=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-745712 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-745712 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m29.346179798s)
-- stdout --
* [old-k8s-version-745712] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20383
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20383-625153/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20383-625153/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-745712" primary control-plane node in "old-k8s-version-745712" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0210 13:14:20.242678 682172 out.go:345] Setting OutFile to fd 1 ...
I0210 13:14:20.242810 682172 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0210 13:14:20.242820 682172 out.go:358] Setting ErrFile to fd 2...
I0210 13:14:20.242824 682172 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0210 13:14:20.242983 682172 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20383-625153/.minikube/bin
I0210 13:14:20.243571 682172 out.go:352] Setting JSON to false
I0210 13:14:20.244715 682172 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":17810,"bootTime":1739175450,"procs":308,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0210 13:14:20.244819 682172 start.go:139] virtualization: kvm guest
I0210 13:14:20.247011 682172 out.go:177] * [old-k8s-version-745712] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0210 13:14:20.248248 682172 out.go:177] - MINIKUBE_LOCATION=20383
I0210 13:14:20.248244 682172 notify.go:220] Checking for updates...
I0210 13:14:20.250797 682172 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0210 13:14:20.252059 682172 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20383-625153/kubeconfig
I0210 13:14:20.253309 682172 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20383-625153/.minikube
I0210 13:14:20.254486 682172 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0210 13:14:20.255729 682172 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0210 13:14:20.257593 682172 config.go:182] Loaded profile config "bridge-651187": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0210 13:14:20.257717 682172 config.go:182] Loaded profile config "flannel-651187": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0210 13:14:20.257810 682172 config.go:182] Loaded profile config "kubernetes-upgrade-284631": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0210 13:14:20.257918 682172 driver.go:394] Setting default libvirt URI to qemu:///system
I0210 13:14:20.297746 682172 out.go:177] * Using the kvm2 driver based on user configuration
I0210 13:14:20.298986 682172 start.go:297] selected driver: kvm2
I0210 13:14:20.299013 682172 start.go:901] validating driver "kvm2" against <nil>
I0210 13:14:20.299036 682172 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0210 13:14:20.300091 682172 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0210 13:14:20.300204 682172 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20383-625153/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0210 13:14:20.315990 682172 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0210 13:14:20.316057 682172 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0210 13:14:20.316329 682172 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0210 13:14:20.316363 682172 cni.go:84] Creating CNI manager for ""
I0210 13:14:20.316408 682172 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0210 13:14:20.316415 682172 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0210 13:14:20.316472 682172 start.go:340] cluster config:
{Name:old-k8s-version-745712 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745712 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0210 13:14:20.316572 682172 iso.go:125] acquiring lock: {Name:mk013d189757e85c0699014f5ef29205d9d4927f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0210 13:14:20.318323 682172 out.go:177] * Starting "old-k8s-version-745712" primary control-plane node in "old-k8s-version-745712" cluster
I0210 13:14:20.319455 682172 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0210 13:14:20.319505 682172 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0210 13:14:20.319517 682172 cache.go:56] Caching tarball of preloaded images
I0210 13:14:20.319584 682172 preload.go:172] Found /home/jenkins/minikube-integration/20383-625153/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0210 13:14:20.319594 682172 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0210 13:14:20.319681 682172 profile.go:143] Saving config to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/config.json ...
I0210 13:14:20.319697 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/config.json: {Name:mk3f760f29178eba4fe697633ce4080f01825600 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:20.319836 682172 start.go:360] acquireMachinesLock for old-k8s-version-745712: {Name:mk28e87da66de739a4c7c70d1fb5afc4ce31a4d0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0210 13:14:20.319888 682172 start.go:364] duration metric: took 30.034µs to acquireMachinesLock for "old-k8s-version-745712"
I0210 13:14:20.319908 682172 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-745712 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-745712 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0210 13:14:20.319991 682172 start.go:125] createHost starting for "" (driver="kvm2")
I0210 13:14:20.321480 682172 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0210 13:14:20.321672 682172 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0210 13:14:20.321727 682172 main.go:141] libmachine: Launching plugin server for driver kvm2
I0210 13:14:20.337877 682172 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41111
I0210 13:14:20.338355 682172 main.go:141] libmachine: () Calling .GetVersion
I0210 13:14:20.338980 682172 main.go:141] libmachine: Using API Version 1
I0210 13:14:20.339006 682172 main.go:141] libmachine: () Calling .SetConfigRaw
I0210 13:14:20.339334 682172 main.go:141] libmachine: () Calling .GetMachineName
I0210 13:14:20.339489 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetMachineName
I0210 13:14:20.339596 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:20.339749 682172 start.go:159] libmachine.API.Create for "old-k8s-version-745712" (driver="kvm2")
I0210 13:14:20.339790 682172 client.go:168] LocalClient.Create starting
I0210 13:14:20.339827 682172 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca.pem
I0210 13:14:20.339873 682172 main.go:141] libmachine: Decoding PEM data...
I0210 13:14:20.339897 682172 main.go:141] libmachine: Parsing certificate...
I0210 13:14:20.339968 682172 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20383-625153/.minikube/certs/cert.pem
I0210 13:14:20.339997 682172 main.go:141] libmachine: Decoding PEM data...
I0210 13:14:20.340014 682172 main.go:141] libmachine: Parsing certificate...
I0210 13:14:20.340039 682172 main.go:141] libmachine: Running pre-create checks...
I0210 13:14:20.340051 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .PreCreateCheck
I0210 13:14:20.340360 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetConfigRaw
I0210 13:14:20.340771 682172 main.go:141] libmachine: Creating machine...
I0210 13:14:20.340787 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .Create
I0210 13:14:20.340921 682172 main.go:141] libmachine: (old-k8s-version-745712) creating KVM machine...
I0210 13:14:20.340931 682172 main.go:141] libmachine: (old-k8s-version-745712) creating network...
I0210 13:14:20.342163 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found existing default KVM network
I0210 13:14:20.343336 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.343160 682195 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:9f:e2:e9} reservation:<nil>}
I0210 13:14:20.344041 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.343976 682195 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:e2:da:dc} reservation:<nil>}
I0210 13:14:20.344946 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.344855 682195 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:96:8d:23} reservation:<nil>}
I0210 13:14:20.346087 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.346004 682195 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003891c0}
I0210 13:14:20.346144 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | created network xml:
I0210 13:14:20.346164 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | <network>
I0210 13:14:20.346179 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | <name>mk-old-k8s-version-745712</name>
I0210 13:14:20.346186 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | <dns enable='no'/>
I0210 13:14:20.346195 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG |
I0210 13:14:20.346212 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0210 13:14:20.346225 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | <dhcp>
I0210 13:14:20.346236 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0210 13:14:20.346247 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | </dhcp>
I0210 13:14:20.346261 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | </ip>
I0210 13:14:20.346304 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG |
I0210 13:14:20.346334 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | </network>
I0210 13:14:20.346348 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG |
I0210 13:14:20.351727 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | trying to create private KVM network mk-old-k8s-version-745712 192.168.72.0/24...
I0210 13:14:20.429237 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | private KVM network mk-old-k8s-version-745712 192.168.72.0/24 created
I0210 13:14:20.429364 682172 main.go:141] libmachine: (old-k8s-version-745712) setting up store path in /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712 ...
I0210 13:14:20.429538 682172 main.go:141] libmachine: (old-k8s-version-745712) building disk image from file:///home/jenkins/minikube-integration/20383-625153/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0210 13:14:20.429690 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.429603 682195 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20383-625153/.minikube
I0210 13:14:20.429854 682172 main.go:141] libmachine: (old-k8s-version-745712) Downloading /home/jenkins/minikube-integration/20383-625153/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20383-625153/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0210 13:14:20.723885 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.723735 682195 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa...
I0210 13:14:20.990153 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.990021 682195 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/old-k8s-version-745712.rawdisk...
I0210 13:14:20.990190 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | Writing magic tar header
I0210 13:14:20.990206 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | Writing SSH key tar header
I0210 13:14:20.990222 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:20.990133 682195 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712 ...
I0210 13:14:20.990238 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712
I0210 13:14:20.990262 682172 main.go:141] libmachine: (old-k8s-version-745712) setting executable bit set on /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712 (perms=drwx------)
I0210 13:14:20.990289 682172 main.go:141] libmachine: (old-k8s-version-745712) setting executable bit set on /home/jenkins/minikube-integration/20383-625153/.minikube/machines (perms=drwxr-xr-x)
I0210 13:14:20.990305 682172 main.go:141] libmachine: (old-k8s-version-745712) setting executable bit set on /home/jenkins/minikube-integration/20383-625153/.minikube (perms=drwxr-xr-x)
I0210 13:14:20.990322 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20383-625153/.minikube/machines
I0210 13:14:20.990337 682172 main.go:141] libmachine: (old-k8s-version-745712) setting executable bit set on /home/jenkins/minikube-integration/20383-625153 (perms=drwxrwxr-x)
I0210 13:14:20.990351 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20383-625153/.minikube
I0210 13:14:20.990367 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20383-625153
I0210 13:14:20.990381 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0210 13:14:20.990407 682172 main.go:141] libmachine: (old-k8s-version-745712) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0210 13:14:20.990420 682172 main.go:141] libmachine: (old-k8s-version-745712) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0210 13:14:20.990426 682172 main.go:141] libmachine: (old-k8s-version-745712) creating domain...
I0210 13:14:20.990434 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home/jenkins
I0210 13:14:20.990442 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | checking permissions on dir: /home
I0210 13:14:20.990450 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | skipping /home - not owner
I0210 13:14:20.991642 682172 main.go:141] libmachine: (old-k8s-version-745712) define libvirt domain using xml:
I0210 13:14:20.991679 682172 main.go:141] libmachine: (old-k8s-version-745712) <domain type='kvm'>
I0210 13:14:20.991690 682172 main.go:141] libmachine: (old-k8s-version-745712) <name>old-k8s-version-745712</name>
I0210 13:14:20.991702 682172 main.go:141] libmachine: (old-k8s-version-745712) <memory unit='MiB'>2200</memory>
I0210 13:14:20.991714 682172 main.go:141] libmachine: (old-k8s-version-745712) <vcpu>2</vcpu>
I0210 13:14:20.991733 682172 main.go:141] libmachine: (old-k8s-version-745712) <features>
I0210 13:14:20.991741 682172 main.go:141] libmachine: (old-k8s-version-745712) <acpi/>
I0210 13:14:20.991745 682172 main.go:141] libmachine: (old-k8s-version-745712) <apic/>
I0210 13:14:20.991752 682172 main.go:141] libmachine: (old-k8s-version-745712) <pae/>
I0210 13:14:20.991756 682172 main.go:141] libmachine: (old-k8s-version-745712)
I0210 13:14:20.991761 682172 main.go:141] libmachine: (old-k8s-version-745712) </features>
I0210 13:14:20.991768 682172 main.go:141] libmachine: (old-k8s-version-745712) <cpu mode='host-passthrough'>
I0210 13:14:20.991827 682172 main.go:141] libmachine: (old-k8s-version-745712)
I0210 13:14:20.991865 682172 main.go:141] libmachine: (old-k8s-version-745712) </cpu>
I0210 13:14:20.991881 682172 main.go:141] libmachine: (old-k8s-version-745712) <os>
I0210 13:14:20.991894 682172 main.go:141] libmachine: (old-k8s-version-745712) <type>hvm</type>
I0210 13:14:20.991908 682172 main.go:141] libmachine: (old-k8s-version-745712) <boot dev='cdrom'/>
I0210 13:14:20.991920 682172 main.go:141] libmachine: (old-k8s-version-745712) <boot dev='hd'/>
I0210 13:14:20.991933 682172 main.go:141] libmachine: (old-k8s-version-745712) <bootmenu enable='no'/>
I0210 13:14:20.991952 682172 main.go:141] libmachine: (old-k8s-version-745712) </os>
I0210 13:14:20.991963 682172 main.go:141] libmachine: (old-k8s-version-745712) <devices>
I0210 13:14:20.991972 682172 main.go:141] libmachine: (old-k8s-version-745712) <disk type='file' device='cdrom'>
I0210 13:14:20.991990 682172 main.go:141] libmachine: (old-k8s-version-745712) <source file='/home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/boot2docker.iso'/>
I0210 13:14:20.992010 682172 main.go:141] libmachine: (old-k8s-version-745712) <target dev='hdc' bus='scsi'/>
I0210 13:14:20.992028 682172 main.go:141] libmachine: (old-k8s-version-745712) <readonly/>
I0210 13:14:20.992050 682172 main.go:141] libmachine: (old-k8s-version-745712) </disk>
I0210 13:14:20.992060 682172 main.go:141] libmachine: (old-k8s-version-745712) <disk type='file' device='disk'>
I0210 13:14:20.992069 682172 main.go:141] libmachine: (old-k8s-version-745712) <driver name='qemu' type='raw' cache='default' io='threads' />
I0210 13:14:20.992086 682172 main.go:141] libmachine: (old-k8s-version-745712) <source file='/home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/old-k8s-version-745712.rawdisk'/>
I0210 13:14:20.992101 682172 main.go:141] libmachine: (old-k8s-version-745712) <target dev='hda' bus='virtio'/>
I0210 13:14:20.992127 682172 main.go:141] libmachine: (old-k8s-version-745712) </disk>
I0210 13:14:20.992155 682172 main.go:141] libmachine: (old-k8s-version-745712) <interface type='network'>
I0210 13:14:20.992168 682172 main.go:141] libmachine: (old-k8s-version-745712) <source network='mk-old-k8s-version-745712'/>
I0210 13:14:20.992177 682172 main.go:141] libmachine: (old-k8s-version-745712) <model type='virtio'/>
I0210 13:14:20.992182 682172 main.go:141] libmachine: (old-k8s-version-745712) </interface>
I0210 13:14:20.992189 682172 main.go:141] libmachine: (old-k8s-version-745712) <interface type='network'>
I0210 13:14:20.992195 682172 main.go:141] libmachine: (old-k8s-version-745712) <source network='default'/>
I0210 13:14:20.992202 682172 main.go:141] libmachine: (old-k8s-version-745712) <model type='virtio'/>
I0210 13:14:20.992207 682172 main.go:141] libmachine: (old-k8s-version-745712) </interface>
I0210 13:14:20.992213 682172 main.go:141] libmachine: (old-k8s-version-745712) <serial type='pty'>
I0210 13:14:20.992218 682172 main.go:141] libmachine: (old-k8s-version-745712) <target port='0'/>
I0210 13:14:20.992224 682172 main.go:141] libmachine: (old-k8s-version-745712) </serial>
I0210 13:14:20.992241 682172 main.go:141] libmachine: (old-k8s-version-745712) <console type='pty'>
I0210 13:14:20.992260 682172 main.go:141] libmachine: (old-k8s-version-745712) <target type='serial' port='0'/>
I0210 13:14:20.992272 682172 main.go:141] libmachine: (old-k8s-version-745712) </console>
I0210 13:14:20.992283 682172 main.go:141] libmachine: (old-k8s-version-745712) <rng model='virtio'>
I0210 13:14:20.992297 682172 main.go:141] libmachine: (old-k8s-version-745712) <backend model='random'>/dev/random</backend>
I0210 13:14:20.992307 682172 main.go:141] libmachine: (old-k8s-version-745712) </rng>
I0210 13:14:20.992317 682172 main.go:141] libmachine: (old-k8s-version-745712)
I0210 13:14:20.992332 682172 main.go:141] libmachine: (old-k8s-version-745712)
I0210 13:14:20.992350 682172 main.go:141] libmachine: (old-k8s-version-745712) </devices>
I0210 13:14:20.992360 682172 main.go:141] libmachine: (old-k8s-version-745712) </domain>
I0210 13:14:20.992372 682172 main.go:141] libmachine: (old-k8s-version-745712)
I0210 13:14:20.997405 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:f0:b9:c2 in network default
I0210 13:14:20.998051 682172 main.go:141] libmachine: (old-k8s-version-745712) starting domain...
I0210 13:14:20.998081 682172 main.go:141] libmachine: (old-k8s-version-745712) ensuring networks are active...
I0210 13:14:20.998095 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:20.998772 682172 main.go:141] libmachine: (old-k8s-version-745712) Ensuring network default is active
I0210 13:14:20.999084 682172 main.go:141] libmachine: (old-k8s-version-745712) Ensuring network mk-old-k8s-version-745712 is active
I0210 13:14:20.999589 682172 main.go:141] libmachine: (old-k8s-version-745712) getting domain XML...
I0210 13:14:21.000284 682172 main.go:141] libmachine: (old-k8s-version-745712) creating domain...
I0210 13:14:22.494518 682172 main.go:141] libmachine: (old-k8s-version-745712) waiting for IP...
I0210 13:14:22.495570 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:22.496181 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:22.496248 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:22.496181 682195 retry.go:31] will retry after 206.585724ms: waiting for domain to come up
I0210 13:14:22.704930 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:22.705536 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:22.705564 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:22.705504 682195 retry.go:31] will retry after 261.073956ms: waiting for domain to come up
I0210 13:14:22.968114 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:22.968968 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:22.968999 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:22.968859 682195 retry.go:31] will retry after 420.810796ms: waiting for domain to come up
I0210 13:14:23.391338 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:23.391957 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:23.392032 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:23.391952 682195 retry.go:31] will retry after 464.402737ms: waiting for domain to come up
I0210 13:14:23.857978 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:23.858996 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:23.859024 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:23.858948 682195 retry.go:31] will retry after 734.537527ms: waiting for domain to come up
I0210 13:14:24.595493 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:24.596176 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:24.596214 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:24.596068 682195 retry.go:31] will retry after 804.337114ms: waiting for domain to come up
I0210 13:14:25.402037 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:25.402621 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:25.402647 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:25.402526 682195 retry.go:31] will retry after 932.090459ms: waiting for domain to come up
I0210 13:14:26.336776 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:26.337362 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:26.337426 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:26.337328 682195 retry.go:31] will retry after 1.137737045s: waiting for domain to come up
I0210 13:14:27.476268 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:27.476832 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:27.476866 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:27.476802 682195 retry.go:31] will retry after 1.158429769s: waiting for domain to come up
I0210 13:14:28.637058 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:28.637613 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:28.637648 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:28.637566 682195 retry.go:31] will retry after 2.042710093s: waiting for domain to come up
I0210 13:14:30.682074 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:30.682779 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:30.682805 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:30.682745 682195 retry.go:31] will retry after 2.466781545s: waiting for domain to come up
I0210 13:14:33.151483 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:33.152045 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:33.152077 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:33.152021 682195 retry.go:31] will retry after 3.390544227s: waiting for domain to come up
I0210 13:14:36.543797 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:36.544313 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:36.544343 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:36.544281 682195 retry.go:31] will retry after 3.699439795s: waiting for domain to come up
I0210 13:14:40.246779 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:40.247429 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find current IP address of domain old-k8s-version-745712 in network mk-old-k8s-version-745712
I0210 13:14:40.247461 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | I0210 13:14:40.247400 682195 retry.go:31] will retry after 3.559256722s: waiting for domain to come up
I0210 13:14:43.810152 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:43.810621 682172 main.go:141] libmachine: (old-k8s-version-745712) found domain IP: 192.168.72.78
I0210 13:14:43.810651 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has current primary IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:43.810661 682172 main.go:141] libmachine: (old-k8s-version-745712) reserving static IP address...
I0210 13:14:43.810994 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-745712", mac: "52:54:00:dd:e4:89", ip: "192.168.72.78"} in network mk-old-k8s-version-745712
I0210 13:14:43.892254 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | Getting to WaitForSSH function...
I0210 13:14:43.892301 682172 main.go:141] libmachine: (old-k8s-version-745712) reserved static IP address 192.168.72.78 for domain old-k8s-version-745712
I0210 13:14:43.892316 682172 main.go:141] libmachine: (old-k8s-version-745712) waiting for SSH...
I0210 13:14:43.894874 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:43.895314 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:minikube Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:43.895349 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:43.895479 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | Using SSH client type: external
I0210 13:14:43.895503 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | Using SSH private key: /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa (-rw-------)
I0210 13:14:43.895574 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.78 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa -p 22] /usr/bin/ssh <nil>}
I0210 13:14:43.895599 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | About to run SSH command:
I0210 13:14:43.895613 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | exit 0
I0210 13:14:44.020833 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | SSH cmd err, output: <nil>:
I0210 13:14:44.021136 682172 main.go:141] libmachine: (old-k8s-version-745712) KVM machine creation complete
I0210 13:14:44.021449 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetConfigRaw
I0210 13:14:44.022060 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:44.022270 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:44.022435 682172 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0210 13:14:44.022451 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetState
I0210 13:14:44.023751 682172 main.go:141] libmachine: Detecting operating system of created instance...
I0210 13:14:44.023767 682172 main.go:141] libmachine: Waiting for SSH to be available...
I0210 13:14:44.023785 682172 main.go:141] libmachine: Getting to WaitForSSH function...
I0210 13:14:44.023791 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.026085 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.026472 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.026495 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.026694 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:44.026872 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.026993 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.027096 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:44.027285 682172 main.go:141] libmachine: Using SSH client type: native
I0210 13:14:44.027490 682172 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.72.78 22 <nil> <nil>}
I0210 13:14:44.027506 682172 main.go:141] libmachine: About to run SSH command:
exit 0
I0210 13:14:44.140228 682172 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0210 13:14:44.140257 682172 main.go:141] libmachine: Detecting the provisioner...
I0210 13:14:44.140269 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.143646 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.144059 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.144102 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.144328 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:44.144557 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.144760 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.144932 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:44.145134 682172 main.go:141] libmachine: Using SSH client type: native
I0210 13:14:44.145395 682172 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.72.78 22 <nil> <nil>}
I0210 13:14:44.145412 682172 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0210 13:14:44.253584 682172 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0210 13:14:44.253658 682172 main.go:141] libmachine: found compatible host: buildroot
I0210 13:14:44.253664 682172 main.go:141] libmachine: Provisioning with buildroot...
I0210 13:14:44.253672 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetMachineName
I0210 13:14:44.253938 682172 buildroot.go:166] provisioning hostname "old-k8s-version-745712"
I0210 13:14:44.253972 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetMachineName
I0210 13:14:44.254182 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.256870 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.257207 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.257243 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.257426 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:44.257583 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.257750 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.257846 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:44.258024 682172 main.go:141] libmachine: Using SSH client type: native
I0210 13:14:44.258201 682172 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.72.78 22 <nil> <nil>}
I0210 13:14:44.258212 682172 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-745712 && echo "old-k8s-version-745712" | sudo tee /etc/hostname
I0210 13:14:44.378661 682172 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-745712
I0210 13:14:44.378690 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.381398 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.381693 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.381742 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.381863 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:44.382063 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.382245 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.382434 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:44.382625 682172 main.go:141] libmachine: Using SSH client type: native
I0210 13:14:44.382796 682172 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.72.78 22 <nil> <nil>}
I0210 13:14:44.382812 682172 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-745712' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-745712/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-745712' | sudo tee -a /etc/hosts;
fi
fi
I0210 13:14:44.501162 682172 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0210 13:14:44.501203 682172 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20383-625153/.minikube CaCertPath:/home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20383-625153/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20383-625153/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20383-625153/.minikube}
I0210 13:14:44.501257 682172 buildroot.go:174] setting up certificates
I0210 13:14:44.501271 682172 provision.go:84] configureAuth start
I0210 13:14:44.501291 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetMachineName
I0210 13:14:44.501672 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetIP
I0210 13:14:44.504548 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.504926 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.504949 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.505145 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.507689 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.508029 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.508060 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.508220 682172 provision.go:143] copyHostCerts
I0210 13:14:44.508290 682172 exec_runner.go:144] found /home/jenkins/minikube-integration/20383-625153/.minikube/ca.pem, removing ...
I0210 13:14:44.508305 682172 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20383-625153/.minikube/ca.pem
I0210 13:14:44.508359 682172 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20383-625153/.minikube/ca.pem (1082 bytes)
I0210 13:14:44.508471 682172 exec_runner.go:144] found /home/jenkins/minikube-integration/20383-625153/.minikube/cert.pem, removing ...
I0210 13:14:44.508479 682172 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20383-625153/.minikube/cert.pem
I0210 13:14:44.508498 682172 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20383-625153/.minikube/cert.pem (1123 bytes)
I0210 13:14:44.508561 682172 exec_runner.go:144] found /home/jenkins/minikube-integration/20383-625153/.minikube/key.pem, removing ...
I0210 13:14:44.508570 682172 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20383-625153/.minikube/key.pem
I0210 13:14:44.508589 682172 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20383-625153/.minikube/key.pem (1675 bytes)
I0210 13:14:44.508660 682172 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20383-625153/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-745712 san=[127.0.0.1 192.168.72.78 localhost minikube old-k8s-version-745712]
I0210 13:14:44.675648 682172 provision.go:177] copyRemoteCerts
I0210 13:14:44.675714 682172 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0210 13:14:44.675749 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.678547 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.678865 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.678907 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.679050 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:44.679246 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.679390 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:44.679500 682172 sshutil.go:53] new ssh client: &{IP:192.168.72.78 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa Username:docker}
I0210 13:14:44.763002 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0210 13:14:44.786811 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0210 13:14:44.810662 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0210 13:14:44.833463 682172 provision.go:87] duration metric: took 332.173507ms to configureAuth
I0210 13:14:44.833497 682172 buildroot.go:189] setting minikube options for container-runtime
I0210 13:14:44.833698 682172 config.go:182] Loaded profile config "old-k8s-version-745712": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0210 13:14:44.833805 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:44.836736 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.837062 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:44.837123 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:44.837336 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:44.837539 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.837673 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:44.837828 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:44.837974 682172 main.go:141] libmachine: Using SSH client type: native
I0210 13:14:44.838174 682172 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.72.78 22 <nil> <nil>}
I0210 13:14:44.838188 682172 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0210 13:14:45.060121 682172 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0210 13:14:45.060154 682172 main.go:141] libmachine: Checking connection to Docker...
I0210 13:14:45.060164 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetURL
I0210 13:14:45.061454 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | using libvirt version 6000000
I0210 13:14:45.063708 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.064054 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.064087 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.064228 682172 main.go:141] libmachine: Docker is up and running!
I0210 13:14:45.064246 682172 main.go:141] libmachine: Reticulating splines...
I0210 13:14:45.064256 682172 client.go:171] duration metric: took 24.724453722s to LocalClient.Create
I0210 13:14:45.064286 682172 start.go:167] duration metric: took 24.724536197s to libmachine.API.Create "old-k8s-version-745712"
I0210 13:14:45.064304 682172 start.go:293] postStartSetup for "old-k8s-version-745712" (driver="kvm2")
I0210 13:14:45.064313 682172 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0210 13:14:45.064331 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:45.064563 682172 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0210 13:14:45.064588 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:45.066881 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.067208 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.067237 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.067372 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:45.067556 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:45.067776 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:45.067930 682172 sshutil.go:53] new ssh client: &{IP:192.168.72.78 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa Username:docker}
I0210 13:14:45.152456 682172 ssh_runner.go:195] Run: cat /etc/os-release
I0210 13:14:45.156303 682172 info.go:137] Remote host: Buildroot 2023.02.9
I0210 13:14:45.156333 682172 filesync.go:126] Scanning /home/jenkins/minikube-integration/20383-625153/.minikube/addons for local assets ...
I0210 13:14:45.156399 682172 filesync.go:126] Scanning /home/jenkins/minikube-integration/20383-625153/.minikube/files for local assets ...
I0210 13:14:45.156475 682172 filesync.go:149] local asset: /home/jenkins/minikube-integration/20383-625153/.minikube/files/etc/ssl/certs/6323522.pem -> 6323522.pem in /etc/ssl/certs
I0210 13:14:45.156768 682172 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0210 13:14:45.168386 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/files/etc/ssl/certs/6323522.pem --> /etc/ssl/certs/6323522.pem (1708 bytes)
I0210 13:14:45.193029 682172 start.go:296] duration metric: took 128.706252ms for postStartSetup
I0210 13:14:45.193125 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetConfigRaw
I0210 13:14:45.193764 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetIP
I0210 13:14:45.196488 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.196869 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.196899 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.197176 682172 profile.go:143] Saving config to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/config.json ...
I0210 13:14:45.197372 682172 start.go:128] duration metric: took 24.877368067s to createHost
I0210 13:14:45.197420 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:45.199809 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.200159 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.200197 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.200314 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:45.200516 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:45.200669 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:45.200785 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:45.200942 682172 main.go:141] libmachine: Using SSH client type: native
I0210 13:14:45.201176 682172 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.72.78 22 <nil> <nil>}
I0210 13:14:45.201190 682172 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0210 13:14:45.305699 682172 main.go:141] libmachine: SSH cmd err, output: <nil>: 1739193285.277200269
I0210 13:14:45.305728 682172 fix.go:216] guest clock: 1739193285.277200269
I0210 13:14:45.305735 682172 fix.go:229] Guest: 2025-02-10 13:14:45.277200269 +0000 UTC Remote: 2025-02-10 13:14:45.19738607 +0000 UTC m=+24.995254328 (delta=79.814199ms)
I0210 13:14:45.305767 682172 fix.go:200] guest clock delta is within tolerance: 79.814199ms
I0210 13:14:45.305773 682172 start.go:83] releasing machines lock for "old-k8s-version-745712", held for 24.985875078s
I0210 13:14:45.305795 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:45.306093 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetIP
I0210 13:14:45.309461 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.309915 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.309950 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.310216 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:45.310695 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:45.310875 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .DriverName
I0210 13:14:45.310954 682172 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0210 13:14:45.311005 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:45.311276 682172 ssh_runner.go:195] Run: cat /version.json
I0210 13:14:45.311320 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHHostname
I0210 13:14:45.313909 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.314051 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.314291 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.314317 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.314494 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:45.314506 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:45.314528 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:45.314702 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:45.314707 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHPort
I0210 13:14:45.314882 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHKeyPath
I0210 13:14:45.314897 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:45.315021 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetSSHUsername
I0210 13:14:45.315074 682172 sshutil.go:53] new ssh client: &{IP:192.168.72.78 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa Username:docker}
I0210 13:14:45.315191 682172 sshutil.go:53] new ssh client: &{IP:192.168.72.78 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20383-625153/.minikube/machines/old-k8s-version-745712/id_rsa Username:docker}
I0210 13:14:45.418108 682172 ssh_runner.go:195] Run: systemctl --version
I0210 13:14:45.423784 682172 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0210 13:14:45.584490 682172 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0210 13:14:45.591240 682172 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0210 13:14:45.591326 682172 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0210 13:14:45.608851 682172 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0210 13:14:45.608886 682172 start.go:495] detecting cgroup driver to use...
I0210 13:14:45.608983 682172 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0210 13:14:45.629788 682172 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0210 13:14:45.646330 682172 docker.go:217] disabling cri-docker service (if available) ...
I0210 13:14:45.646412 682172 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0210 13:14:45.660209 682172 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0210 13:14:45.672873 682172 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0210 13:14:45.782708 682172 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0210 13:14:45.930552 682172 docker.go:233] disabling docker service ...
I0210 13:14:45.930626 682172 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0210 13:14:45.943991 682172 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0210 13:14:45.956198 682172 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0210 13:14:46.063464 682172 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0210 13:14:46.180105 682172 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0210 13:14:46.193598 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0210 13:14:46.210559 682172 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0210 13:14:46.210616 682172 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0210 13:14:46.219804 682172 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0210 13:14:46.219884 682172 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0210 13:14:46.229343 682172 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0210 13:14:46.238805 682172 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0210 13:14:46.248612 682172 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0210 13:14:46.258352 682172 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0210 13:14:46.267273 682172 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0210 13:14:46.267335 682172 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0210 13:14:46.280542 682172 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0210 13:14:46.296367 682172 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0210 13:14:46.410767 682172 ssh_runner.go:195] Run: sudo systemctl restart crio
I0210 13:14:46.503654 682172 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0210 13:14:46.503746 682172 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0210 13:14:46.509087 682172 start.go:563] Will wait 60s for crictl version
I0210 13:14:46.509182 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:46.512971 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0210 13:14:46.557031 682172 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0210 13:14:46.557133 682172 ssh_runner.go:195] Run: crio --version
I0210 13:14:46.592284 682172 ssh_runner.go:195] Run: crio --version
I0210 13:14:46.694777 682172 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0210 13:14:46.787922 682172 main.go:141] libmachine: (old-k8s-version-745712) Calling .GetIP
I0210 13:14:46.790874 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:46.791161 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:dd:e4:89", ip: ""} in network mk-old-k8s-version-745712: {Iface:virbr2 ExpiryTime:2025-02-10 14:14:36 +0000 UTC Type:0 Mac:52:54:00:dd:e4:89 Iaid: IPaddr:192.168.72.78 Prefix:24 Hostname:old-k8s-version-745712 Clientid:01:52:54:00:dd:e4:89}
I0210 13:14:46.791188 682172 main.go:141] libmachine: (old-k8s-version-745712) DBG | domain old-k8s-version-745712 has defined IP address 192.168.72.78 and MAC address 52:54:00:dd:e4:89 in network mk-old-k8s-version-745712
I0210 13:14:46.791395 682172 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0210 13:14:46.795489 682172 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0210 13:14:46.806964 682172 kubeadm.go:883] updating cluster {Name:old-k8s-version-745712 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745712 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.78 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0210 13:14:46.807082 682172 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0210 13:14:46.807127 682172 ssh_runner.go:195] Run: sudo crictl images --output json
I0210 13:14:46.836459 682172 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0210 13:14:46.836543 682172 ssh_runner.go:195] Run: which lz4
I0210 13:14:46.840213 682172 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0210 13:14:46.843959 682172 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0210 13:14:46.843996 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0210 13:14:48.232758 682172 crio.go:462] duration metric: took 1.392570671s to copy over tarball
I0210 13:14:48.232838 682172 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0210 13:14:50.778971 682172 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.546100658s)
I0210 13:14:50.779014 682172 crio.go:469] duration metric: took 2.546215442s to extract the tarball
I0210 13:14:50.779025 682172 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0210 13:14:50.823187 682172 ssh_runner.go:195] Run: sudo crictl images --output json
I0210 13:14:50.866620 682172 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0210 13:14:50.866659 682172 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0210 13:14:50.866738 682172 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:50.866772 682172 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:50.866801 682172 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:50.866822 682172 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0210 13:14:50.866838 682172 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0210 13:14:50.866805 682172 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0210 13:14:50.866868 682172 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:50.866722 682172 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0210 13:14:50.868421 682172 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0210 13:14:50.868433 682172 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:50.868427 682172 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:50.868427 682172 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:50.868425 682172 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0210 13:14:50.868433 682172 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:50.868490 682172 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0210 13:14:50.868658 682172 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0210 13:14:51.010064 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0210 13:14:51.010325 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:51.016725 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:51.022451 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:51.023151 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:51.038464 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0210 13:14:51.043336 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0210 13:14:51.143129 682172 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0210 13:14:51.143163 682172 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0210 13:14:51.143184 682172 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0210 13:14:51.143203 682172 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:51.143251 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.143252 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.200617 682172 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0210 13:14:51.200672 682172 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:51.200733 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.200794 682172 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0210 13:14:51.200841 682172 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:51.200890 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.210121 682172 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0210 13:14:51.210183 682172 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:51.210241 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.217678 682172 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0210 13:14:51.217711 682172 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0210 13:14:51.217735 682172 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0210 13:14:51.217748 682172 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0210 13:14:51.217785 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.217819 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:51.217834 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:51.217783 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0210 13:14:51.217789 682172 ssh_runner.go:195] Run: which crictl
I0210 13:14:51.217873 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:51.217928 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:51.242164 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0210 13:14:51.339431 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:51.350089 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:51.350162 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:51.350172 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:51.350219 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0210 13:14:51.350263 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0210 13:14:51.393393 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0210 13:14:51.467328 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0210 13:14:51.544552 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0210 13:14:51.600415 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0210 13:14:51.600471 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0210 13:14:51.600494 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0210 13:14:51.600504 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0210 13:14:51.600546 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0210 13:14:51.600552 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0210 13:14:51.600608 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0210 13:14:51.714794 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0210 13:14:51.714950 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0210 13:14:51.714964 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0210 13:14:51.714965 682172 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0210 13:14:51.714997 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0210 13:14:51.748728 682172 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0210 13:14:51.862100 682172 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0210 13:14:52.004078 682172 cache_images.go:92] duration metric: took 1.137397454s to LoadCachedImages
W0210 13:14:52.004212 682172 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20383-625153/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0210 13:14:52.004234 682172 kubeadm.go:934] updating node { 192.168.72.78 8443 v1.20.0 crio true true} ...
I0210 13:14:52.004371 682172 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-745712 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.78
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745712 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0210 13:14:52.004470 682172 ssh_runner.go:195] Run: crio config
I0210 13:14:52.058352 682172 cni.go:84] Creating CNI manager for ""
I0210 13:14:52.058379 682172 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0210 13:14:52.058398 682172 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0210 13:14:52.058426 682172 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.78 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-745712 NodeName:old-k8s-version-745712 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.78"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.78 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0210 13:14:52.058596 682172 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.78
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-745712"
kubeletExtraArgs:
node-ip: 192.168.72.78
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.78"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0210 13:14:52.058677 682172 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0210 13:14:52.068572 682172 binaries.go:44] Found k8s binaries, skipping transfer
I0210 13:14:52.068648 682172 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0210 13:14:52.077778 682172 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0210 13:14:52.094300 682172 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0210 13:14:52.110040 682172 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0210 13:14:52.126523 682172 ssh_runner.go:195] Run: grep 192.168.72.78 control-plane.minikube.internal$ /etc/hosts
I0210 13:14:52.130428 682172 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.78 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0210 13:14:52.142166 682172 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0210 13:14:52.277069 682172 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0210 13:14:52.296962 682172 certs.go:68] Setting up /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712 for IP: 192.168.72.78
I0210 13:14:52.296993 682172 certs.go:194] generating shared ca certs ...
I0210 13:14:52.297018 682172 certs.go:226] acquiring lock for ca certs: {Name:mkf2f72f82a6bd7e3c16bb224cd26b80c3c89e0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.297270 682172 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20383-625153/.minikube/ca.key
I0210 13:14:52.297350 682172 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20383-625153/.minikube/proxy-client-ca.key
I0210 13:14:52.297368 682172 certs.go:256] generating profile certs ...
I0210 13:14:52.297459 682172 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/client.key
I0210 13:14:52.297486 682172 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/client.crt with IP's: []
I0210 13:14:52.398082 682172 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/client.crt ...
I0210 13:14:52.398126 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/client.crt: {Name:mk8866bedf6d0c5eea5b5f16d35fdcfa165da624 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.398338 682172 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/client.key ...
I0210 13:14:52.398362 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/client.key: {Name:mkf487e26cdec63e0d8d0db38f4f23879595358c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.398502 682172 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.key.f20ca5cb
I0210 13:14:52.398526 682172 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.crt.f20ca5cb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.78]
I0210 13:14:52.784120 682172 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.crt.f20ca5cb ...
I0210 13:14:52.784155 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.crt.f20ca5cb: {Name:mk9f46fd8c7564133fd155ed7105da02cdceae90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.784371 682172 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.key.f20ca5cb ...
I0210 13:14:52.784392 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.key.f20ca5cb: {Name:mkd38e78e7e6d443ed74e1b1ace0177e17da5c09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.784520 682172 certs.go:381] copying /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.crt.f20ca5cb -> /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.crt
I0210 13:14:52.784600 682172 certs.go:385] copying /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.key.f20ca5cb -> /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.key
I0210 13:14:52.784652 682172 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.key
I0210 13:14:52.784668 682172 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.crt with IP's: []
I0210 13:14:52.860364 682172 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.crt ...
I0210 13:14:52.860393 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.crt: {Name:mkbc9c45bc194843a3245f499f35dfc4d9032392 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.860565 682172 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.key ...
I0210 13:14:52.860613 682172 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.key: {Name:mk2d6b8b2caaef24eda83dd2b91a9822c51e0d7b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 13:14:52.860872 682172 certs.go:484] found cert: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/632352.pem (1338 bytes)
W0210 13:14:52.860914 682172 certs.go:480] ignoring /home/jenkins/minikube-integration/20383-625153/.minikube/certs/632352_empty.pem, impossibly tiny 0 bytes
I0210 13:14:52.860925 682172 certs.go:484] found cert: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca-key.pem (1675 bytes)
I0210 13:14:52.860945 682172 certs.go:484] found cert: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/ca.pem (1082 bytes)
I0210 13:14:52.860967 682172 certs.go:484] found cert: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/cert.pem (1123 bytes)
I0210 13:14:52.860987 682172 certs.go:484] found cert: /home/jenkins/minikube-integration/20383-625153/.minikube/certs/key.pem (1675 bytes)
I0210 13:14:52.861025 682172 certs.go:484] found cert: /home/jenkins/minikube-integration/20383-625153/.minikube/files/etc/ssl/certs/6323522.pem (1708 bytes)
I0210 13:14:52.861651 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0210 13:14:52.887216 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0210 13:14:52.909860 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0210 13:14:52.932644 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0210 13:14:52.954608 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0210 13:14:53.000437 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0210 13:14:53.035269 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0210 13:14:53.143691 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/profiles/old-k8s-version-745712/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0210 13:14:53.217151 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0210 13:14:53.247992 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/certs/632352.pem --> /usr/share/ca-certificates/632352.pem (1338 bytes)
I0210 13:14:53.270692 682172 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20383-625153/.minikube/files/etc/ssl/certs/6323522.pem --> /usr/share/ca-certificates/6323522.pem (1708 bytes)
I0210 13:14:53.294011 682172 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0210 13:14:53.309374 682172 ssh_runner.go:195] Run: openssl version
I0210 13:14:53.314628 682172 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0210 13:14:53.324649 682172 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0210 13:14:53.328766 682172 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 10 12:05 /usr/share/ca-certificates/minikubeCA.pem
I0210 13:14:53.328818 682172 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0210 13:14:53.334309 682172 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0210 13:14:53.344678 682172 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/632352.pem && ln -fs /usr/share/ca-certificates/632352.pem /etc/ssl/certs/632352.pem"
I0210 13:14:53.354978 682172 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/632352.pem
I0210 13:14:53.358973 682172 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 10 12:13 /usr/share/ca-certificates/632352.pem
I0210 13:14:53.359025 682172 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/632352.pem
I0210 13:14:53.364252 682172 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/632352.pem /etc/ssl/certs/51391683.0"
I0210 13:14:53.374540 682172 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6323522.pem && ln -fs /usr/share/ca-certificates/6323522.pem /etc/ssl/certs/6323522.pem"
I0210 13:14:53.385028 682172 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6323522.pem
I0210 13:14:53.389180 682172 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 10 12:13 /usr/share/ca-certificates/6323522.pem
I0210 13:14:53.389226 682172 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6323522.pem
I0210 13:14:53.394483 682172 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6323522.pem /etc/ssl/certs/3ec20f2e.0"
I0210 13:14:53.405602 682172 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0210 13:14:53.409366 682172 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0210 13:14:53.409432 682172 kubeadm.go:392] StartCluster: {Name:old-k8s-version-745712 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745712 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.78 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0210 13:14:53.409535 682172 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0210 13:14:53.409614 682172 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0210 13:14:53.445633 682172 cri.go:89] found id: ""
I0210 13:14:53.445703 682172 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0210 13:14:53.455890 682172 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0210 13:14:53.464893 682172 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0210 13:14:53.474970 682172 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0210 13:14:53.474992 682172 kubeadm.go:157] found existing configuration files:
I0210 13:14:53.475046 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0210 13:14:53.484704 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0210 13:14:53.484768 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0210 13:14:53.494631 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0210 13:14:53.504400 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0210 13:14:53.504489 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0210 13:14:53.513989 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0210 13:14:53.522408 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0210 13:14:53.522473 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0210 13:14:53.531257 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0210 13:14:53.539586 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0210 13:14:53.539644 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0210 13:14:53.548213 682172 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0210 13:14:53.803405 682172 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0210 13:16:52.014082 682172 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0210 13:16:52.014169 682172 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0210 13:16:52.015526 682172 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0210 13:16:52.015566 682172 kubeadm.go:310] [preflight] Running pre-flight checks
I0210 13:16:52.015628 682172 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0210 13:16:52.015748 682172 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0210 13:16:52.015866 682172 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0210 13:16:52.015973 682172 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0210 13:16:52.017897 682172 out.go:235] - Generating certificates and keys ...
I0210 13:16:52.017986 682172 kubeadm.go:310] [certs] Using existing ca certificate authority
I0210 13:16:52.018046 682172 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0210 13:16:52.018110 682172 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0210 13:16:52.018159 682172 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0210 13:16:52.018248 682172 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0210 13:16:52.018352 682172 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0210 13:16:52.018451 682172 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0210 13:16:52.018578 682172 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-745712] and IPs [192.168.72.78 127.0.0.1 ::1]
I0210 13:16:52.018648 682172 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0210 13:16:52.018825 682172 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-745712] and IPs [192.168.72.78 127.0.0.1 ::1]
I0210 13:16:52.018928 682172 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0210 13:16:52.019021 682172 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0210 13:16:52.019093 682172 kubeadm.go:310] [certs] Generating "sa" key and public key
I0210 13:16:52.019174 682172 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0210 13:16:52.019256 682172 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0210 13:16:52.019343 682172 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0210 13:16:52.019432 682172 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0210 13:16:52.019513 682172 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0210 13:16:52.019630 682172 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0210 13:16:52.019747 682172 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0210 13:16:52.019801 682172 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0210 13:16:52.019892 682172 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0210 13:16:52.021521 682172 out.go:235] - Booting up control plane ...
I0210 13:16:52.021611 682172 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0210 13:16:52.021694 682172 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0210 13:16:52.021817 682172 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0210 13:16:52.021899 682172 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0210 13:16:52.022045 682172 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0210 13:16:52.022097 682172 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0210 13:16:52.022159 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:16:52.022349 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:16:52.022423 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:16:52.022584 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:16:52.022645 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:16:52.022820 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:16:52.022915 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:16:52.023076 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:16:52.023136 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:16:52.023295 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:16:52.023301 682172 kubeadm.go:310]
I0210 13:16:52.023335 682172 kubeadm.go:310] Unfortunately, an error has occurred:
I0210 13:16:52.023374 682172 kubeadm.go:310] timed out waiting for the condition
I0210 13:16:52.023381 682172 kubeadm.go:310]
I0210 13:16:52.023408 682172 kubeadm.go:310] This error is likely caused by:
I0210 13:16:52.023452 682172 kubeadm.go:310] - The kubelet is not running
I0210 13:16:52.023565 682172 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0210 13:16:52.023576 682172 kubeadm.go:310]
I0210 13:16:52.023655 682172 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0210 13:16:52.023683 682172 kubeadm.go:310] - 'systemctl status kubelet'
I0210 13:16:52.023714 682172 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0210 13:16:52.023721 682172 kubeadm.go:310]
I0210 13:16:52.023818 682172 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0210 13:16:52.023890 682172 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0210 13:16:52.023896 682172 kubeadm.go:310]
I0210 13:16:52.023997 682172 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0210 13:16:52.024075 682172 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0210 13:16:52.024141 682172 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0210 13:16:52.024236 682172 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0210 13:16:52.024281 682172 kubeadm.go:310]
W0210 13:16:52.024382 682172 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-745712] and IPs [192.168.72.78 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-745712] and IPs [192.168.72.78 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-745712] and IPs [192.168.72.78 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-745712] and IPs [192.168.72.78 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0210 13:16:52.024434 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0210 13:16:52.517319 682172 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0210 13:16:52.531791 682172 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0210 13:16:52.541180 682172 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0210 13:16:52.541203 682172 kubeadm.go:157] found existing configuration files:
I0210 13:16:52.541253 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0210 13:16:52.550141 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0210 13:16:52.550201 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0210 13:16:52.559060 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0210 13:16:52.567404 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0210 13:16:52.567476 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0210 13:16:52.576679 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0210 13:16:52.585524 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0210 13:16:52.585595 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0210 13:16:52.594776 682172 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0210 13:16:52.603815 682172 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0210 13:16:52.603873 682172 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0210 13:16:52.612996 682172 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0210 13:16:52.831260 682172 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0210 13:18:48.904473 682172 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0210 13:18:48.904609 682172 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0210 13:18:48.906409 682172 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0210 13:18:48.906513 682172 kubeadm.go:310] [preflight] Running pre-flight checks
I0210 13:18:48.906646 682172 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0210 13:18:48.906778 682172 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0210 13:18:48.906920 682172 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0210 13:18:48.907024 682172 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0210 13:18:48.908270 682172 out.go:235] - Generating certificates and keys ...
I0210 13:18:48.908368 682172 kubeadm.go:310] [certs] Using existing ca certificate authority
I0210 13:18:48.908489 682172 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0210 13:18:48.908601 682172 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0210 13:18:48.908682 682172 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0210 13:18:48.908770 682172 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0210 13:18:48.908847 682172 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0210 13:18:48.908930 682172 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0210 13:18:48.909012 682172 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0210 13:18:48.909142 682172 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0210 13:18:48.909243 682172 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0210 13:18:48.909298 682172 kubeadm.go:310] [certs] Using the existing "sa" key
I0210 13:18:48.909373 682172 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0210 13:18:48.909445 682172 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0210 13:18:48.909517 682172 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0210 13:18:48.909600 682172 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0210 13:18:48.909673 682172 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0210 13:18:48.909801 682172 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0210 13:18:48.909918 682172 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0210 13:18:48.909974 682172 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0210 13:18:48.910063 682172 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0210 13:18:48.911882 682172 out.go:235] - Booting up control plane ...
I0210 13:18:48.911999 682172 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0210 13:18:48.912130 682172 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0210 13:18:48.912230 682172 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0210 13:18:48.912325 682172 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0210 13:18:48.912541 682172 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0210 13:18:48.912615 682172 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0210 13:18:48.912743 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:18:48.912934 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:18:48.913028 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:18:48.913294 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:18:48.913383 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:18:48.913622 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:18:48.913715 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:18:48.913908 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:18:48.913964 682172 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 13:18:48.914112 682172 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 13:18:48.914116 682172 kubeadm.go:310]
I0210 13:18:48.914157 682172 kubeadm.go:310] Unfortunately, an error has occurred:
I0210 13:18:48.914189 682172 kubeadm.go:310] timed out waiting for the condition
I0210 13:18:48.914193 682172 kubeadm.go:310]
I0210 13:18:48.914221 682172 kubeadm.go:310] This error is likely caused by:
I0210 13:18:48.914250 682172 kubeadm.go:310] - The kubelet is not running
I0210 13:18:48.914334 682172 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0210 13:18:48.914342 682172 kubeadm.go:310]
I0210 13:18:48.914429 682172 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0210 13:18:48.914455 682172 kubeadm.go:310] - 'systemctl status kubelet'
I0210 13:18:48.914481 682172 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0210 13:18:48.914484 682172 kubeadm.go:310]
I0210 13:18:48.914567 682172 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0210 13:18:48.914633 682172 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0210 13:18:48.914637 682172 kubeadm.go:310]
I0210 13:18:48.914728 682172 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0210 13:18:48.914802 682172 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0210 13:18:48.914864 682172 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0210 13:18:48.914921 682172 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0210 13:18:48.914987 682172 kubeadm.go:394] duration metric: took 3m55.505567485s to StartCluster
I0210 13:18:48.915055 682172 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0210 13:18:48.915110 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0210 13:18:48.915183 682172 kubeadm.go:310]
I0210 13:18:48.958318 682172 cri.go:89] found id: ""
I0210 13:18:48.958347 682172 logs.go:282] 0 containers: []
W0210 13:18:48.958357 682172 logs.go:284] No container was found matching "kube-apiserver"
I0210 13:18:48.958365 682172 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0210 13:18:48.958436 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0210 13:18:48.997185 682172 cri.go:89] found id: ""
I0210 13:18:48.997220 682172 logs.go:282] 0 containers: []
W0210 13:18:48.997231 682172 logs.go:284] No container was found matching "etcd"
I0210 13:18:48.997239 682172 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0210 13:18:48.997301 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0210 13:18:49.029716 682172 cri.go:89] found id: ""
I0210 13:18:49.029747 682172 logs.go:282] 0 containers: []
W0210 13:18:49.029757 682172 logs.go:284] No container was found matching "coredns"
I0210 13:18:49.029765 682172 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0210 13:18:49.029839 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0210 13:18:49.074664 682172 cri.go:89] found id: ""
I0210 13:18:49.074713 682172 logs.go:282] 0 containers: []
W0210 13:18:49.074725 682172 logs.go:284] No container was found matching "kube-scheduler"
I0210 13:18:49.074734 682172 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0210 13:18:49.074801 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0210 13:18:49.115179 682172 cri.go:89] found id: ""
I0210 13:18:49.115213 682172 logs.go:282] 0 containers: []
W0210 13:18:49.115225 682172 logs.go:284] No container was found matching "kube-proxy"
I0210 13:18:49.115234 682172 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0210 13:18:49.115301 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0210 13:18:49.154581 682172 cri.go:89] found id: ""
I0210 13:18:49.154621 682172 logs.go:282] 0 containers: []
W0210 13:18:49.154634 682172 logs.go:284] No container was found matching "kube-controller-manager"
I0210 13:18:49.154643 682172 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0210 13:18:49.154711 682172 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0210 13:18:49.193755 682172 cri.go:89] found id: ""
I0210 13:18:49.193800 682172 logs.go:282] 0 containers: []
W0210 13:18:49.193814 682172 logs.go:284] No container was found matching "kindnet"
I0210 13:18:49.193829 682172 logs.go:123] Gathering logs for dmesg ...
I0210 13:18:49.193846 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0210 13:18:49.208602 682172 logs.go:123] Gathering logs for describe nodes ...
I0210 13:18:49.208639 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0210 13:18:49.342391 682172 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0210 13:18:49.342419 682172 logs.go:123] Gathering logs for CRI-O ...
I0210 13:18:49.342435 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0210 13:18:49.441835 682172 logs.go:123] Gathering logs for container status ...
I0210 13:18:49.441882 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0210 13:18:49.482346 682172 logs.go:123] Gathering logs for kubelet ...
I0210 13:18:49.482388 682172 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0210 13:18:49.530871 682172 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0210 13:18:49.530970 682172 out.go:270] *
*
W0210 13:18:49.531052 682172 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0210 13:18:49.531070 682172 out.go:270] *
*
W0210 13:18:49.531877 682172 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0210 13:18:49.535003 682172 out.go:201]
W0210 13:18:49.536073 682172 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0210 13:18:49.536110 682172 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0210 13:18:49.536144 682172 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0210 13:18:49.537372 682172 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-745712 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-745712 -n old-k8s-version-745712
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-745712 -n old-k8s-version-745712: exit status 6 (243.302891ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0210 13:18:49.835300 687479 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-745712" does not appear in /home/jenkins/minikube-integration/20383-625153/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-745712" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (269.65s)