=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-806597 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
I0120 16:25:05.880239 2136749 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2-amd64.sha256 Dst:/tmp/TestKVMDriverInstallOrUpdate858879667/001/docker-machine-driver-kvm2.download Pwd: Mode:2 Umask:---------- Detectors:[0x530a660 0x530a660 0x530a660 0x530a660 0x530a660 0x530a660 0x530a660] Decompressors:map[bz2:0xc000900cf0 gz:0xc000900cf8 tar:0xc000900c90 tar.bz2:0xc000900cb0 tar.gz:0xc000900cc0 tar.xz:0xc000900cd0 tar.zst:0xc000900ce0 tbz2:0xc000900cb0 tgz:0xc000900cc0 txz:0xc000900cd0 tzst:0xc000900ce0 xz:0xc000900d00 zip:0xc000900d10 zst:0xc000900d08] Getters:map[file:0xc0019a2450 http:0xc00093a230 https:0xc00093a280] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response cod
e: 404. trying to get the common version
I0120 16:25:05.880305 2136749 download.go:108] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2.sha256 -> /tmp/TestKVMDriverInstallOrUpdate858879667/001/docker-machine-driver-kvm2
I0120 16:25:07.418114 2136749 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 16:25:08.721352 2136749 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/workspace/KVM_Linux_crio_integration/testdata/kvm2-driver-older-version:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0120 16:25:08.755790 2136749 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/testdata/kvm2-driver-older-version/docker-machine-driver-kvm2 version is 1.1.1
W0120 16:25:08.755833 2136749 install.go:62] docker-machine-driver-kvm2: docker-machine-driver-kvm2 is version 1.1.1, want 1.3.0
W0120 16:25:08.755917 2136749 out.go:174] [unset outFile]: * Downloading driver docker-machine-driver-kvm2:
I0120 16:25:08.755959 2136749 download.go:108] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2-amd64.sha256 -> /tmp/TestKVMDriverInstallOrUpdate858879667/002/docker-machine-driver-kvm2
I0120 16:25:08.922980 2136749 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2-amd64.sha256 Dst:/tmp/TestKVMDriverInstallOrUpdate858879667/002/docker-machine-driver-kvm2.download Pwd: Mode:2 Umask:---------- Detectors:[0x530a660 0x530a660 0x530a660 0x530a660 0x530a660 0x530a660 0x530a660] Decompressors:map[bz2:0xc000900cf0 gz:0xc000900cf8 tar:0xc000900c90 tar.bz2:0xc000900cb0 tar.gz:0xc000900cc0 tar.xz:0xc000900cd0 tar.zst:0xc000900ce0 tbz2:0xc000900cb0 tgz:0xc000900cc0 txz:0xc000900cd0 tzst:0xc000900ce0 xz:0xc000900d00 zip:0xc000900d10 zst:0xc000900d08] Getters:map[file:0xc001b25680 http:0xc000074500 https:0xc000074550] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response cod
e: 404. trying to get the common version
I0120 16:25:08.923056 2136749 download.go:108] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-kvm2.sha256 -> /tmp/TestKVMDriverInstallOrUpdate858879667/002/docker-machine-driver-kvm2
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-806597 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m9.454479462s)
-- stdout --
* [old-k8s-version-806597] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20109
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20109-2129584/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20109-2129584/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Downloading driver docker-machine-driver-kvm2:
* Starting "old-k8s-version-806597" primary control-plane node in "old-k8s-version-806597" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0120 16:25:05.837628 2180315 out.go:345] Setting OutFile to fd 1 ...
I0120 16:25:05.837791 2180315 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0120 16:25:05.837804 2180315 out.go:358] Setting ErrFile to fd 2...
I0120 16:25:05.837811 2180315 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0120 16:25:05.838012 2180315 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20109-2129584/.minikube/bin
I0120 16:25:05.838736 2180315 out.go:352] Setting JSON to false
I0120 16:25:05.839771 2180315 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":29252,"bootTime":1737361054,"procs":201,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0120 16:25:05.839894 2180315 start.go:139] virtualization: kvm guest
I0120 16:25:05.841986 2180315 out.go:177] * [old-k8s-version-806597] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0120 16:25:05.843492 2180315 notify.go:220] Checking for updates...
I0120 16:25:05.843536 2180315 out.go:177] - MINIKUBE_LOCATION=20109
I0120 16:25:05.844907 2180315 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0120 16:25:05.846222 2180315 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20109-2129584/kubeconfig
I0120 16:25:05.847562 2180315 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20109-2129584/.minikube
I0120 16:25:05.849239 2180315 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0120 16:25:05.850929 2180315 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0120 16:25:05.853205 2180315 config.go:182] Loaded profile config "cert-options-435922": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I0120 16:25:05.853374 2180315 config.go:182] Loaded profile config "kubernetes-upgrade-207056": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I0120 16:25:05.853522 2180315 driver.go:394] Setting default libvirt URI to qemu:///system
I0120 16:25:05.894997 2180315 out.go:177] * Using the kvm2 driver based on user configuration
I0120 16:25:05.896321 2180315 start.go:297] selected driver: kvm2
I0120 16:25:05.896339 2180315 start.go:901] validating driver "kvm2" against <nil>
I0120 16:25:05.896354 2180315 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0120 16:25:05.897076 2180315 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 16:25:07.418171 2180315 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20109-2129584/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/testdata/kvm2-driver-without-version:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
W0120 16:25:07.454727 2180315 install.go:62] docker-machine-driver-kvm2: exit status 1
I0120 16:25:07.457201 2180315 out.go:177] * Downloading driver docker-machine-driver-kvm2:
I0120 16:25:07.458872 2180315 download.go:108] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.35.0/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.35.0/docker-machine-driver-kvm2-amd64.sha256 -> /home/jenkins/minikube-integration/20109-2129584/.minikube/bin/docker-machine-driver-kvm2
I0120 16:25:08.721227 2180315 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0120 16:25:08.721638 2180315 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0120 16:25:08.721694 2180315 cni.go:84] Creating CNI manager for ""
I0120 16:25:08.721753 2180315 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0120 16:25:08.721766 2180315 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0120 16:25:08.721860 2180315 start.go:340] cluster config:
{Name:old-k8s-version-806597 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-806597 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0120 16:25:08.722006 2180315 iso.go:125] acquiring lock: {Name:mkfdd69d29de07488d13f32c54d682aa5b350b99 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 16:25:08.724471 2180315 out.go:177] * Starting "old-k8s-version-806597" primary control-plane node in "old-k8s-version-806597" cluster
I0120 16:25:08.725826 2180315 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0120 16:25:08.725911 2180315 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0120 16:25:08.725931 2180315 cache.go:56] Caching tarball of preloaded images
I0120 16:25:08.726067 2180315 preload.go:172] Found /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0120 16:25:08.726094 2180315 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0120 16:25:08.726250 2180315 profile.go:143] Saving config to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/config.json ...
I0120 16:25:08.726281 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/config.json: {Name:mk641e3a07e3563b1e7003600696758bdf208883 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:25:08.726492 2180315 start.go:360] acquireMachinesLock for old-k8s-version-806597: {Name:mkb8bb9d716afe4381507ba751e49800d47b1664 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0120 16:25:42.619917 2180315 start.go:364] duration metric: took 33.893308678s to acquireMachinesLock for "old-k8s-version-806597"
I0120 16:25:42.620010 2180315 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-806597 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-806597 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0120 16:25:42.620148 2180315 start.go:125] createHost starting for "" (driver="kvm2")
I0120 16:25:42.622408 2180315 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0120 16:25:42.622587 2180315 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/20109-2129584/.minikube/bin/docker-machine-driver-kvm2
I0120 16:25:42.622673 2180315 main.go:141] libmachine: Launching plugin server for driver kvm2
I0120 16:25:42.640124 2180315 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36133
I0120 16:25:42.640566 2180315 main.go:141] libmachine: () Calling .GetVersion
I0120 16:25:42.641206 2180315 main.go:141] libmachine: Using API Version 1
I0120 16:25:42.641229 2180315 main.go:141] libmachine: () Calling .SetConfigRaw
I0120 16:25:42.641621 2180315 main.go:141] libmachine: () Calling .GetMachineName
I0120 16:25:42.641851 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetMachineName
I0120 16:25:42.642013 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:25:42.642166 2180315 start.go:159] libmachine.API.Create for "old-k8s-version-806597" (driver="kvm2")
I0120 16:25:42.642197 2180315 client.go:168] LocalClient.Create starting
I0120 16:25:42.642234 2180315 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca.pem
I0120 16:25:42.642280 2180315 main.go:141] libmachine: Decoding PEM data...
I0120 16:25:42.642308 2180315 main.go:141] libmachine: Parsing certificate...
I0120 16:25:42.642390 2180315 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/cert.pem
I0120 16:25:42.642415 2180315 main.go:141] libmachine: Decoding PEM data...
I0120 16:25:42.642435 2180315 main.go:141] libmachine: Parsing certificate...
I0120 16:25:42.642462 2180315 main.go:141] libmachine: Running pre-create checks...
I0120 16:25:42.642483 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .PreCreateCheck
I0120 16:25:42.642825 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetConfigRaw
I0120 16:25:42.643320 2180315 main.go:141] libmachine: Creating machine...
I0120 16:25:42.643336 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .Create
I0120 16:25:42.643494 2180315 main.go:141] libmachine: (old-k8s-version-806597) creating KVM machine...
I0120 16:25:42.643518 2180315 main.go:141] libmachine: (old-k8s-version-806597) creating network...
I0120 16:25:42.644737 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found existing default KVM network
I0120 16:25:42.646096 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:42.645927 2180805 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:bb:28:fa} reservation:<nil>}
I0120 16:25:42.647463 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:42.647336 2180805 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000302000}
I0120 16:25:42.647571 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | created network xml:
I0120 16:25:42.647592 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | <network>
I0120 16:25:42.647626 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | <name>mk-old-k8s-version-806597</name>
I0120 16:25:42.647663 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | <dns enable='no'/>
I0120 16:25:42.647688 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG |
I0120 16:25:42.647700 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0120 16:25:42.647713 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | <dhcp>
I0120 16:25:42.647733 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0120 16:25:42.647751 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | </dhcp>
I0120 16:25:42.647768 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | </ip>
I0120 16:25:42.647786 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG |
I0120 16:25:42.647799 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | </network>
I0120 16:25:42.647821 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG |
I0120 16:25:42.653220 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | trying to create private KVM network mk-old-k8s-version-806597 192.168.50.0/24...
I0120 16:25:42.726288 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | private KVM network mk-old-k8s-version-806597 192.168.50.0/24 created
I0120 16:25:42.726327 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting up store path in /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597 ...
I0120 16:25:42.726342 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:42.726210 2180805 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20109-2129584/.minikube
I0120 16:25:42.726389 2180315 main.go:141] libmachine: (old-k8s-version-806597) building disk image from file:///home/jenkins/minikube-integration/20109-2129584/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0120 16:25:42.726429 2180315 main.go:141] libmachine: (old-k8s-version-806597) Downloading /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20109-2129584/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0120 16:25:43.014915 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:43.014737 2180805 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa...
I0120 16:25:43.181377 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:43.181227 2180805 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/old-k8s-version-806597.rawdisk...
I0120 16:25:43.181408 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | Writing magic tar header
I0120 16:25:43.181422 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | Writing SSH key tar header
I0120 16:25:43.181431 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:43.181348 2180805 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597 ...
I0120 16:25:43.181449 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597
I0120 16:25:43.181527 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting executable bit set on /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597 (perms=drwx------)
I0120 16:25:43.181585 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20109-2129584/.minikube/machines
I0120 16:25:43.181602 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting executable bit set on /home/jenkins/minikube-integration/20109-2129584/.minikube/machines (perms=drwxr-xr-x)
I0120 16:25:43.181618 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting executable bit set on /home/jenkins/minikube-integration/20109-2129584/.minikube (perms=drwxr-xr-x)
I0120 16:25:43.181634 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20109-2129584/.minikube
I0120 16:25:43.181645 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting executable bit set on /home/jenkins/minikube-integration/20109-2129584 (perms=drwxrwxr-x)
I0120 16:25:43.181657 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0120 16:25:43.181664 2180315 main.go:141] libmachine: (old-k8s-version-806597) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0120 16:25:43.181676 2180315 main.go:141] libmachine: (old-k8s-version-806597) creating domain...
I0120 16:25:43.181690 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20109-2129584
I0120 16:25:43.181699 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0120 16:25:43.181709 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home/jenkins
I0120 16:25:43.181726 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | checking permissions on dir: /home
I0120 16:25:43.181755 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | skipping /home - not owner
I0120 16:25:43.182884 2180315 main.go:141] libmachine: (old-k8s-version-806597) define libvirt domain using xml:
I0120 16:25:43.182909 2180315 main.go:141] libmachine: (old-k8s-version-806597) <domain type='kvm'>
I0120 16:25:43.182945 2180315 main.go:141] libmachine: (old-k8s-version-806597) <name>old-k8s-version-806597</name>
I0120 16:25:43.182977 2180315 main.go:141] libmachine: (old-k8s-version-806597) <memory unit='MiB'>2200</memory>
I0120 16:25:43.183001 2180315 main.go:141] libmachine: (old-k8s-version-806597) <vcpu>2</vcpu>
I0120 16:25:43.183017 2180315 main.go:141] libmachine: (old-k8s-version-806597) <features>
I0120 16:25:43.183043 2180315 main.go:141] libmachine: (old-k8s-version-806597) <acpi/>
I0120 16:25:43.183058 2180315 main.go:141] libmachine: (old-k8s-version-806597) <apic/>
I0120 16:25:43.183070 2180315 main.go:141] libmachine: (old-k8s-version-806597) <pae/>
I0120 16:25:43.183079 2180315 main.go:141] libmachine: (old-k8s-version-806597)
I0120 16:25:43.183086 2180315 main.go:141] libmachine: (old-k8s-version-806597) </features>
I0120 16:25:43.183095 2180315 main.go:141] libmachine: (old-k8s-version-806597) <cpu mode='host-passthrough'>
I0120 16:25:43.183104 2180315 main.go:141] libmachine: (old-k8s-version-806597)
I0120 16:25:43.183118 2180315 main.go:141] libmachine: (old-k8s-version-806597) </cpu>
I0120 16:25:43.183127 2180315 main.go:141] libmachine: (old-k8s-version-806597) <os>
I0120 16:25:43.183141 2180315 main.go:141] libmachine: (old-k8s-version-806597) <type>hvm</type>
I0120 16:25:43.183153 2180315 main.go:141] libmachine: (old-k8s-version-806597) <boot dev='cdrom'/>
I0120 16:25:43.183163 2180315 main.go:141] libmachine: (old-k8s-version-806597) <boot dev='hd'/>
I0120 16:25:43.183172 2180315 main.go:141] libmachine: (old-k8s-version-806597) <bootmenu enable='no'/>
I0120 16:25:43.183181 2180315 main.go:141] libmachine: (old-k8s-version-806597) </os>
I0120 16:25:43.183248 2180315 main.go:141] libmachine: (old-k8s-version-806597) <devices>
I0120 16:25:43.183275 2180315 main.go:141] libmachine: (old-k8s-version-806597) <disk type='file' device='cdrom'>
I0120 16:25:43.183292 2180315 main.go:141] libmachine: (old-k8s-version-806597) <source file='/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/boot2docker.iso'/>
I0120 16:25:43.183308 2180315 main.go:141] libmachine: (old-k8s-version-806597) <target dev='hdc' bus='scsi'/>
I0120 16:25:43.183323 2180315 main.go:141] libmachine: (old-k8s-version-806597) <readonly/>
I0120 16:25:43.183336 2180315 main.go:141] libmachine: (old-k8s-version-806597) </disk>
I0120 16:25:43.183351 2180315 main.go:141] libmachine: (old-k8s-version-806597) <disk type='file' device='disk'>
I0120 16:25:43.183370 2180315 main.go:141] libmachine: (old-k8s-version-806597) <driver name='qemu' type='raw' cache='default' io='threads' />
I0120 16:25:43.183399 2180315 main.go:141] libmachine: (old-k8s-version-806597) <source file='/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/old-k8s-version-806597.rawdisk'/>
I0120 16:25:43.183417 2180315 main.go:141] libmachine: (old-k8s-version-806597) <target dev='hda' bus='virtio'/>
I0120 16:25:43.183432 2180315 main.go:141] libmachine: (old-k8s-version-806597) </disk>
I0120 16:25:43.183445 2180315 main.go:141] libmachine: (old-k8s-version-806597) <interface type='network'>
I0120 16:25:43.183460 2180315 main.go:141] libmachine: (old-k8s-version-806597) <source network='mk-old-k8s-version-806597'/>
I0120 16:25:43.183474 2180315 main.go:141] libmachine: (old-k8s-version-806597) <model type='virtio'/>
I0120 16:25:43.183484 2180315 main.go:141] libmachine: (old-k8s-version-806597) </interface>
I0120 16:25:43.183502 2180315 main.go:141] libmachine: (old-k8s-version-806597) <interface type='network'>
I0120 16:25:43.183516 2180315 main.go:141] libmachine: (old-k8s-version-806597) <source network='default'/>
I0120 16:25:43.183529 2180315 main.go:141] libmachine: (old-k8s-version-806597) <model type='virtio'/>
I0120 16:25:43.183543 2180315 main.go:141] libmachine: (old-k8s-version-806597) </interface>
I0120 16:25:43.183556 2180315 main.go:141] libmachine: (old-k8s-version-806597) <serial type='pty'>
I0120 16:25:43.183571 2180315 main.go:141] libmachine: (old-k8s-version-806597) <target port='0'/>
I0120 16:25:43.183599 2180315 main.go:141] libmachine: (old-k8s-version-806597) </serial>
I0120 16:25:43.183614 2180315 main.go:141] libmachine: (old-k8s-version-806597) <console type='pty'>
I0120 16:25:43.183627 2180315 main.go:141] libmachine: (old-k8s-version-806597) <target type='serial' port='0'/>
I0120 16:25:43.183640 2180315 main.go:141] libmachine: (old-k8s-version-806597) </console>
I0120 16:25:43.183652 2180315 main.go:141] libmachine: (old-k8s-version-806597) <rng model='virtio'>
I0120 16:25:43.183668 2180315 main.go:141] libmachine: (old-k8s-version-806597) <backend model='random'>/dev/random</backend>
I0120 16:25:43.183686 2180315 main.go:141] libmachine: (old-k8s-version-806597) </rng>
I0120 16:25:43.183720 2180315 main.go:141] libmachine: (old-k8s-version-806597)
I0120 16:25:43.183745 2180315 main.go:141] libmachine: (old-k8s-version-806597)
I0120 16:25:43.183766 2180315 main.go:141] libmachine: (old-k8s-version-806597) </devices>
I0120 16:25:43.183776 2180315 main.go:141] libmachine: (old-k8s-version-806597) </domain>
I0120 16:25:43.183786 2180315 main.go:141] libmachine: (old-k8s-version-806597)
I0120 16:25:43.187955 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:e6:ef:cc in network default
I0120 16:25:43.188844 2180315 main.go:141] libmachine: (old-k8s-version-806597) starting domain...
I0120 16:25:43.188867 2180315 main.go:141] libmachine: (old-k8s-version-806597) ensuring networks are active...
I0120 16:25:43.188880 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:43.189494 2180315 main.go:141] libmachine: (old-k8s-version-806597) Ensuring network default is active
I0120 16:25:43.189834 2180315 main.go:141] libmachine: (old-k8s-version-806597) Ensuring network mk-old-k8s-version-806597 is active
I0120 16:25:43.190457 2180315 main.go:141] libmachine: (old-k8s-version-806597) getting domain XML...
I0120 16:25:43.191329 2180315 main.go:141] libmachine: (old-k8s-version-806597) creating domain...
I0120 16:25:44.541075 2180315 main.go:141] libmachine: (old-k8s-version-806597) waiting for IP...
I0120 16:25:44.542385 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:44.543129 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:44.543228 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:44.543143 2180805 retry.go:31] will retry after 254.970151ms: waiting for domain to come up
I0120 16:25:44.799828 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:44.800385 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:44.800421 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:44.800354 2180805 retry.go:31] will retry after 235.04601ms: waiting for domain to come up
I0120 16:25:45.036966 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:45.037613 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:45.037650 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:45.037542 2180805 retry.go:31] will retry after 430.932107ms: waiting for domain to come up
I0120 16:25:45.470354 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:45.470937 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:45.470967 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:45.470909 2180805 retry.go:31] will retry after 389.110428ms: waiting for domain to come up
I0120 16:25:45.861753 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:45.862231 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:45.862278 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:45.862211 2180805 retry.go:31] will retry after 676.514778ms: waiting for domain to come up
I0120 16:25:46.539940 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:46.540451 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:46.540506 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:46.540422 2180805 retry.go:31] will retry after 816.499753ms: waiting for domain to come up
I0120 16:25:47.358826 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:47.359471 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:47.359507 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:47.359448 2180805 retry.go:31] will retry after 737.471448ms: waiting for domain to come up
I0120 16:25:48.099136 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:48.099707 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:48.099734 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:48.099700 2180805 retry.go:31] will retry after 1.070431059s: waiting for domain to come up
I0120 16:25:49.171358 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:49.171819 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:49.171848 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:49.171808 2180805 retry.go:31] will retry after 1.246867848s: waiting for domain to come up
I0120 16:25:50.420268 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:50.420764 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:50.420793 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:50.420729 2180805 retry.go:31] will retry after 1.733327189s: waiting for domain to come up
I0120 16:25:52.155894 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:52.156471 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:52.156502 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:52.156435 2180805 retry.go:31] will retry after 2.553206208s: waiting for domain to come up
I0120 16:25:54.712049 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:54.712540 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:54.712570 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:54.712514 2180805 retry.go:31] will retry after 3.290775988s: waiting for domain to come up
I0120 16:25:58.005276 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:25:58.005642 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:25:58.005672 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:25:58.005578 2180805 retry.go:31] will retry after 3.942795342s: waiting for domain to come up
I0120 16:26:01.951815 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:01.952324 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find current IP address of domain old-k8s-version-806597 in network mk-old-k8s-version-806597
I0120 16:26:01.952385 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | I0120 16:26:01.952291 2180805 retry.go:31] will retry after 4.071957347s: waiting for domain to come up
I0120 16:26:06.028371 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.029058 2180315 main.go:141] libmachine: (old-k8s-version-806597) found domain IP: 192.168.50.241
I0120 16:26:06.029085 2180315 main.go:141] libmachine: (old-k8s-version-806597) reserving static IP address...
I0120 16:26:06.029117 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has current primary IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.029522 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-806597", mac: "52:54:00:02:1a:c1", ip: "192.168.50.241"} in network mk-old-k8s-version-806597
I0120 16:26:06.116699 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | Getting to WaitForSSH function...
I0120 16:26:06.116728 2180315 main.go:141] libmachine: (old-k8s-version-806597) reserved static IP address 192.168.50.241 for domain old-k8s-version-806597
I0120 16:26:06.116741 2180315 main.go:141] libmachine: (old-k8s-version-806597) waiting for SSH...
I0120 16:26:06.119622 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.120095 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:minikube Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.120129 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.120303 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | Using SSH client type: external
I0120 16:26:06.120335 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | Using SSH private key: /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa (-rw-------)
I0120 16:26:06.120409 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.241 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa -p 22] /usr/bin/ssh <nil>}
I0120 16:26:06.120431 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | About to run SSH command:
I0120 16:26:06.120441 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | exit 0
I0120 16:26:06.251348 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | SSH cmd err, output: <nil>:
I0120 16:26:06.251687 2180315 main.go:141] libmachine: (old-k8s-version-806597) KVM machine creation complete
I0120 16:26:06.251979 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetConfigRaw
I0120 16:26:06.252739 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:06.253017 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:06.253247 2180315 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0120 16:26:06.253261 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetState
I0120 16:26:06.254645 2180315 main.go:141] libmachine: Detecting operating system of created instance...
I0120 16:26:06.254663 2180315 main.go:141] libmachine: Waiting for SSH to be available...
I0120 16:26:06.254669 2180315 main.go:141] libmachine: Getting to WaitForSSH function...
I0120 16:26:06.254675 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:06.257222 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.257574 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.257620 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.257743 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:06.257991 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.258208 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.258391 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:06.258571 2180315 main.go:141] libmachine: Using SSH client type: native
I0120 16:26:06.258830 2180315 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.241 22 <nil> <nil>}
I0120 16:26:06.258847 2180315 main.go:141] libmachine: About to run SSH command:
exit 0
I0120 16:26:06.370228 2180315 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0120 16:26:06.370253 2180315 main.go:141] libmachine: Detecting the provisioner...
I0120 16:26:06.370261 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:06.373176 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.373546 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.373570 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.373778 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:06.374027 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.374191 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.374367 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:06.374532 2180315 main.go:141] libmachine: Using SSH client type: native
I0120 16:26:06.374772 2180315 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.241 22 <nil> <nil>}
I0120 16:26:06.374787 2180315 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0120 16:26:06.487716 2180315 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0120 16:26:06.487797 2180315 main.go:141] libmachine: found compatible host: buildroot
I0120 16:26:06.487812 2180315 main.go:141] libmachine: Provisioning with buildroot...
I0120 16:26:06.487822 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetMachineName
I0120 16:26:06.488060 2180315 buildroot.go:166] provisioning hostname "old-k8s-version-806597"
I0120 16:26:06.488102 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetMachineName
I0120 16:26:06.488215 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:06.491033 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.491430 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.491461 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.491618 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:06.491798 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.491958 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.492108 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:06.492320 2180315 main.go:141] libmachine: Using SSH client type: native
I0120 16:26:06.492530 2180315 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.241 22 <nil> <nil>}
I0120 16:26:06.492559 2180315 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-806597 && echo "old-k8s-version-806597" | sudo tee /etc/hostname
I0120 16:26:06.622625 2180315 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-806597
I0120 16:26:06.622683 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:06.625695 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.626064 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.626093 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.626318 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:06.626542 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.626719 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:06.626838 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:06.627006 2180315 main.go:141] libmachine: Using SSH client type: native
I0120 16:26:06.627249 2180315 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.241 22 <nil> <nil>}
I0120 16:26:06.627268 2180315 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-806597' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-806597/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-806597' | sudo tee -a /etc/hosts;
fi
fi
I0120 16:26:06.750870 2180315 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0120 16:26:06.750917 2180315 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20109-2129584/.minikube CaCertPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20109-2129584/.minikube}
I0120 16:26:06.750943 2180315 buildroot.go:174] setting up certificates
I0120 16:26:06.750959 2180315 provision.go:84] configureAuth start
I0120 16:26:06.750979 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetMachineName
I0120 16:26:06.751306 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetIP
I0120 16:26:06.754453 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.754849 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.754886 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.755018 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:06.757590 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.757935 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:06.757965 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:06.758172 2180315 provision.go:143] copyHostCerts
I0120 16:26:06.758244 2180315 exec_runner.go:144] found /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.pem, removing ...
I0120 16:26:06.758258 2180315 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.pem
I0120 16:26:06.758329 2180315 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.pem (1082 bytes)
I0120 16:26:06.758465 2180315 exec_runner.go:144] found /home/jenkins/minikube-integration/20109-2129584/.minikube/cert.pem, removing ...
I0120 16:26:06.758476 2180315 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20109-2129584/.minikube/cert.pem
I0120 16:26:06.758501 2180315 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20109-2129584/.minikube/cert.pem (1123 bytes)
I0120 16:26:06.758594 2180315 exec_runner.go:144] found /home/jenkins/minikube-integration/20109-2129584/.minikube/key.pem, removing ...
I0120 16:26:06.758623 2180315 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20109-2129584/.minikube/key.pem
I0120 16:26:06.758655 2180315 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20109-2129584/.minikube/key.pem (1679 bytes)
I0120 16:26:06.758745 2180315 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-806597 san=[127.0.0.1 192.168.50.241 localhost minikube old-k8s-version-806597]
I0120 16:26:07.098838 2180315 provision.go:177] copyRemoteCerts
I0120 16:26:07.098934 2180315 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0120 16:26:07.098970 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:07.101838 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.102155 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.102181 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.102361 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:07.102576 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.102760 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:07.102866 2180315 sshutil.go:53] new ssh client: &{IP:192.168.50.241 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa Username:docker}
I0120 16:26:07.190087 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0120 16:26:07.214751 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0120 16:26:07.240207 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0120 16:26:07.266308 2180315 provision.go:87] duration metric: took 515.329527ms to configureAuth
I0120 16:26:07.266342 2180315 buildroot.go:189] setting minikube options for container-runtime
I0120 16:26:07.266540 2180315 config.go:182] Loaded profile config "old-k8s-version-806597": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0120 16:26:07.266653 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:07.269551 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.269905 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.269938 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.270096 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:07.270354 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.270557 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.270747 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:07.270943 2180315 main.go:141] libmachine: Using SSH client type: native
I0120 16:26:07.271130 2180315 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.241 22 <nil> <nil>}
I0120 16:26:07.271146 2180315 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0120 16:26:07.509188 2180315 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0120 16:26:07.509227 2180315 main.go:141] libmachine: Checking connection to Docker...
I0120 16:26:07.509241 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetURL
I0120 16:26:07.510661 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | using libvirt version 6000000
I0120 16:26:07.513007 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.513374 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.513417 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.513621 2180315 main.go:141] libmachine: Docker is up and running!
I0120 16:26:07.513643 2180315 main.go:141] libmachine: Reticulating splines...
I0120 16:26:07.513672 2180315 client.go:171] duration metric: took 24.871443012s to LocalClient.Create
I0120 16:26:07.513703 2180315 start.go:167] duration metric: took 24.87153796s to libmachine.API.Create "old-k8s-version-806597"
I0120 16:26:07.513715 2180315 start.go:293] postStartSetup for "old-k8s-version-806597" (driver="kvm2")
I0120 16:26:07.513729 2180315 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0120 16:26:07.513749 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:07.514044 2180315 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0120 16:26:07.514072 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:07.516543 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.516855 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.516880 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.517133 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:07.517362 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.517578 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:07.517719 2180315 sshutil.go:53] new ssh client: &{IP:192.168.50.241 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa Username:docker}
I0120 16:26:07.606722 2180315 ssh_runner.go:195] Run: cat /etc/os-release
I0120 16:26:07.611484 2180315 info.go:137] Remote host: Buildroot 2023.02.9
I0120 16:26:07.611519 2180315 filesync.go:126] Scanning /home/jenkins/minikube-integration/20109-2129584/.minikube/addons for local assets ...
I0120 16:26:07.611602 2180315 filesync.go:126] Scanning /home/jenkins/minikube-integration/20109-2129584/.minikube/files for local assets ...
I0120 16:26:07.611675 2180315 filesync.go:149] local asset: /home/jenkins/minikube-integration/20109-2129584/.minikube/files/etc/ssl/certs/21367492.pem -> 21367492.pem in /etc/ssl/certs
I0120 16:26:07.611800 2180315 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0120 16:26:07.621801 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/files/etc/ssl/certs/21367492.pem --> /etc/ssl/certs/21367492.pem (1708 bytes)
I0120 16:26:07.648048 2180315 start.go:296] duration metric: took 134.299886ms for postStartSetup
I0120 16:26:07.648126 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetConfigRaw
I0120 16:26:07.648839 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetIP
I0120 16:26:07.651615 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.651998 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.652026 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.652217 2180315 profile.go:143] Saving config to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/config.json ...
I0120 16:26:07.652489 2180315 start.go:128] duration metric: took 25.03232575s to createHost
I0120 16:26:07.652518 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:07.654957 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.655361 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.655389 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.655513 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:07.655746 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.655900 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.656069 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:07.656222 2180315 main.go:141] libmachine: Using SSH client type: native
I0120 16:26:07.656387 2180315 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.241 22 <nil> <nil>}
I0120 16:26:07.656397 2180315 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0120 16:26:07.771640 2180315 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737390367.742600560
I0120 16:26:07.771676 2180315 fix.go:216] guest clock: 1737390367.742600560
I0120 16:26:07.771684 2180315 fix.go:229] Guest: 2025-01-20 16:26:07.74260056 +0000 UTC Remote: 2025-01-20 16:26:07.652504125 +0000 UTC m=+61.859229819 (delta=90.096435ms)
I0120 16:26:07.771709 2180315 fix.go:200] guest clock delta is within tolerance: 90.096435ms
I0120 16:26:07.771717 2180315 start.go:83] releasing machines lock for "old-k8s-version-806597", held for 25.151752748s
I0120 16:26:07.771752 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:07.772033 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetIP
I0120 16:26:07.775217 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.775707 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.775749 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.776022 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:07.776781 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:07.777036 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .DriverName
I0120 16:26:07.777158 2180315 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0120 16:26:07.777222 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:07.777536 2180315 ssh_runner.go:195] Run: cat /version.json
I0120 16:26:07.777560 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHHostname
I0120 16:26:07.780250 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.780595 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.780643 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.780675 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.780825 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:07.780957 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:07.780981 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:07.780990 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.781150 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHPort
I0120 16:26:07.781157 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:07.781323 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHKeyPath
I0120 16:26:07.781315 2180315 sshutil.go:53] new ssh client: &{IP:192.168.50.241 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa Username:docker}
I0120 16:26:07.781494 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetSSHUsername
I0120 16:26:07.781648 2180315 sshutil.go:53] new ssh client: &{IP:192.168.50.241 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20109-2129584/.minikube/machines/old-k8s-version-806597/id_rsa Username:docker}
I0120 16:26:07.864771 2180315 ssh_runner.go:195] Run: systemctl --version
I0120 16:26:07.892210 2180315 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0120 16:26:08.068848 2180315 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0120 16:26:08.075723 2180315 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0120 16:26:08.075810 2180315 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0120 16:26:08.093929 2180315 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0120 16:26:08.093977 2180315 start.go:495] detecting cgroup driver to use...
I0120 16:26:08.094099 2180315 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0120 16:26:08.118924 2180315 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0120 16:26:08.139602 2180315 docker.go:217] disabling cri-docker service (if available) ...
I0120 16:26:08.139676 2180315 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0120 16:26:08.155249 2180315 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0120 16:26:08.170466 2180315 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0120 16:26:08.298339 2180315 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0120 16:26:08.482682 2180315 docker.go:233] disabling docker service ...
I0120 16:26:08.482763 2180315 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0120 16:26:08.503903 2180315 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0120 16:26:08.517728 2180315 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0120 16:26:08.655481 2180315 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0120 16:26:08.810102 2180315 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0120 16:26:08.825925 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0120 16:26:08.846193 2180315 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0120 16:26:08.846277 2180315 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0120 16:26:08.857437 2180315 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0120 16:26:08.857539 2180315 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0120 16:26:08.869364 2180315 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0120 16:26:08.881019 2180315 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0120 16:26:08.892614 2180315 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0120 16:26:08.904669 2180315 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0120 16:26:08.915983 2180315 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0120 16:26:08.916058 2180315 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0120 16:26:08.933201 2180315 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0120 16:26:08.943616 2180315 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0120 16:26:09.105895 2180315 ssh_runner.go:195] Run: sudo systemctl restart crio
I0120 16:26:09.227633 2180315 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0120 16:26:09.227733 2180315 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0120 16:26:09.235332 2180315 start.go:563] Will wait 60s for crictl version
I0120 16:26:09.235428 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:09.240095 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0120 16:26:09.292885 2180315 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0120 16:26:09.293039 2180315 ssh_runner.go:195] Run: crio --version
I0120 16:26:09.324814 2180315 ssh_runner.go:195] Run: crio --version
I0120 16:26:09.358115 2180315 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0120 16:26:09.359602 2180315 main.go:141] libmachine: (old-k8s-version-806597) Calling .GetIP
I0120 16:26:09.363063 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:09.363567 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:02:1a:c1", ip: ""} in network mk-old-k8s-version-806597: {Iface:virbr2 ExpiryTime:2025-01-20 17:25:59 +0000 UTC Type:0 Mac:52:54:00:02:1a:c1 Iaid: IPaddr:192.168.50.241 Prefix:24 Hostname:old-k8s-version-806597 Clientid:01:52:54:00:02:1a:c1}
I0120 16:26:09.363603 2180315 main.go:141] libmachine: (old-k8s-version-806597) DBG | domain old-k8s-version-806597 has defined IP address 192.168.50.241 and MAC address 52:54:00:02:1a:c1 in network mk-old-k8s-version-806597
I0120 16:26:09.363883 2180315 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0120 16:26:09.368562 2180315 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0120 16:26:09.381987 2180315 kubeadm.go:883] updating cluster {Name:old-k8s-version-806597 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-806597 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.241 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0120 16:26:09.382129 2180315 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0120 16:26:09.382187 2180315 ssh_runner.go:195] Run: sudo crictl images --output json
I0120 16:26:09.419218 2180315 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0120 16:26:09.419289 2180315 ssh_runner.go:195] Run: which lz4
I0120 16:26:09.423711 2180315 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0120 16:26:09.428502 2180315 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0120 16:26:09.428538 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0120 16:26:11.255602 2180315 crio.go:462] duration metric: took 1.831932276s to copy over tarball
I0120 16:26:11.255721 2180315 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0120 16:26:13.958662 2180315 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.702897487s)
I0120 16:26:13.958696 2180315 crio.go:469] duration metric: took 2.703057594s to extract the tarball
I0120 16:26:13.958704 2180315 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0120 16:26:14.003804 2180315 ssh_runner.go:195] Run: sudo crictl images --output json
I0120 16:26:14.054640 2180315 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0120 16:26:14.054677 2180315 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0120 16:26:14.054745 2180315 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0120 16:26:14.054793 2180315 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.054813 2180315 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0120 16:26:14.054842 2180315 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.054874 2180315 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0120 16:26:14.054843 2180315 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.054852 2180315 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.054796 2180315 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:14.056197 2180315 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:14.056442 2180315 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.056458 2180315 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.056501 2180315 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0120 16:26:14.056442 2180315 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.056446 2180315 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0120 16:26:14.056571 2180315 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0120 16:26:14.056504 2180315 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.255911 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.261015 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0120 16:26:14.271871 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0120 16:26:14.283998 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.287187 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.299760 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.329076 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:14.396160 2180315 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0120 16:26:14.396234 2180315 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.396338 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.396341 2180315 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0120 16:26:14.396404 2180315 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0120 16:26:14.396461 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.426212 2180315 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0120 16:26:14.426273 2180315 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0120 16:26:14.426342 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.445345 2180315 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0120 16:26:14.445399 2180315 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.445455 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.470555 2180315 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0120 16:26:14.470624 2180315 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.470701 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.475886 2180315 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0120 16:26:14.475959 2180315 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.476032 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.483228 2180315 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0120 16:26:14.485259 2180315 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0120 16:26:14.485316 2180315 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:14.485360 2180315 ssh_runner.go:195] Run: which crictl
I0120 16:26:14.485370 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.485361 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 16:26:14.485396 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 16:26:14.485433 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.485496 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.485502 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.771462 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:14.771604 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.771626 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 16:26:14.771678 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.771745 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 16:26:14.771763 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.771811 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.948549 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 16:26:14.948568 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 16:26:14.948595 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:14.948653 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 16:26:14.948759 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 16:26:14.948773 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 16:26:14.948838 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 16:26:15.113088 2180315 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 16:26:15.113170 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0120 16:26:15.113333 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0120 16:26:15.113423 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0120 16:26:15.113461 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0120 16:26:15.113517 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0120 16:26:15.113585 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0120 16:26:15.149469 2180315 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0120 16:26:15.149576 2180315 cache_images.go:92] duration metric: took 1.094879778s to LoadCachedImages
W0120 16:26:15.149665 2180315 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20109-2129584/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0120 16:26:15.149685 2180315 kubeadm.go:934] updating node { 192.168.50.241 8443 v1.20.0 crio true true} ...
I0120 16:26:15.149874 2180315 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-806597 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.241
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-806597 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0120 16:26:15.149965 2180315 ssh_runner.go:195] Run: crio config
I0120 16:26:15.210239 2180315 cni.go:84] Creating CNI manager for ""
I0120 16:26:15.210274 2180315 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0120 16:26:15.210289 2180315 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0120 16:26:15.210311 2180315 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.241 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-806597 NodeName:old-k8s-version-806597 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.241"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.241 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0120 16:26:15.210498 2180315 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.241
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-806597"
kubeletExtraArgs:
node-ip: 192.168.50.241
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.241"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0120 16:26:15.210588 2180315 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0120 16:26:15.222433 2180315 binaries.go:44] Found k8s binaries, skipping transfer
I0120 16:26:15.222528 2180315 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0120 16:26:15.234452 2180315 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0120 16:26:15.253710 2180315 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0120 16:26:15.274391 2180315 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0120 16:26:15.295494 2180315 ssh_runner.go:195] Run: grep 192.168.50.241 control-plane.minikube.internal$ /etc/hosts
I0120 16:26:15.300358 2180315 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.241 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0120 16:26:15.314207 2180315 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0120 16:26:15.445942 2180315 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0120 16:26:15.467879 2180315 certs.go:68] Setting up /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597 for IP: 192.168.50.241
I0120 16:26:15.467911 2180315 certs.go:194] generating shared ca certs ...
I0120 16:26:15.467937 2180315 certs.go:226] acquiring lock for ca certs: {Name:mk84252bd5600698fafde6d96c5306f1543c8a40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.468170 2180315 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.key
I0120 16:26:15.468250 2180315 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/proxy-client-ca.key
I0120 16:26:15.468266 2180315 certs.go:256] generating profile certs ...
I0120 16:26:15.468364 2180315 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/client.key
I0120 16:26:15.468390 2180315 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/client.crt with IP's: []
I0120 16:26:15.577472 2180315 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/client.crt ...
I0120 16:26:15.577509 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/client.crt: {Name:mk914869e99403fc00f1cc4cad2ac1e0f3ec5551 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.577754 2180315 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/client.key ...
I0120 16:26:15.577783 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/client.key: {Name:mkb92bb614ad1cca6b0bdf061440a9ad4a00c5e5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.577908 2180315 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.key.72816fb1
I0120 16:26:15.577927 2180315 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.crt.72816fb1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.241]
I0120 16:26:15.668661 2180315 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.crt.72816fb1 ...
I0120 16:26:15.668711 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.crt.72816fb1: {Name:mk8ca43e254a5404c4e4ca93c5c33b7ec4ae25d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.668957 2180315 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.key.72816fb1 ...
I0120 16:26:15.668994 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.key.72816fb1: {Name:mkd7928d3b6f1cd61571f995c138a3935139db8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.669164 2180315 certs.go:381] copying /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.crt.72816fb1 -> /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.crt
I0120 16:26:15.669301 2180315 certs.go:385] copying /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.key.72816fb1 -> /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.key
I0120 16:26:15.669399 2180315 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.key
I0120 16:26:15.669437 2180315 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.crt with IP's: []
I0120 16:26:15.967203 2180315 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.crt ...
I0120 16:26:15.967244 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.crt: {Name:mk9c2857e3082a01d8d3c5bec5ce892ccc2ad7b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.967440 2180315 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.key ...
I0120 16:26:15.967455 2180315 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.key: {Name:mk4c49d697564a24897bf19dd29d9182642aa2f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 16:26:15.967625 2180315 certs.go:484] found cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/2136749.pem (1338 bytes)
W0120 16:26:15.967664 2180315 certs.go:480] ignoring /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/2136749_empty.pem, impossibly tiny 0 bytes
I0120 16:26:15.967676 2180315 certs.go:484] found cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca-key.pem (1675 bytes)
I0120 16:26:15.967699 2180315 certs.go:484] found cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/ca.pem (1082 bytes)
I0120 16:26:15.967723 2180315 certs.go:484] found cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/cert.pem (1123 bytes)
I0120 16:26:15.967744 2180315 certs.go:484] found cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/key.pem (1679 bytes)
I0120 16:26:15.967781 2180315 certs.go:484] found cert: /home/jenkins/minikube-integration/20109-2129584/.minikube/files/etc/ssl/certs/21367492.pem (1708 bytes)
I0120 16:26:15.968409 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0120 16:26:15.996020 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0120 16:26:16.024650 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0120 16:26:16.052287 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0120 16:26:16.080693 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0120 16:26:16.108290 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0120 16:26:16.133710 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0120 16:26:16.159665 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/profiles/old-k8s-version-806597/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0120 16:26:16.187716 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/files/etc/ssl/certs/21367492.pem --> /usr/share/ca-certificates/21367492.pem (1708 bytes)
I0120 16:26:16.213166 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0120 16:26:16.239603 2180315 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20109-2129584/.minikube/certs/2136749.pem --> /usr/share/ca-certificates/2136749.pem (1338 bytes)
I0120 16:26:16.265627 2180315 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0120 16:26:16.286526 2180315 ssh_runner.go:195] Run: openssl version
I0120 16:26:16.293672 2180315 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21367492.pem && ln -fs /usr/share/ca-certificates/21367492.pem /etc/ssl/certs/21367492.pem"
I0120 16:26:16.306832 2180315 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21367492.pem
I0120 16:26:16.312186 2180315 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 20 15:16 /usr/share/ca-certificates/21367492.pem
I0120 16:26:16.312254 2180315 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21367492.pem
I0120 16:26:16.319194 2180315 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21367492.pem /etc/ssl/certs/3ec20f2e.0"
I0120 16:26:16.339608 2180315 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0120 16:26:16.361478 2180315 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0120 16:26:16.370929 2180315 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 20 15:05 /usr/share/ca-certificates/minikubeCA.pem
I0120 16:26:16.371021 2180315 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0120 16:26:16.377897 2180315 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0120 16:26:16.395739 2180315 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2136749.pem && ln -fs /usr/share/ca-certificates/2136749.pem /etc/ssl/certs/2136749.pem"
I0120 16:26:16.412706 2180315 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2136749.pem
I0120 16:26:16.419322 2180315 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 20 15:16 /usr/share/ca-certificates/2136749.pem
I0120 16:26:16.419420 2180315 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2136749.pem
I0120 16:26:16.426849 2180315 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2136749.pem /etc/ssl/certs/51391683.0"
I0120 16:26:16.442098 2180315 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0120 16:26:16.447038 2180315 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0120 16:26:16.447118 2180315 kubeadm.go:392] StartCluster: {Name:old-k8s-version-806597 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-806597 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.241 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0120 16:26:16.447228 2180315 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0120 16:26:16.447310 2180315 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0120 16:26:16.488184 2180315 cri.go:89] found id: ""
I0120 16:26:16.488327 2180315 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0120 16:26:16.499968 2180315 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0120 16:26:16.510813 2180315 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0120 16:26:16.521717 2180315 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0120 16:26:16.521744 2180315 kubeadm.go:157] found existing configuration files:
I0120 16:26:16.521802 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0120 16:26:16.532541 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0120 16:26:16.532660 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0120 16:26:16.544206 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0120 16:26:16.554880 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0120 16:26:16.554976 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0120 16:26:16.567537 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0120 16:26:16.579804 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0120 16:26:16.579878 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0120 16:26:16.592478 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0120 16:26:16.604442 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0120 16:26:16.604526 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0120 16:26:16.616832 2180315 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0120 16:26:16.743059 2180315 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0120 16:26:16.743124 2180315 kubeadm.go:310] [preflight] Running pre-flight checks
I0120 16:26:16.887386 2180315 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0120 16:26:16.887552 2180315 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0120 16:26:16.887686 2180315 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0120 16:26:17.092403 2180315 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0120 16:26:17.095152 2180315 out.go:235] - Generating certificates and keys ...
I0120 16:26:17.095265 2180315 kubeadm.go:310] [certs] Using existing ca certificate authority
I0120 16:26:17.095400 2180315 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0120 16:26:17.232982 2180315 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0120 16:26:17.360580 2180315 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0120 16:26:17.458945 2180315 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0120 16:26:17.755642 2180315 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0120 16:26:17.994212 2180315 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0120 16:26:17.994402 2180315 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-806597] and IPs [192.168.50.241 127.0.0.1 ::1]
I0120 16:26:18.167059 2180315 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0120 16:26:18.167305 2180315 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-806597] and IPs [192.168.50.241 127.0.0.1 ::1]
I0120 16:26:18.343031 2180315 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0120 16:26:18.731988 2180315 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0120 16:26:19.042242 2180315 kubeadm.go:310] [certs] Generating "sa" key and public key
I0120 16:26:19.042344 2180315 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0120 16:26:19.483495 2180315 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0120 16:26:19.688174 2180315 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0120 16:26:19.999937 2180315 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0120 16:26:20.097904 2180315 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0120 16:26:20.123004 2180315 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0120 16:26:20.123402 2180315 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0120 16:26:20.123476 2180315 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0120 16:26:20.273327 2180315 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0120 16:26:20.275346 2180315 out.go:235] - Booting up control plane ...
I0120 16:26:20.275493 2180315 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0120 16:26:20.282943 2180315 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0120 16:26:20.284334 2180315 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0120 16:26:20.285288 2180315 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0120 16:26:20.290986 2180315 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0120 16:27:00.284539 2180315 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0120 16:27:00.285489 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:27:00.285713 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:27:05.286010 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:27:05.286288 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:27:15.285409 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:27:15.285642 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:27:35.285200 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:27:35.285474 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:28:15.287572 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:28:15.287782 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:28:15.287841 2180315 kubeadm.go:310]
I0120 16:28:15.287913 2180315 kubeadm.go:310] Unfortunately, an error has occurred:
I0120 16:28:15.287988 2180315 kubeadm.go:310] timed out waiting for the condition
I0120 16:28:15.288003 2180315 kubeadm.go:310]
I0120 16:28:15.288029 2180315 kubeadm.go:310] This error is likely caused by:
I0120 16:28:15.288088 2180315 kubeadm.go:310] - The kubelet is not running
I0120 16:28:15.288213 2180315 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0120 16:28:15.288224 2180315 kubeadm.go:310]
I0120 16:28:15.288379 2180315 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0120 16:28:15.288413 2180315 kubeadm.go:310] - 'systemctl status kubelet'
I0120 16:28:15.288450 2180315 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0120 16:28:15.288463 2180315 kubeadm.go:310]
I0120 16:28:15.288604 2180315 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0120 16:28:15.288675 2180315 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0120 16:28:15.288689 2180315 kubeadm.go:310]
I0120 16:28:15.288822 2180315 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0120 16:28:15.288925 2180315 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0120 16:28:15.289048 2180315 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0120 16:28:15.289159 2180315 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0120 16:28:15.289171 2180315 kubeadm.go:310]
I0120 16:28:15.289538 2180315 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0120 16:28:15.289637 2180315 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0120 16:28:15.289764 2180315 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0120 16:28:15.289964 2180315 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-806597] and IPs [192.168.50.241 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-806597] and IPs [192.168.50.241 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-806597] and IPs [192.168.50.241 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-806597] and IPs [192.168.50.241 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0120 16:28:15.290009 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0120 16:28:17.732807 2180315 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.44275482s)
I0120 16:28:17.732901 2180315 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0120 16:28:17.747772 2180315 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0120 16:28:17.757979 2180315 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0120 16:28:17.758006 2180315 kubeadm.go:157] found existing configuration files:
I0120 16:28:17.758062 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0120 16:28:17.767540 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0120 16:28:17.767630 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0120 16:28:17.777476 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0120 16:28:17.786547 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0120 16:28:17.786617 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0120 16:28:17.796245 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0120 16:28:17.805721 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0120 16:28:17.805827 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0120 16:28:17.816019 2180315 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0120 16:28:17.825348 2180315 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0120 16:28:17.825410 2180315 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0120 16:28:17.835578 2180315 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0120 16:28:18.044639 2180315 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0120 16:30:14.312909 2180315 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0120 16:30:14.313035 2180315 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0120 16:30:14.315200 2180315 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0120 16:30:14.315283 2180315 kubeadm.go:310] [preflight] Running pre-flight checks
I0120 16:30:14.315368 2180315 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0120 16:30:14.315446 2180315 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0120 16:30:14.315524 2180315 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0120 16:30:14.315575 2180315 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0120 16:30:14.317295 2180315 out.go:235] - Generating certificates and keys ...
I0120 16:30:14.317399 2180315 kubeadm.go:310] [certs] Using existing ca certificate authority
I0120 16:30:14.317511 2180315 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0120 16:30:14.317643 2180315 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0120 16:30:14.317718 2180315 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0120 16:30:14.317835 2180315 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0120 16:30:14.317946 2180315 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0120 16:30:14.318047 2180315 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0120 16:30:14.318129 2180315 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0120 16:30:14.318260 2180315 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0120 16:30:14.318362 2180315 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0120 16:30:14.318416 2180315 kubeadm.go:310] [certs] Using the existing "sa" key
I0120 16:30:14.318494 2180315 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0120 16:30:14.318561 2180315 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0120 16:30:14.318643 2180315 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0120 16:30:14.318727 2180315 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0120 16:30:14.318806 2180315 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0120 16:30:14.318954 2180315 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0120 16:30:14.319072 2180315 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0120 16:30:14.319126 2180315 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0120 16:30:14.319212 2180315 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0120 16:30:14.320710 2180315 out.go:235] - Booting up control plane ...
I0120 16:30:14.320837 2180315 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0120 16:30:14.320936 2180315 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0120 16:30:14.321022 2180315 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0120 16:30:14.321126 2180315 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0120 16:30:14.321344 2180315 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0120 16:30:14.321413 2180315 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0120 16:30:14.321508 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:30:14.321779 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:30:14.321881 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:30:14.322162 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:30:14.322276 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:30:14.322488 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:30:14.322576 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:30:14.322869 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:30:14.322969 2180315 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 16:30:14.323211 2180315 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 16:30:14.323224 2180315 kubeadm.go:310]
I0120 16:30:14.323293 2180315 kubeadm.go:310] Unfortunately, an error has occurred:
I0120 16:30:14.323335 2180315 kubeadm.go:310] timed out waiting for the condition
I0120 16:30:14.323344 2180315 kubeadm.go:310]
I0120 16:30:14.323389 2180315 kubeadm.go:310] This error is likely caused by:
I0120 16:30:14.323423 2180315 kubeadm.go:310] - The kubelet is not running
I0120 16:30:14.323536 2180315 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0120 16:30:14.323544 2180315 kubeadm.go:310]
I0120 16:30:14.323657 2180315 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0120 16:30:14.323713 2180315 kubeadm.go:310] - 'systemctl status kubelet'
I0120 16:30:14.323769 2180315 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0120 16:30:14.323778 2180315 kubeadm.go:310]
I0120 16:30:14.323891 2180315 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0120 16:30:14.324023 2180315 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0120 16:30:14.324046 2180315 kubeadm.go:310]
I0120 16:30:14.324202 2180315 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0120 16:30:14.324338 2180315 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0120 16:30:14.324457 2180315 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0120 16:30:14.324588 2180315 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0120 16:30:14.324643 2180315 kubeadm.go:310]
I0120 16:30:14.324694 2180315 kubeadm.go:394] duration metric: took 3m57.877582207s to StartCluster
I0120 16:30:14.324770 2180315 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0120 16:30:14.324860 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0120 16:30:14.389563 2180315 cri.go:89] found id: ""
I0120 16:30:14.389597 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.389608 2180315 logs.go:284] No container was found matching "kube-apiserver"
I0120 16:30:14.389617 2180315 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0120 16:30:14.389700 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0120 16:30:14.443626 2180315 cri.go:89] found id: ""
I0120 16:30:14.443665 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.443677 2180315 logs.go:284] No container was found matching "etcd"
I0120 16:30:14.443685 2180315 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0120 16:30:14.443777 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0120 16:30:14.493330 2180315 cri.go:89] found id: ""
I0120 16:30:14.493369 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.493382 2180315 logs.go:284] No container was found matching "coredns"
I0120 16:30:14.493392 2180315 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0120 16:30:14.493474 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0120 16:30:14.535826 2180315 cri.go:89] found id: ""
I0120 16:30:14.535863 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.535875 2180315 logs.go:284] No container was found matching "kube-scheduler"
I0120 16:30:14.535883 2180315 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0120 16:30:14.535971 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0120 16:30:14.586146 2180315 cri.go:89] found id: ""
I0120 16:30:14.586185 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.586196 2180315 logs.go:284] No container was found matching "kube-proxy"
I0120 16:30:14.586205 2180315 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0120 16:30:14.586281 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0120 16:30:14.629186 2180315 cri.go:89] found id: ""
I0120 16:30:14.629215 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.629224 2180315 logs.go:284] No container was found matching "kube-controller-manager"
I0120 16:30:14.629231 2180315 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0120 16:30:14.629307 2180315 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0120 16:30:14.670583 2180315 cri.go:89] found id: ""
I0120 16:30:14.670631 2180315 logs.go:282] 0 containers: []
W0120 16:30:14.670642 2180315 logs.go:284] No container was found matching "kindnet"
I0120 16:30:14.670657 2180315 logs.go:123] Gathering logs for container status ...
I0120 16:30:14.670683 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0120 16:30:14.735305 2180315 logs.go:123] Gathering logs for kubelet ...
I0120 16:30:14.735350 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0120 16:30:14.816373 2180315 logs.go:123] Gathering logs for dmesg ...
I0120 16:30:14.816424 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0120 16:30:14.838060 2180315 logs.go:123] Gathering logs for describe nodes ...
I0120 16:30:14.838112 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0120 16:30:15.061156 2180315 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0120 16:30:15.061194 2180315 logs.go:123] Gathering logs for CRI-O ...
I0120 16:30:15.061214 2180315 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0120 16:30:15.219738 2180315 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 16:30:15.219923 2180315 out.go:270] *
*
W0120 16:30:15.220112 2180315 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 16:30:15.220184 2180315 out.go:270] *
*
W0120 16:30:15.221714 2180315 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0120 16:30:15.225912 2180315 out.go:201]
W0120 16:30:15.227397 2180315 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 16:30:15.227501 2180315 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0120 16:30:15.227542 2180315 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0120 16:30:15.229269 2180315 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-806597 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-806597 -n old-k8s-version-806597
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-806597 -n old-k8s-version-806597: exit status 6 (263.693824ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0120 16:30:15.565748 2183878 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-806597" does not appear in /home/jenkins/minikube-integration/20109-2129584/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-806597" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (309.80s)