=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-782728 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-782728 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m42.762345995s)
-- stdout --
* [old-k8s-version-782728] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18427
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18427-1067917/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18427-1067917/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-782728" primary control-plane node in "old-k8s-version-782728" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0318 14:10:43.147133 1122305 out.go:291] Setting OutFile to fd 1 ...
I0318 14:10:43.147420 1122305 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0318 14:10:43.147431 1122305 out.go:304] Setting ErrFile to fd 2...
I0318 14:10:43.147436 1122305 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0318 14:10:43.147620 1122305 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18427-1067917/.minikube/bin
I0318 14:10:43.148364 1122305 out.go:298] Setting JSON to false
I0318 14:10:43.149569 1122305 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":21190,"bootTime":1710749853,"procs":301,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0318 14:10:43.149638 1122305 start.go:139] virtualization: kvm guest
I0318 14:10:43.152003 1122305 out.go:177] * [old-k8s-version-782728] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0318 14:10:43.153668 1122305 out.go:177] - MINIKUBE_LOCATION=18427
I0318 14:10:43.153727 1122305 notify.go:220] Checking for updates...
I0318 14:10:43.155255 1122305 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0318 14:10:43.156990 1122305 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18427-1067917/kubeconfig
I0318 14:10:43.158685 1122305 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18427-1067917/.minikube
I0318 14:10:43.160353 1122305 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0318 14:10:43.162047 1122305 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0318 14:10:43.164146 1122305 config.go:182] Loaded profile config "bridge-059272": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 14:10:43.164289 1122305 config.go:182] Loaded profile config "enable-default-cni-059272": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 14:10:43.164414 1122305 config.go:182] Loaded profile config "flannel-059272": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 14:10:43.164585 1122305 driver.go:392] Setting default libvirt URI to qemu:///system
I0318 14:10:43.206552 1122305 out.go:177] * Using the kvm2 driver based on user configuration
I0318 14:10:43.208025 1122305 start.go:297] selected driver: kvm2
I0318 14:10:43.208045 1122305 start.go:901] validating driver "kvm2" against <nil>
I0318 14:10:43.208055 1122305 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0318 14:10:43.208956 1122305 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0318 14:10:43.209034 1122305 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18427-1067917/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0318 14:10:43.228057 1122305 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0318 14:10:43.228135 1122305 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0318 14:10:43.228468 1122305 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0318 14:10:43.228575 1122305 cni.go:84] Creating CNI manager for ""
I0318 14:10:43.228594 1122305 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0318 14:10:43.228613 1122305 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0318 14:10:43.228690 1122305 start.go:340] cluster config:
{Name:old-k8s-version-782728 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-782728 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0318 14:10:43.228814 1122305 iso.go:125] acquiring lock: {Name:mkb9005c39e1a5881f5d834c05544023d041c1ed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0318 14:10:43.231681 1122305 out.go:177] * Starting "old-k8s-version-782728" primary control-plane node in "old-k8s-version-782728" cluster
I0318 14:10:43.233181 1122305 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0318 14:10:43.233247 1122305 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0318 14:10:43.233258 1122305 cache.go:56] Caching tarball of preloaded images
I0318 14:10:43.233392 1122305 preload.go:173] Found /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0318 14:10:43.233409 1122305 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0318 14:10:43.233556 1122305 profile.go:142] Saving config to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/config.json ...
I0318 14:10:43.233584 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/config.json: {Name:mke65fda3c9c54396e82d829c7a663cae165c9fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:10:43.233804 1122305 start.go:360] acquireMachinesLock for old-k8s-version-782728: {Name:mkab080da72017f9265de5adb0ea5a5114c7ddcc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0318 14:10:43.233867 1122305 start.go:364] duration metric: took 30.257µs to acquireMachinesLock for "old-k8s-version-782728"
I0318 14:10:43.233892 1122305 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-782728 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-782728 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0318 14:10:43.233990 1122305 start.go:125] createHost starting for "" (driver="kvm2")
I0318 14:10:43.235764 1122305 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0318 14:10:43.235967 1122305 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0318 14:10:43.236019 1122305 main.go:141] libmachine: Launching plugin server for driver kvm2
I0318 14:10:43.253600 1122305 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34487
I0318 14:10:43.254181 1122305 main.go:141] libmachine: () Calling .GetVersion
I0318 14:10:43.254978 1122305 main.go:141] libmachine: Using API Version 1
I0318 14:10:43.255006 1122305 main.go:141] libmachine: () Calling .SetConfigRaw
I0318 14:10:43.255406 1122305 main.go:141] libmachine: () Calling .GetMachineName
I0318 14:10:43.255650 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetMachineName
I0318 14:10:43.256122 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:10:43.256339 1122305 start.go:159] libmachine.API.Create for "old-k8s-version-782728" (driver="kvm2")
I0318 14:10:43.256366 1122305 client.go:168] LocalClient.Create starting
I0318 14:10:43.256405 1122305 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca.pem
I0318 14:10:43.256454 1122305 main.go:141] libmachine: Decoding PEM data...
I0318 14:10:43.256475 1122305 main.go:141] libmachine: Parsing certificate...
I0318 14:10:43.256539 1122305 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/cert.pem
I0318 14:10:43.256570 1122305 main.go:141] libmachine: Decoding PEM data...
I0318 14:10:43.256584 1122305 main.go:141] libmachine: Parsing certificate...
I0318 14:10:43.256604 1122305 main.go:141] libmachine: Running pre-create checks...
I0318 14:10:43.256621 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .PreCreateCheck
I0318 14:10:43.260319 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetConfigRaw
I0318 14:10:43.260836 1122305 main.go:141] libmachine: Creating machine...
I0318 14:10:43.260856 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .Create
I0318 14:10:43.261380 1122305 main.go:141] libmachine: (old-k8s-version-782728) Creating KVM machine...
I0318 14:10:43.263622 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found existing default KVM network
I0318 14:10:43.265480 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:43.265268 1122327 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:56:14:d4} reservation:<nil>}
I0318 14:10:43.266994 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:43.266914 1122327 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015d80}
I0318 14:10:43.267028 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | created network xml:
I0318 14:10:43.267041 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | <network>
I0318 14:10:43.267053 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | <name>mk-old-k8s-version-782728</name>
I0318 14:10:43.267067 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | <dns enable='no'/>
I0318 14:10:43.267074 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG |
I0318 14:10:43.267085 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0318 14:10:43.267096 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | <dhcp>
I0318 14:10:43.267106 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0318 14:10:43.267117 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | </dhcp>
I0318 14:10:43.267130 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | </ip>
I0318 14:10:43.267144 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG |
I0318 14:10:43.267240 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | </network>
I0318 14:10:43.267274 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG |
I0318 14:10:43.272823 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | trying to create private KVM network mk-old-k8s-version-782728 192.168.50.0/24...
I0318 14:10:43.368867 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting up store path in /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728 ...
I0318 14:10:43.368903 1122305 main.go:141] libmachine: (old-k8s-version-782728) Building disk image from file:///home/jenkins/minikube-integration/18427-1067917/.minikube/cache/iso/amd64/minikube-v1.32.1-1710520390-17991-amd64.iso
I0318 14:10:43.368925 1122305 main.go:141] libmachine: (old-k8s-version-782728) Downloading /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18427-1067917/.minikube/cache/iso/amd64/minikube-v1.32.1-1710520390-17991-amd64.iso...
I0318 14:10:43.368946 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | private KVM network mk-old-k8s-version-782728 192.168.50.0/24 created
I0318 14:10:43.368962 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:43.365053 1122327 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18427-1067917/.minikube
I0318 14:10:43.691978 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:43.690490 1122327 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa...
I0318 14:10:43.925665 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:43.925524 1122327 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/old-k8s-version-782728.rawdisk...
I0318 14:10:43.925702 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Writing magic tar header
I0318 14:10:43.925717 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Writing SSH key tar header
I0318 14:10:43.925807 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:43.925724 1122327 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728 ...
I0318 14:10:43.925880 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728
I0318 14:10:43.925930 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting executable bit set on /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728 (perms=drwx------)
I0318 14:10:43.925966 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting executable bit set on /home/jenkins/minikube-integration/18427-1067917/.minikube/machines (perms=drwxr-xr-x)
I0318 14:10:43.925981 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines
I0318 14:10:43.925996 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18427-1067917/.minikube
I0318 14:10:43.926011 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18427-1067917
I0318 14:10:43.926026 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0318 14:10:43.926051 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home/jenkins
I0318 14:10:43.926067 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting executable bit set on /home/jenkins/minikube-integration/18427-1067917/.minikube (perms=drwxr-xr-x)
I0318 14:10:43.926084 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting executable bit set on /home/jenkins/minikube-integration/18427-1067917 (perms=drwxrwxr-x)
I0318 14:10:43.926093 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0318 14:10:43.926102 1122305 main.go:141] libmachine: (old-k8s-version-782728) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0318 14:10:43.926112 1122305 main.go:141] libmachine: (old-k8s-version-782728) Creating domain...
I0318 14:10:43.926123 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Checking permissions on dir: /home
I0318 14:10:43.926147 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Skipping /home - not owner
I0318 14:10:43.927575 1122305 main.go:141] libmachine: (old-k8s-version-782728) define libvirt domain using xml:
I0318 14:10:43.927604 1122305 main.go:141] libmachine: (old-k8s-version-782728) <domain type='kvm'>
I0318 14:10:43.927615 1122305 main.go:141] libmachine: (old-k8s-version-782728) <name>old-k8s-version-782728</name>
I0318 14:10:43.927624 1122305 main.go:141] libmachine: (old-k8s-version-782728) <memory unit='MiB'>2200</memory>
I0318 14:10:43.927633 1122305 main.go:141] libmachine: (old-k8s-version-782728) <vcpu>2</vcpu>
I0318 14:10:43.927641 1122305 main.go:141] libmachine: (old-k8s-version-782728) <features>
I0318 14:10:43.927653 1122305 main.go:141] libmachine: (old-k8s-version-782728) <acpi/>
I0318 14:10:43.927664 1122305 main.go:141] libmachine: (old-k8s-version-782728) <apic/>
I0318 14:10:43.927680 1122305 main.go:141] libmachine: (old-k8s-version-782728) <pae/>
I0318 14:10:43.927690 1122305 main.go:141] libmachine: (old-k8s-version-782728)
I0318 14:10:43.927698 1122305 main.go:141] libmachine: (old-k8s-version-782728) </features>
I0318 14:10:43.927710 1122305 main.go:141] libmachine: (old-k8s-version-782728) <cpu mode='host-passthrough'>
I0318 14:10:43.927722 1122305 main.go:141] libmachine: (old-k8s-version-782728)
I0318 14:10:43.927732 1122305 main.go:141] libmachine: (old-k8s-version-782728) </cpu>
I0318 14:10:43.927742 1122305 main.go:141] libmachine: (old-k8s-version-782728) <os>
I0318 14:10:43.927751 1122305 main.go:141] libmachine: (old-k8s-version-782728) <type>hvm</type>
I0318 14:10:43.927762 1122305 main.go:141] libmachine: (old-k8s-version-782728) <boot dev='cdrom'/>
I0318 14:10:43.927771 1122305 main.go:141] libmachine: (old-k8s-version-782728) <boot dev='hd'/>
I0318 14:10:43.927783 1122305 main.go:141] libmachine: (old-k8s-version-782728) <bootmenu enable='no'/>
I0318 14:10:43.927791 1122305 main.go:141] libmachine: (old-k8s-version-782728) </os>
I0318 14:10:43.927809 1122305 main.go:141] libmachine: (old-k8s-version-782728) <devices>
I0318 14:10:43.927842 1122305 main.go:141] libmachine: (old-k8s-version-782728) <disk type='file' device='cdrom'>
I0318 14:10:43.927872 1122305 main.go:141] libmachine: (old-k8s-version-782728) <source file='/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/boot2docker.iso'/>
I0318 14:10:43.927886 1122305 main.go:141] libmachine: (old-k8s-version-782728) <target dev='hdc' bus='scsi'/>
I0318 14:10:43.927897 1122305 main.go:141] libmachine: (old-k8s-version-782728) <readonly/>
I0318 14:10:43.927905 1122305 main.go:141] libmachine: (old-k8s-version-782728) </disk>
I0318 14:10:43.927915 1122305 main.go:141] libmachine: (old-k8s-version-782728) <disk type='file' device='disk'>
I0318 14:10:43.927924 1122305 main.go:141] libmachine: (old-k8s-version-782728) <driver name='qemu' type='raw' cache='default' io='threads' />
I0318 14:10:43.927950 1122305 main.go:141] libmachine: (old-k8s-version-782728) <source file='/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/old-k8s-version-782728.rawdisk'/>
I0318 14:10:43.927969 1122305 main.go:141] libmachine: (old-k8s-version-782728) <target dev='hda' bus='virtio'/>
I0318 14:10:43.927977 1122305 main.go:141] libmachine: (old-k8s-version-782728) </disk>
I0318 14:10:43.927990 1122305 main.go:141] libmachine: (old-k8s-version-782728) <interface type='network'>
I0318 14:10:43.928004 1122305 main.go:141] libmachine: (old-k8s-version-782728) <source network='mk-old-k8s-version-782728'/>
I0318 14:10:43.928016 1122305 main.go:141] libmachine: (old-k8s-version-782728) <model type='virtio'/>
I0318 14:10:43.928025 1122305 main.go:141] libmachine: (old-k8s-version-782728) </interface>
I0318 14:10:43.928037 1122305 main.go:141] libmachine: (old-k8s-version-782728) <interface type='network'>
I0318 14:10:43.928046 1122305 main.go:141] libmachine: (old-k8s-version-782728) <source network='default'/>
I0318 14:10:43.928056 1122305 main.go:141] libmachine: (old-k8s-version-782728) <model type='virtio'/>
I0318 14:10:43.928065 1122305 main.go:141] libmachine: (old-k8s-version-782728) </interface>
I0318 14:10:43.928076 1122305 main.go:141] libmachine: (old-k8s-version-782728) <serial type='pty'>
I0318 14:10:43.928087 1122305 main.go:141] libmachine: (old-k8s-version-782728) <target port='0'/>
I0318 14:10:43.928097 1122305 main.go:141] libmachine: (old-k8s-version-782728) </serial>
I0318 14:10:43.928109 1122305 main.go:141] libmachine: (old-k8s-version-782728) <console type='pty'>
I0318 14:10:43.928120 1122305 main.go:141] libmachine: (old-k8s-version-782728) <target type='serial' port='0'/>
I0318 14:10:43.928129 1122305 main.go:141] libmachine: (old-k8s-version-782728) </console>
I0318 14:10:43.928145 1122305 main.go:141] libmachine: (old-k8s-version-782728) <rng model='virtio'>
I0318 14:10:43.928193 1122305 main.go:141] libmachine: (old-k8s-version-782728) <backend model='random'>/dev/random</backend>
I0318 14:10:43.928235 1122305 main.go:141] libmachine: (old-k8s-version-782728) </rng>
I0318 14:10:43.928250 1122305 main.go:141] libmachine: (old-k8s-version-782728)
I0318 14:10:43.928261 1122305 main.go:141] libmachine: (old-k8s-version-782728)
I0318 14:10:43.928275 1122305 main.go:141] libmachine: (old-k8s-version-782728) </devices>
I0318 14:10:43.928290 1122305 main.go:141] libmachine: (old-k8s-version-782728) </domain>
I0318 14:10:43.928305 1122305 main.go:141] libmachine: (old-k8s-version-782728)
I0318 14:10:43.933317 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:68:5e:8b in network default
I0318 14:10:43.934147 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:43.934177 1122305 main.go:141] libmachine: (old-k8s-version-782728) Ensuring networks are active...
I0318 14:10:43.935102 1122305 main.go:141] libmachine: (old-k8s-version-782728) Ensuring network default is active
I0318 14:10:43.935557 1122305 main.go:141] libmachine: (old-k8s-version-782728) Ensuring network mk-old-k8s-version-782728 is active
I0318 14:10:43.936382 1122305 main.go:141] libmachine: (old-k8s-version-782728) Getting domain xml...
I0318 14:10:43.937449 1122305 main.go:141] libmachine: (old-k8s-version-782728) Creating domain...
I0318 14:10:45.471514 1122305 main.go:141] libmachine: (old-k8s-version-782728) Waiting to get IP...
I0318 14:10:45.472513 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:45.473229 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:45.473291 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:45.473216 1122327 retry.go:31] will retry after 197.707672ms: waiting for machine to come up
I0318 14:10:45.672934 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:45.673576 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:45.673601 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:45.673521 1122327 retry.go:31] will retry after 360.623055ms: waiting for machine to come up
I0318 14:10:46.036412 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:46.037430 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:46.037455 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:46.037329 1122327 retry.go:31] will retry after 345.556699ms: waiting for machine to come up
I0318 14:10:46.385235 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:46.385847 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:46.385874 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:46.385795 1122327 retry.go:31] will retry after 557.009366ms: waiting for machine to come up
I0318 14:10:46.944701 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:46.945291 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:46.945313 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:46.945226 1122327 retry.go:31] will retry after 463.74346ms: waiting for machine to come up
I0318 14:10:47.411232 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:47.411731 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:47.411767 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:47.411685 1122327 retry.go:31] will retry after 744.419393ms: waiting for machine to come up
I0318 14:10:48.158287 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:48.158930 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:48.158969 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:48.158857 1122327 retry.go:31] will retry after 1.141477117s: waiting for machine to come up
I0318 14:10:49.301698 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:49.302263 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:49.302290 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:49.302198 1122327 retry.go:31] will retry after 1.489252212s: waiting for machine to come up
I0318 14:10:50.793093 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:50.793706 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:50.793739 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:50.793584 1122327 retry.go:31] will retry after 1.377860848s: waiting for machine to come up
I0318 14:10:52.173075 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:52.173662 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:52.173739 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:52.173600 1122327 retry.go:31] will retry after 1.648489069s: waiting for machine to come up
I0318 14:10:53.824376 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:53.826998 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:53.827023 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:53.826773 1122327 retry.go:31] will retry after 2.245492058s: waiting for machine to come up
I0318 14:10:56.075966 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:56.075998 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:56.076014 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:56.074137 1122327 retry.go:31] will retry after 2.400901667s: waiting for machine to come up
I0318 14:10:58.484465 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:10:58.492040 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:10:58.492079 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:10:58.491978 1122327 retry.go:31] will retry after 2.79331204s: waiting for machine to come up
I0318 14:11:01.286826 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:01.287475 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:11:01.287493 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:11:01.287392 1122327 retry.go:31] will retry after 3.787029054s: waiting for machine to come up
I0318 14:11:05.077084 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:05.077667 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find current IP address of domain old-k8s-version-782728 in network mk-old-k8s-version-782728
I0318 14:11:05.077700 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | I0318 14:11:05.077599 1122327 retry.go:31] will retry after 6.614503473s: waiting for machine to come up
I0318 14:11:11.695873 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:11.696522 1122305 main.go:141] libmachine: (old-k8s-version-782728) Found IP for machine: 192.168.50.229
I0318 14:11:11.696576 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has current primary IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:11.696598 1122305 main.go:141] libmachine: (old-k8s-version-782728) Reserving static IP address...
I0318 14:11:11.696949 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-782728", mac: "52:54:00:bb:bf:3d", ip: "192.168.50.229"} in network mk-old-k8s-version-782728
I0318 14:11:11.775359 1122305 main.go:141] libmachine: (old-k8s-version-782728) Reserved static IP address: 192.168.50.229
I0318 14:11:11.775401 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Getting to WaitForSSH function...
I0318 14:11:11.775412 1122305 main.go:141] libmachine: (old-k8s-version-782728) Waiting for SSH to be available...
I0318 14:11:11.778286 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:11.778573 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728
I0318 14:11:11.778596 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | unable to find defined IP address of network mk-old-k8s-version-782728 interface with MAC address 52:54:00:bb:bf:3d
I0318 14:11:11.778770 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Using SSH client type: external
I0318 14:11:11.778800 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Using SSH private key: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa (-rw-------)
I0318 14:11:11.778834 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa -p 22] /usr/bin/ssh <nil>}
I0318 14:11:11.778849 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | About to run SSH command:
I0318 14:11:11.778868 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | exit 0
I0318 14:11:11.782766 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | SSH cmd err, output: exit status 255:
I0318 14:11:11.782789 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0318 14:11:11.782817 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | command : exit 0
I0318 14:11:11.782825 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | err : exit status 255
I0318 14:11:11.782842 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | output :
I0318 14:11:14.783564 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Getting to WaitForSSH function...
I0318 14:11:14.786130 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:14.786460 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:14.786495 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:14.786595 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Using SSH client type: external
I0318 14:11:14.786616 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Using SSH private key: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa (-rw-------)
I0318 14:11:14.786635 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.229 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa -p 22] /usr/bin/ssh <nil>}
I0318 14:11:14.786642 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | About to run SSH command:
I0318 14:11:14.786668 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | exit 0
I0318 14:11:14.916187 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | SSH cmd err, output: <nil>:
I0318 14:11:14.916588 1122305 main.go:141] libmachine: (old-k8s-version-782728) KVM machine creation complete!
I0318 14:11:14.916863 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetConfigRaw
I0318 14:11:14.917499 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:14.917734 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:14.917932 1122305 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0318 14:11:14.917961 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetState
I0318 14:11:14.919491 1122305 main.go:141] libmachine: Detecting operating system of created instance...
I0318 14:11:14.919513 1122305 main.go:141] libmachine: Waiting for SSH to be available...
I0318 14:11:14.919521 1122305 main.go:141] libmachine: Getting to WaitForSSH function...
I0318 14:11:14.919531 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:14.921781 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:14.922068 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:14.922101 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:14.922277 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:14.922471 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:14.922691 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:14.922830 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:14.922971 1122305 main.go:141] libmachine: Using SSH client type: native
I0318 14:11:14.923212 1122305 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.229 22 <nil> <nil>}
I0318 14:11:14.923229 1122305 main.go:141] libmachine: About to run SSH command:
exit 0
I0318 14:11:15.031275 1122305 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0318 14:11:15.031308 1122305 main.go:141] libmachine: Detecting the provisioner...
I0318 14:11:15.031320 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:15.034354 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.034744 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.034777 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.034970 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:15.035179 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.035368 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.035561 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:15.035789 1122305 main.go:141] libmachine: Using SSH client type: native
I0318 14:11:15.036157 1122305 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.229 22 <nil> <nil>}
I0318 14:11:15.036179 1122305 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0318 14:11:15.145050 1122305 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0318 14:11:15.145176 1122305 main.go:141] libmachine: found compatible host: buildroot
I0318 14:11:15.145190 1122305 main.go:141] libmachine: Provisioning with buildroot...
I0318 14:11:15.145199 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetMachineName
I0318 14:11:15.145505 1122305 buildroot.go:166] provisioning hostname "old-k8s-version-782728"
I0318 14:11:15.145542 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetMachineName
I0318 14:11:15.145757 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:15.148554 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.148920 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.148942 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.149197 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:15.149388 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.149592 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.149740 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:15.149998 1122305 main.go:141] libmachine: Using SSH client type: native
I0318 14:11:15.150237 1122305 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.229 22 <nil> <nil>}
I0318 14:11:15.150256 1122305 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-782728 && echo "old-k8s-version-782728" | sudo tee /etc/hostname
I0318 14:11:15.276484 1122305 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-782728
I0318 14:11:15.276518 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:15.280450 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.280821 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.280846 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.281051 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:15.281324 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.281505 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.281622 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:15.281828 1122305 main.go:141] libmachine: Using SSH client type: native
I0318 14:11:15.282040 1122305 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.229 22 <nil> <nil>}
I0318 14:11:15.282059 1122305 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-782728' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-782728/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-782728' | sudo tee -a /etc/hosts;
fi
fi
I0318 14:11:15.402652 1122305 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0318 14:11:15.402687 1122305 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18427-1067917/.minikube CaCertPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18427-1067917/.minikube}
I0318 14:11:15.402736 1122305 buildroot.go:174] setting up certificates
I0318 14:11:15.402749 1122305 provision.go:84] configureAuth start
I0318 14:11:15.402763 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetMachineName
I0318 14:11:15.403067 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetIP
I0318 14:11:15.405793 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.406172 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.406204 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.406334 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:15.408946 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.409384 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.409428 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.409571 1122305 provision.go:143] copyHostCerts
I0318 14:11:15.409665 1122305 exec_runner.go:144] found /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.pem, removing ...
I0318 14:11:15.409683 1122305 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.pem
I0318 14:11:15.409786 1122305 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.pem (1078 bytes)
I0318 14:11:15.409985 1122305 exec_runner.go:144] found /home/jenkins/minikube-integration/18427-1067917/.minikube/cert.pem, removing ...
I0318 14:11:15.410002 1122305 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18427-1067917/.minikube/cert.pem
I0318 14:11:15.410055 1122305 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18427-1067917/.minikube/cert.pem (1123 bytes)
I0318 14:11:15.410147 1122305 exec_runner.go:144] found /home/jenkins/minikube-integration/18427-1067917/.minikube/key.pem, removing ...
I0318 14:11:15.410158 1122305 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18427-1067917/.minikube/key.pem
I0318 14:11:15.410196 1122305 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18427-1067917/.minikube/key.pem (1679 bytes)
I0318 14:11:15.410311 1122305 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-782728 san=[127.0.0.1 192.168.50.229 localhost minikube old-k8s-version-782728]
I0318 14:11:15.610213 1122305 provision.go:177] copyRemoteCerts
I0318 14:11:15.610292 1122305 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0318 14:11:15.610321 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:15.613407 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.613785 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.613813 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.614024 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:15.614267 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.614435 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:15.614590 1122305 sshutil.go:53] new ssh client: &{IP:192.168.50.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa Username:docker}
I0318 14:11:15.701037 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0318 14:11:15.733666 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0318 14:11:15.763620 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0318 14:11:15.793076 1122305 provision.go:87] duration metric: took 390.306833ms to configureAuth
I0318 14:11:15.793111 1122305 buildroot.go:189] setting minikube options for container-runtime
I0318 14:11:15.793299 1122305 config.go:182] Loaded profile config "old-k8s-version-782728": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0318 14:11:15.793382 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:15.796599 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.796947 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:15.796972 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:15.797203 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:15.797435 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.797624 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:15.797748 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:15.797884 1122305 main.go:141] libmachine: Using SSH client type: native
I0318 14:11:15.798072 1122305 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.229 22 <nil> <nil>}
I0318 14:11:15.798092 1122305 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0318 14:11:16.095692 1122305 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0318 14:11:16.095729 1122305 main.go:141] libmachine: Checking connection to Docker...
I0318 14:11:16.095741 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetURL
I0318 14:11:16.097194 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | Using libvirt version 6000000
I0318 14:11:16.099907 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.100322 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.100378 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.100568 1122305 main.go:141] libmachine: Docker is up and running!
I0318 14:11:16.100584 1122305 main.go:141] libmachine: Reticulating splines...
I0318 14:11:16.100605 1122305 client.go:171] duration metric: took 32.844217743s to LocalClient.Create
I0318 14:11:16.100629 1122305 start.go:167] duration metric: took 32.844293809s to libmachine.API.Create "old-k8s-version-782728"
I0318 14:11:16.100638 1122305 start.go:293] postStartSetup for "old-k8s-version-782728" (driver="kvm2")
I0318 14:11:16.100648 1122305 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0318 14:11:16.100669 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:16.100927 1122305 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0318 14:11:16.100954 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:16.103317 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.103666 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.103703 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.103973 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:16.104162 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:16.104358 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:16.104532 1122305 sshutil.go:53] new ssh client: &{IP:192.168.50.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa Username:docker}
I0318 14:11:16.187351 1122305 ssh_runner.go:195] Run: cat /etc/os-release
I0318 14:11:16.192281 1122305 info.go:137] Remote host: Buildroot 2023.02.9
I0318 14:11:16.192309 1122305 filesync.go:126] Scanning /home/jenkins/minikube-integration/18427-1067917/.minikube/addons for local assets ...
I0318 14:11:16.192370 1122305 filesync.go:126] Scanning /home/jenkins/minikube-integration/18427-1067917/.minikube/files for local assets ...
I0318 14:11:16.192453 1122305 filesync.go:149] local asset: /home/jenkins/minikube-integration/18427-1067917/.minikube/files/etc/ssl/certs/10752082.pem -> 10752082.pem in /etc/ssl/certs
I0318 14:11:16.192539 1122305 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0318 14:11:16.202897 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/files/etc/ssl/certs/10752082.pem --> /etc/ssl/certs/10752082.pem (1708 bytes)
I0318 14:11:16.231667 1122305 start.go:296] duration metric: took 131.011235ms for postStartSetup
I0318 14:11:16.231726 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetConfigRaw
I0318 14:11:16.232408 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetIP
I0318 14:11:16.235801 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.236270 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.236308 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.236538 1122305 profile.go:142] Saving config to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/config.json ...
I0318 14:11:16.236731 1122305 start.go:128] duration metric: took 33.002728183s to createHost
I0318 14:11:16.236758 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:16.239186 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.239611 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.239635 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.239848 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:16.240090 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:16.240257 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:16.240402 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:16.240584 1122305 main.go:141] libmachine: Using SSH client type: native
I0318 14:11:16.240768 1122305 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.50.229 22 <nil> <nil>}
I0318 14:11:16.240784 1122305 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0318 14:11:16.349336 1122305 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710771076.339451831
I0318 14:11:16.349365 1122305 fix.go:216] guest clock: 1710771076.339451831
I0318 14:11:16.349399 1122305 fix.go:229] Guest: 2024-03-18 14:11:16.339451831 +0000 UTC Remote: 2024-03-18 14:11:16.236744713 +0000 UTC m=+33.149235953 (delta=102.707118ms)
I0318 14:11:16.349427 1122305 fix.go:200] guest clock delta is within tolerance: 102.707118ms
I0318 14:11:16.349435 1122305 start.go:83] releasing machines lock for "old-k8s-version-782728", held for 33.115555193s
I0318 14:11:16.349460 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:16.349797 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetIP
I0318 14:11:16.353161 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.353637 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.353665 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.353922 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:16.354496 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:16.354671 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .DriverName
I0318 14:11:16.354777 1122305 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0318 14:11:16.354831 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:16.354942 1122305 ssh_runner.go:195] Run: cat /version.json
I0318 14:11:16.354970 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHHostname
I0318 14:11:16.357931 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.357960 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.358411 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.358486 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.358568 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:16.358592 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:16.358795 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:16.358812 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHPort
I0318 14:11:16.359019 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:16.359056 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHKeyPath
I0318 14:11:16.359250 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:16.359287 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetSSHUsername
I0318 14:11:16.359424 1122305 sshutil.go:53] new ssh client: &{IP:192.168.50.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa Username:docker}
I0318 14:11:16.359770 1122305 sshutil.go:53] new ssh client: &{IP:192.168.50.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18427-1067917/.minikube/machines/old-k8s-version-782728/id_rsa Username:docker}
I0318 14:11:16.445837 1122305 ssh_runner.go:195] Run: systemctl --version
I0318 14:11:16.473563 1122305 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0318 14:11:16.652028 1122305 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0318 14:11:16.658954 1122305 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0318 14:11:16.659039 1122305 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0318 14:11:16.687229 1122305 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0318 14:11:16.687261 1122305 start.go:494] detecting cgroup driver to use...
I0318 14:11:16.687352 1122305 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0318 14:11:16.709329 1122305 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0318 14:11:16.725031 1122305 docker.go:217] disabling cri-docker service (if available) ...
I0318 14:11:16.725095 1122305 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0318 14:11:16.740710 1122305 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0318 14:11:16.756272 1122305 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0318 14:11:16.902138 1122305 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0318 14:11:17.061752 1122305 docker.go:233] disabling docker service ...
I0318 14:11:17.061827 1122305 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0318 14:11:17.078119 1122305 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0318 14:11:17.093132 1122305 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0318 14:11:17.257193 1122305 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0318 14:11:17.384452 1122305 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0318 14:11:17.403125 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0318 14:11:17.425152 1122305 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0318 14:11:17.425234 1122305 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0318 14:11:17.437365 1122305 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0318 14:11:17.437443 1122305 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0318 14:11:17.449785 1122305 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0318 14:11:17.461181 1122305 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0318 14:11:17.472937 1122305 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0318 14:11:17.484454 1122305 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0318 14:11:17.495392 1122305 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0318 14:11:17.495452 1122305 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0318 14:11:17.510878 1122305 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0318 14:11:17.521830 1122305 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0318 14:11:17.674768 1122305 ssh_runner.go:195] Run: sudo systemctl restart crio
I0318 14:11:17.848404 1122305 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0318 14:11:17.848507 1122305 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0318 14:11:17.854297 1122305 start.go:562] Will wait 60s for crictl version
I0318 14:11:17.854364 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:17.859316 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0318 14:11:17.904567 1122305 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0318 14:11:17.904684 1122305 ssh_runner.go:195] Run: crio --version
I0318 14:11:17.935820 1122305 ssh_runner.go:195] Run: crio --version
I0318 14:11:17.978623 1122305 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0318 14:11:17.979960 1122305 main.go:141] libmachine: (old-k8s-version-782728) Calling .GetIP
I0318 14:11:17.984120 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:17.984596 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:bb:bf:3d", ip: ""} in network mk-old-k8s-version-782728: {Iface:virbr1 ExpiryTime:2024-03-18 15:11:01 +0000 UTC Type:0 Mac:52:54:00:bb:bf:3d Iaid: IPaddr:192.168.50.229 Prefix:24 Hostname:old-k8s-version-782728 Clientid:01:52:54:00:bb:bf:3d}
I0318 14:11:17.984659 1122305 main.go:141] libmachine: (old-k8s-version-782728) DBG | domain old-k8s-version-782728 has defined IP address 192.168.50.229 and MAC address 52:54:00:bb:bf:3d in network mk-old-k8s-version-782728
I0318 14:11:17.984885 1122305 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0318 14:11:17.990207 1122305 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0318 14:11:18.005678 1122305 kubeadm.go:877] updating cluster {Name:old-k8s-version-782728 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-782728 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.229 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0318 14:11:18.005830 1122305 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0318 14:11:18.005903 1122305 ssh_runner.go:195] Run: sudo crictl images --output json
I0318 14:11:18.048576 1122305 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0318 14:11:18.048674 1122305 ssh_runner.go:195] Run: which lz4
I0318 14:11:18.054760 1122305 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0318 14:11:18.060544 1122305 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0318 14:11:18.060590 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0318 14:11:20.159801 1122305 crio.go:444] duration metric: took 2.105087936s to copy over tarball
I0318 14:11:20.159931 1122305 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0318 14:11:23.367085 1122305 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.207115966s)
I0318 14:11:23.367122 1122305 crio.go:451] duration metric: took 3.207266915s to extract the tarball
I0318 14:11:23.367132 1122305 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0318 14:11:23.413510 1122305 ssh_runner.go:195] Run: sudo crictl images --output json
I0318 14:11:23.467679 1122305 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0318 14:11:23.467712 1122305 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0318 14:11:23.467796 1122305 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0318 14:11:23.467852 1122305 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0318 14:11:23.468117 1122305 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0318 14:11:23.468159 1122305 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 14:11:23.468300 1122305 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0318 14:11:23.468347 1122305 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 14:11:23.468485 1122305 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 14:11:23.468505 1122305 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0318 14:11:23.470545 1122305 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0318 14:11:23.470584 1122305 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0318 14:11:23.470597 1122305 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0318 14:11:23.470545 1122305 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 14:11:23.470552 1122305 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 14:11:23.470625 1122305 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 14:11:23.470675 1122305 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0318 14:11:23.471121 1122305 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0318 14:11:23.625936 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0318 14:11:23.627165 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0318 14:11:23.636176 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0318 14:11:23.640646 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0318 14:11:23.642335 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0318 14:11:23.678025 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0318 14:11:23.679915 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0318 14:11:23.731019 1122305 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0318 14:11:23.731067 1122305 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 14:11:23.731128 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.735016 1122305 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0318 14:11:23.735065 1122305 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0318 14:11:23.735119 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.771522 1122305 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0318 14:11:23.771577 1122305 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0318 14:11:23.771631 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.803893 1122305 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0318 14:11:23.803938 1122305 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0318 14:11:23.804006 1122305 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0318 14:11:23.804030 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.804051 1122305 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 14:11:23.804103 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.830800 1122305 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0318 14:11:23.830859 1122305 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 14:11:23.830917 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.846715 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0318 14:11:23.846771 1122305 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0318 14:11:23.846816 1122305 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0318 14:11:23.846829 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0318 14:11:23.846844 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0318 14:11:23.846857 1122305 ssh_runner.go:195] Run: which crictl
I0318 14:11:23.846962 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0318 14:11:23.846992 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0318 14:11:23.847024 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0318 14:11:23.996990 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0318 14:11:23.997016 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0318 14:11:23.997106 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0318 14:11:23.997128 1122305 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0318 14:11:24.000315 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0318 14:11:24.000319 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0318 14:11:24.000372 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0318 14:11:24.036144 1122305 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0318 14:11:24.132968 1122305 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0318 14:11:24.283423 1122305 cache_images.go:92] duration metric: took 815.68651ms to LoadCachedImages
W0318 14:11:24.283578 1122305 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18427-1067917/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0318 14:11:24.283597 1122305 kubeadm.go:928] updating node { 192.168.50.229 8443 v1.20.0 crio true true} ...
I0318 14:11:24.283758 1122305 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-782728 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.229
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-782728 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0318 14:11:24.283874 1122305 ssh_runner.go:195] Run: crio config
I0318 14:11:24.345959 1122305 cni.go:84] Creating CNI manager for ""
I0318 14:11:24.345988 1122305 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0318 14:11:24.346003 1122305 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0318 14:11:24.346030 1122305 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.229 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-782728 NodeName:old-k8s-version-782728 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.229"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.229 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0318 14:11:24.346204 1122305 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.229
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-782728"
kubeletExtraArgs:
node-ip: 192.168.50.229
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.229"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0318 14:11:24.346274 1122305 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0318 14:11:24.357808 1122305 binaries.go:44] Found k8s binaries, skipping transfer
I0318 14:11:24.357897 1122305 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0318 14:11:24.370835 1122305 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0318 14:11:24.393543 1122305 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0318 14:11:24.412548 1122305 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0318 14:11:24.431966 1122305 ssh_runner.go:195] Run: grep 192.168.50.229 control-plane.minikube.internal$ /etc/hosts
I0318 14:11:24.436418 1122305 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.229 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0318 14:11:24.450534 1122305 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0318 14:11:24.583698 1122305 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0318 14:11:24.602360 1122305 certs.go:68] Setting up /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728 for IP: 192.168.50.229
I0318 14:11:24.602388 1122305 certs.go:194] generating shared ca certs ...
I0318 14:11:24.602411 1122305 certs.go:226] acquiring lock for ca certs: {Name:mkc7781bd693a905b86d51c380d52282361680ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:24.602610 1122305 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.key
I0318 14:11:24.602667 1122305 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/proxy-client-ca.key
I0318 14:11:24.602681 1122305 certs.go:256] generating profile certs ...
I0318 14:11:24.602761 1122305 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/client.key
I0318 14:11:24.602779 1122305 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/client.crt with IP's: []
I0318 14:11:25.052295 1122305 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/client.crt ...
I0318 14:11:25.052334 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/client.crt: {Name:mkfb731b27dd8e3cafd52e65cd550b1408b7809a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:25.052530 1122305 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/client.key ...
I0318 14:11:25.052546 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/client.key: {Name:mkfb22a6ad532f18232fb6e2a7de61d6463476c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:25.052664 1122305 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.key.07e4f612
I0318 14:11:25.052683 1122305 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.crt.07e4f612 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.229]
I0318 14:11:25.283420 1122305 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.crt.07e4f612 ...
I0318 14:11:25.283459 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.crt.07e4f612: {Name:mkdb0c0db21e157c511427916ed1803b90af7970 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:25.283677 1122305 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.key.07e4f612 ...
I0318 14:11:25.283699 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.key.07e4f612: {Name:mke9d38866093244a9e82de322da4da42fe430ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:25.283816 1122305 certs.go:381] copying /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.crt.07e4f612 -> /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.crt
I0318 14:11:25.284717 1122305 certs.go:385] copying /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.key.07e4f612 -> /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.key
I0318 14:11:25.284837 1122305 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.key
I0318 14:11:25.284869 1122305 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.crt with IP's: []
I0318 14:11:25.435012 1122305 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.crt ...
I0318 14:11:25.435052 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.crt: {Name:mk929efc8ed165cf35172678bf1e301d50bd7c5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:25.435277 1122305 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.key ...
I0318 14:11:25.435303 1122305 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.key: {Name:mk5fc5169f7ce199d021610b7b99ea62937cdeef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 14:11:25.435560 1122305 certs.go:484] found cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/1075208.pem (1338 bytes)
W0318 14:11:25.435622 1122305 certs.go:480] ignoring /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/1075208_empty.pem, impossibly tiny 0 bytes
I0318 14:11:25.435637 1122305 certs.go:484] found cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca-key.pem (1679 bytes)
I0318 14:11:25.435672 1122305 certs.go:484] found cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/ca.pem (1078 bytes)
I0318 14:11:25.435706 1122305 certs.go:484] found cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/cert.pem (1123 bytes)
I0318 14:11:25.435734 1122305 certs.go:484] found cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/key.pem (1679 bytes)
I0318 14:11:25.435789 1122305 certs.go:484] found cert: /home/jenkins/minikube-integration/18427-1067917/.minikube/files/etc/ssl/certs/10752082.pem (1708 bytes)
I0318 14:11:25.436570 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0318 14:11:25.499817 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0318 14:11:25.558385 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0318 14:11:25.631623 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0318 14:11:25.671420 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0318 14:11:25.712358 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0318 14:11:25.750610 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0318 14:11:25.787807 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/profiles/old-k8s-version-782728/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0318 14:11:25.825305 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/certs/1075208.pem --> /usr/share/ca-certificates/1075208.pem (1338 bytes)
I0318 14:11:25.862212 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/files/etc/ssl/certs/10752082.pem --> /usr/share/ca-certificates/10752082.pem (1708 bytes)
I0318 14:11:25.901548 1122305 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18427-1067917/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0318 14:11:25.940196 1122305 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0318 14:11:25.963602 1122305 ssh_runner.go:195] Run: openssl version
I0318 14:11:25.973038 1122305 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1075208.pem && ln -fs /usr/share/ca-certificates/1075208.pem /etc/ssl/certs/1075208.pem"
I0318 14:11:25.989155 1122305 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1075208.pem
I0318 14:11:25.997204 1122305 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 18 12:54 /usr/share/ca-certificates/1075208.pem
I0318 14:11:25.997292 1122305 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1075208.pem
I0318 14:11:26.006252 1122305 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1075208.pem /etc/ssl/certs/51391683.0"
I0318 14:11:26.022964 1122305 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10752082.pem && ln -fs /usr/share/ca-certificates/10752082.pem /etc/ssl/certs/10752082.pem"
I0318 14:11:26.042405 1122305 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10752082.pem
I0318 14:11:26.048872 1122305 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 18 12:54 /usr/share/ca-certificates/10752082.pem
I0318 14:11:26.048937 1122305 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10752082.pem
I0318 14:11:26.056169 1122305 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10752082.pem /etc/ssl/certs/3ec20f2e.0"
I0318 14:11:26.072431 1122305 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0318 14:11:26.088652 1122305 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0318 14:11:26.095009 1122305 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 18 12:45 /usr/share/ca-certificates/minikubeCA.pem
I0318 14:11:26.095105 1122305 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0318 14:11:26.103895 1122305 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0318 14:11:26.120368 1122305 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0318 14:11:26.126420 1122305 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0318 14:11:26.126499 1122305 kubeadm.go:391] StartCluster: {Name:old-k8s-version-782728 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-782728 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.229 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0318 14:11:26.126619 1122305 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0318 14:11:26.126714 1122305 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0318 14:11:26.174317 1122305 cri.go:89] found id: ""
I0318 14:11:26.174424 1122305 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0318 14:11:26.188570 1122305 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0318 14:11:26.202015 1122305 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0318 14:11:26.214384 1122305 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0318 14:11:26.214413 1122305 kubeadm.go:156] found existing configuration files:
I0318 14:11:26.214476 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0318 14:11:26.226832 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0318 14:11:26.226911 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0318 14:11:26.247870 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0318 14:11:26.273906 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0318 14:11:26.274012 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0318 14:11:26.289085 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0318 14:11:26.306071 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0318 14:11:26.306151 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0318 14:11:26.320232 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0318 14:11:26.347419 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0318 14:11:26.347496 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0318 14:11:26.363356 1122305 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0318 14:11:26.522448 1122305 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0318 14:11:26.522870 1122305 kubeadm.go:309] [preflight] Running pre-flight checks
I0318 14:11:26.722006 1122305 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0318 14:11:26.722156 1122305 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0318 14:11:26.722278 1122305 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0318 14:11:27.056683 1122305 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0318 14:11:27.060078 1122305 out.go:204] - Generating certificates and keys ...
I0318 14:11:27.060188 1122305 kubeadm.go:309] [certs] Using existing ca certificate authority
I0318 14:11:27.060267 1122305 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0318 14:11:27.317219 1122305 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0318 14:11:27.393852 1122305 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0318 14:11:27.583754 1122305 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0318 14:11:27.709775 1122305 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0318 14:11:27.961368 1122305 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0318 14:11:27.961853 1122305 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-782728] and IPs [192.168.50.229 127.0.0.1 ::1]
I0318 14:11:28.276309 1122305 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0318 14:11:28.276500 1122305 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-782728] and IPs [192.168.50.229 127.0.0.1 ::1]
I0318 14:11:28.955292 1122305 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0318 14:11:29.495672 1122305 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0318 14:11:29.773008 1122305 kubeadm.go:309] [certs] Generating "sa" key and public key
I0318 14:11:29.773347 1122305 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0318 14:11:29.859325 1122305 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0318 14:11:30.398761 1122305 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0318 14:11:30.676223 1122305 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0318 14:11:30.863405 1122305 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0318 14:11:30.879682 1122305 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0318 14:11:30.880846 1122305 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0318 14:11:30.881508 1122305 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0318 14:11:31.019294 1122305 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0318 14:11:31.021271 1122305 out.go:204] - Booting up control plane ...
I0318 14:11:31.021425 1122305 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0318 14:11:31.030253 1122305 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0318 14:11:31.031350 1122305 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0318 14:11:31.032142 1122305 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0318 14:11:31.036303 1122305 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0318 14:12:11.035613 1122305 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0318 14:12:11.036422 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:12:11.036722 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:12:16.037089 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:12:16.037311 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:12:26.038334 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:12:26.038593 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:12:46.039205 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:12:46.039525 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:13:26.040006 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:13:26.040621 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:13:26.040663 1122305 kubeadm.go:309]
I0318 14:13:26.040751 1122305 kubeadm.go:309] Unfortunately, an error has occurred:
I0318 14:13:26.040879 1122305 kubeadm.go:309] timed out waiting for the condition
I0318 14:13:26.040899 1122305 kubeadm.go:309]
I0318 14:13:26.040983 1122305 kubeadm.go:309] This error is likely caused by:
I0318 14:13:26.041087 1122305 kubeadm.go:309] - The kubelet is not running
I0318 14:13:26.041350 1122305 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0318 14:13:26.041364 1122305 kubeadm.go:309]
I0318 14:13:26.041614 1122305 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0318 14:13:26.041706 1122305 kubeadm.go:309] - 'systemctl status kubelet'
I0318 14:13:26.041805 1122305 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0318 14:13:26.041826 1122305 kubeadm.go:309]
I0318 14:13:26.042066 1122305 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0318 14:13:26.042252 1122305 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0318 14:13:26.042266 1122305 kubeadm.go:309]
I0318 14:13:26.042448 1122305 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0318 14:13:26.042595 1122305 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0318 14:13:26.042789 1122305 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0318 14:13:26.042972 1122305 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0318 14:13:26.042992 1122305 kubeadm.go:309]
I0318 14:13:26.044399 1122305 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0318 14:13:26.044535 1122305 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0318 14:13:26.044714 1122305 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0318 14:13:26.044830 1122305 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-782728] and IPs [192.168.50.229 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-782728] and IPs [192.168.50.229 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-782728] and IPs [192.168.50.229 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-782728] and IPs [192.168.50.229 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0318 14:13:26.044886 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0318 14:13:28.486643 1122305 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.441729511s)
I0318 14:13:28.486741 1122305 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0318 14:13:28.501582 1122305 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0318 14:13:28.512530 1122305 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0318 14:13:28.512551 1122305 kubeadm.go:156] found existing configuration files:
I0318 14:13:28.512599 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0318 14:13:28.523484 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0318 14:13:28.523544 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0318 14:13:28.533918 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0318 14:13:28.544622 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0318 14:13:28.544679 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0318 14:13:28.555175 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0318 14:13:28.565508 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0318 14:13:28.565576 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0318 14:13:28.576782 1122305 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0318 14:13:28.587368 1122305 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0318 14:13:28.587445 1122305 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0318 14:13:28.598332 1122305 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0318 14:13:28.827215 1122305 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0318 14:15:25.179643 1122305 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0318 14:15:25.179749 1122305 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0318 14:15:25.180771 1122305 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0318 14:15:25.180838 1122305 kubeadm.go:309] [preflight] Running pre-flight checks
I0318 14:15:25.180919 1122305 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0318 14:15:25.181006 1122305 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0318 14:15:25.181096 1122305 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0318 14:15:25.181153 1122305 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0318 14:15:25.183055 1122305 out.go:204] - Generating certificates and keys ...
I0318 14:15:25.183121 1122305 kubeadm.go:309] [certs] Using existing ca certificate authority
I0318 14:15:25.183174 1122305 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0318 14:15:25.183240 1122305 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0318 14:15:25.183291 1122305 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0318 14:15:25.183348 1122305 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0318 14:15:25.183394 1122305 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0318 14:15:25.183454 1122305 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0318 14:15:25.183506 1122305 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0318 14:15:25.183577 1122305 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0318 14:15:25.183688 1122305 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0318 14:15:25.183756 1122305 kubeadm.go:309] [certs] Using the existing "sa" key
I0318 14:15:25.183854 1122305 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0318 14:15:25.183948 1122305 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0318 14:15:25.184000 1122305 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0318 14:15:25.184053 1122305 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0318 14:15:25.184098 1122305 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0318 14:15:25.184190 1122305 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0318 14:15:25.184264 1122305 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0318 14:15:25.184324 1122305 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0318 14:15:25.184431 1122305 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0318 14:15:25.186885 1122305 out.go:204] - Booting up control plane ...
I0318 14:15:25.187024 1122305 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0318 14:15:25.187091 1122305 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0318 14:15:25.187151 1122305 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0318 14:15:25.187225 1122305 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0318 14:15:25.187377 1122305 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0318 14:15:25.187435 1122305 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0318 14:15:25.187493 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:15:25.187669 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:15:25.187735 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:15:25.187911 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:15:25.187970 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:15:25.188119 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:15:25.188194 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:15:25.188400 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:15:25.188481 1122305 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 14:15:25.188707 1122305 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 14:15:25.188729 1122305 kubeadm.go:309]
I0318 14:15:25.188774 1122305 kubeadm.go:309] Unfortunately, an error has occurred:
I0318 14:15:25.188833 1122305 kubeadm.go:309] timed out waiting for the condition
I0318 14:15:25.188848 1122305 kubeadm.go:309]
I0318 14:15:25.188878 1122305 kubeadm.go:309] This error is likely caused by:
I0318 14:15:25.188910 1122305 kubeadm.go:309] - The kubelet is not running
I0318 14:15:25.189007 1122305 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0318 14:15:25.189014 1122305 kubeadm.go:309]
I0318 14:15:25.189104 1122305 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0318 14:15:25.189134 1122305 kubeadm.go:309] - 'systemctl status kubelet'
I0318 14:15:25.189166 1122305 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0318 14:15:25.189172 1122305 kubeadm.go:309]
I0318 14:15:25.189253 1122305 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0318 14:15:25.189330 1122305 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0318 14:15:25.189340 1122305 kubeadm.go:309]
I0318 14:15:25.189436 1122305 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0318 14:15:25.189520 1122305 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0318 14:15:25.189588 1122305 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0318 14:15:25.189647 1122305 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0318 14:15:25.189692 1122305 kubeadm.go:309]
I0318 14:15:25.189712 1122305 kubeadm.go:393] duration metric: took 3m59.063221445s to StartCluster
I0318 14:15:25.189754 1122305 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0318 14:15:25.189808 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0318 14:15:25.239252 1122305 cri.go:89] found id: ""
I0318 14:15:25.239290 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.239302 1122305 logs.go:278] No container was found matching "kube-apiserver"
I0318 14:15:25.239310 1122305 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0318 14:15:25.239369 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0318 14:15:25.287340 1122305 cri.go:89] found id: ""
I0318 14:15:25.287368 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.287375 1122305 logs.go:278] No container was found matching "etcd"
I0318 14:15:25.287381 1122305 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0318 14:15:25.287445 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0318 14:15:25.327218 1122305 cri.go:89] found id: ""
I0318 14:15:25.327249 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.327260 1122305 logs.go:278] No container was found matching "coredns"
I0318 14:15:25.327268 1122305 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0318 14:15:25.327328 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0318 14:15:25.364884 1122305 cri.go:89] found id: ""
I0318 14:15:25.364918 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.364927 1122305 logs.go:278] No container was found matching "kube-scheduler"
I0318 14:15:25.364933 1122305 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0318 14:15:25.364987 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0318 14:15:25.401037 1122305 cri.go:89] found id: ""
I0318 14:15:25.401072 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.401080 1122305 logs.go:278] No container was found matching "kube-proxy"
I0318 14:15:25.401087 1122305 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0318 14:15:25.401138 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0318 14:15:25.443430 1122305 cri.go:89] found id: ""
I0318 14:15:25.443460 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.443469 1122305 logs.go:278] No container was found matching "kube-controller-manager"
I0318 14:15:25.443478 1122305 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0318 14:15:25.443539 1122305 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0318 14:15:25.478498 1122305 cri.go:89] found id: ""
I0318 14:15:25.478529 1122305 logs.go:276] 0 containers: []
W0318 14:15:25.478538 1122305 logs.go:278] No container was found matching "kindnet"
I0318 14:15:25.478554 1122305 logs.go:123] Gathering logs for kubelet ...
I0318 14:15:25.478569 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0318 14:15:25.529139 1122305 logs.go:123] Gathering logs for dmesg ...
I0318 14:15:25.529181 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0318 14:15:25.543745 1122305 logs.go:123] Gathering logs for describe nodes ...
I0318 14:15:25.543781 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0318 14:15:25.692134 1122305 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0318 14:15:25.692159 1122305 logs.go:123] Gathering logs for CRI-O ...
I0318 14:15:25.692176 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0318 14:15:25.788869 1122305 logs.go:123] Gathering logs for container status ...
I0318 14:15:25.788912 1122305 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0318 14:15:25.831141 1122305 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 14:15:25.831185 1122305 out.go:239] *
*
W0318 14:15:25.831240 1122305 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 14:15:25.831263 1122305 out.go:239] *
*
W0318 14:15:25.832137 1122305 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0318 14:15:25.835858 1122305 out.go:177]
W0318 14:15:25.837037 1122305 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 14:15:25.837102 1122305 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0318 14:15:25.837137 1122305 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0318 14:15:25.838601 1122305 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-782728 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-782728 -n old-k8s-version-782728
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-782728 -n old-k8s-version-782728: exit status 6 (245.065259ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0318 14:15:26.126067 1128275 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-782728" does not appear in /home/jenkins/minikube-integration/18427-1067917/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-782728" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (283.06s)