=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-503971 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-503971 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m38.255443474s)
-- stdout --
* [old-k8s-version-503971] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18779
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18779-13391/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18779-13391/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-503971" primary control-plane node in "old-k8s-version-503971" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0501 03:30:12.547276 65502 out.go:291] Setting OutFile to fd 1 ...
I0501 03:30:12.547417 65502 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0501 03:30:12.547434 65502 out.go:304] Setting ErrFile to fd 2...
I0501 03:30:12.547450 65502 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0501 03:30:12.547718 65502 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18779-13391/.minikube/bin
I0501 03:30:12.548366 65502 out.go:298] Setting JSON to false
I0501 03:30:12.549428 65502 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":7956,"bootTime":1714526257,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0501 03:30:12.549491 65502 start.go:139] virtualization: kvm guest
I0501 03:30:12.551613 65502 out.go:177] * [old-k8s-version-503971] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
I0501 03:30:12.552973 65502 out.go:177] - MINIKUBE_LOCATION=18779
I0501 03:30:12.554272 65502 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0501 03:30:12.553057 65502 notify.go:220] Checking for updates...
I0501 03:30:12.556671 65502 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18779-13391/kubeconfig
I0501 03:30:12.557966 65502 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18779-13391/.minikube
I0501 03:30:12.559376 65502 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0501 03:30:12.560810 65502 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0501 03:30:12.562481 65502 config.go:182] Loaded profile config "cert-options-582976": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0501 03:30:12.562600 65502 config.go:182] Loaded profile config "kubernetes-upgrade-046243": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0501 03:30:12.562731 65502 config.go:182] Loaded profile config "pause-542495": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0501 03:30:12.562841 65502 driver.go:392] Setting default libvirt URI to qemu:///system
I0501 03:30:12.601023 65502 out.go:177] * Using the kvm2 driver based on user configuration
I0501 03:30:12.602106 65502 start.go:297] selected driver: kvm2
I0501 03:30:12.602117 65502 start.go:901] validating driver "kvm2" against <nil>
I0501 03:30:12.602127 65502 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0501 03:30:12.602818 65502 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0501 03:30:12.602893 65502 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18779-13391/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0501 03:30:12.618994 65502 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0
I0501 03:30:12.619061 65502 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0501 03:30:12.619303 65502 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0501 03:30:12.619358 65502 cni.go:84] Creating CNI manager for ""
I0501 03:30:12.619368 65502 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0501 03:30:12.619379 65502 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0501 03:30:12.619429 65502 start.go:340] cluster config:
{Name:old-k8s-version-503971 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-503971 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0501 03:30:12.619519 65502 iso.go:125] acquiring lock: {Name:mkcd2496aadb29931e179193d707c731bfda98b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0501 03:30:12.621066 65502 out.go:177] * Starting "old-k8s-version-503971" primary control-plane node in "old-k8s-version-503971" cluster
I0501 03:30:12.622160 65502 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0501 03:30:12.622204 65502 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0501 03:30:12.622221 65502 cache.go:56] Caching tarball of preloaded images
I0501 03:30:12.622306 65502 preload.go:173] Found /home/jenkins/minikube-integration/18779-13391/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0501 03:30:12.622323 65502 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0501 03:30:12.622458 65502 profile.go:143] Saving config to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/config.json ...
I0501 03:30:12.622486 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/config.json: {Name:mk669fe3f056de7b3742f1c61796e4302042079b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:12.622663 65502 start.go:360] acquireMachinesLock for old-k8s-version-503971: {Name:mkc4548e5afe1d4b0a833f6c522103562b0cefff Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0501 03:30:14.808875 65502 start.go:364] duration metric: took 2.186175971s to acquireMachinesLock for "old-k8s-version-503971"
I0501 03:30:14.808968 65502 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-503971 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18779/minikube-v1.33.0-1714498396-18779-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-503971 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0501 03:30:14.809090 65502 start.go:125] createHost starting for "" (driver="kvm2")
I0501 03:30:14.811132 65502 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0501 03:30:14.811344 65502 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0501 03:30:14.811404 65502 main.go:141] libmachine: Launching plugin server for driver kvm2
I0501 03:30:14.832570 65502 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43321
I0501 03:30:14.833923 65502 main.go:141] libmachine: () Calling .GetVersion
I0501 03:30:14.834627 65502 main.go:141] libmachine: Using API Version 1
I0501 03:30:14.834658 65502 main.go:141] libmachine: () Calling .SetConfigRaw
I0501 03:30:14.835031 65502 main.go:141] libmachine: () Calling .GetMachineName
I0501 03:30:14.835191 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetMachineName
I0501 03:30:14.835288 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:14.835409 65502 start.go:159] libmachine.API.Create for "old-k8s-version-503971" (driver="kvm2")
I0501 03:30:14.835439 65502 client.go:168] LocalClient.Create starting
I0501 03:30:14.835472 65502 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca.pem
I0501 03:30:14.835510 65502 main.go:141] libmachine: Decoding PEM data...
I0501 03:30:14.835539 65502 main.go:141] libmachine: Parsing certificate...
I0501 03:30:14.835613 65502 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18779-13391/.minikube/certs/cert.pem
I0501 03:30:14.835655 65502 main.go:141] libmachine: Decoding PEM data...
I0501 03:30:14.835675 65502 main.go:141] libmachine: Parsing certificate...
I0501 03:30:14.835703 65502 main.go:141] libmachine: Running pre-create checks...
I0501 03:30:14.835716 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .PreCreateCheck
I0501 03:30:14.836137 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetConfigRaw
I0501 03:30:14.836571 65502 main.go:141] libmachine: Creating machine...
I0501 03:30:14.836590 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .Create
I0501 03:30:14.836699 65502 main.go:141] libmachine: (old-k8s-version-503971) Creating KVM machine...
I0501 03:30:14.838192 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found existing default KVM network
I0501 03:30:14.839850 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:14.839672 65721 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:d3:be:79} reservation:<nil>}
I0501 03:30:14.841237 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:14.841142 65721 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:a4:69:27} reservation:<nil>}
I0501 03:30:14.842784 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:14.842704 65721 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002891d0}
I0501 03:30:14.842892 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | created network xml:
I0501 03:30:14.842903 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | <network>
I0501 03:30:14.842911 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | <name>mk-old-k8s-version-503971</name>
I0501 03:30:14.842918 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | <dns enable='no'/>
I0501 03:30:14.842925 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG |
I0501 03:30:14.842941 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0501 03:30:14.842950 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | <dhcp>
I0501 03:30:14.842956 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0501 03:30:14.842964 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | </dhcp>
I0501 03:30:14.842969 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | </ip>
I0501 03:30:14.842976 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG |
I0501 03:30:14.842981 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | </network>
I0501 03:30:14.842987 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG |
I0501 03:30:14.849161 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | trying to create private KVM network mk-old-k8s-version-503971 192.168.61.0/24...
I0501 03:30:14.935299 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | private KVM network mk-old-k8s-version-503971 192.168.61.0/24 created
I0501 03:30:14.935382 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting up store path in /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971 ...
I0501 03:30:14.935469 65502 main.go:141] libmachine: (old-k8s-version-503971) Building disk image from file:///home/jenkins/minikube-integration/18779-13391/.minikube/cache/iso/amd64/minikube-v1.33.0-1714498396-18779-amd64.iso
I0501 03:30:14.935534 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:14.935500 65721 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18779-13391/.minikube
I0501 03:30:14.935662 65502 main.go:141] libmachine: (old-k8s-version-503971) Downloading /home/jenkins/minikube-integration/18779-13391/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18779-13391/.minikube/cache/iso/amd64/minikube-v1.33.0-1714498396-18779-amd64.iso...
I0501 03:30:15.188664 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:15.188551 65721 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa...
I0501 03:30:15.300917 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:15.300789 65721 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/old-k8s-version-503971.rawdisk...
I0501 03:30:15.300952 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Writing magic tar header
I0501 03:30:15.300972 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Writing SSH key tar header
I0501 03:30:15.301057 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:15.301007 65721 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971 ...
I0501 03:30:15.301155 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971
I0501 03:30:15.301186 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18779-13391/.minikube/machines
I0501 03:30:15.301210 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting executable bit set on /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971 (perms=drwx------)
I0501 03:30:15.301228 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting executable bit set on /home/jenkins/minikube-integration/18779-13391/.minikube/machines (perms=drwxr-xr-x)
I0501 03:30:15.301249 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting executable bit set on /home/jenkins/minikube-integration/18779-13391/.minikube (perms=drwxr-xr-x)
I0501 03:30:15.301264 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting executable bit set on /home/jenkins/minikube-integration/18779-13391 (perms=drwxrwxr-x)
I0501 03:30:15.301281 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0501 03:30:15.301295 65502 main.go:141] libmachine: (old-k8s-version-503971) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0501 03:30:15.301311 65502 main.go:141] libmachine: (old-k8s-version-503971) Creating domain...
I0501 03:30:15.301330 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18779-13391/.minikube
I0501 03:30:15.301344 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18779-13391
I0501 03:30:15.301359 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0501 03:30:15.301371 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home/jenkins
I0501 03:30:15.301395 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Checking permissions on dir: /home
I0501 03:30:15.301409 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Skipping /home - not owner
I0501 03:30:15.302639 65502 main.go:141] libmachine: (old-k8s-version-503971) define libvirt domain using xml:
I0501 03:30:15.302657 65502 main.go:141] libmachine: (old-k8s-version-503971) <domain type='kvm'>
I0501 03:30:15.302666 65502 main.go:141] libmachine: (old-k8s-version-503971) <name>old-k8s-version-503971</name>
I0501 03:30:15.302675 65502 main.go:141] libmachine: (old-k8s-version-503971) <memory unit='MiB'>2200</memory>
I0501 03:30:15.302683 65502 main.go:141] libmachine: (old-k8s-version-503971) <vcpu>2</vcpu>
I0501 03:30:15.302695 65502 main.go:141] libmachine: (old-k8s-version-503971) <features>
I0501 03:30:15.302705 65502 main.go:141] libmachine: (old-k8s-version-503971) <acpi/>
I0501 03:30:15.302712 65502 main.go:141] libmachine: (old-k8s-version-503971) <apic/>
I0501 03:30:15.302733 65502 main.go:141] libmachine: (old-k8s-version-503971) <pae/>
I0501 03:30:15.302741 65502 main.go:141] libmachine: (old-k8s-version-503971)
I0501 03:30:15.302750 65502 main.go:141] libmachine: (old-k8s-version-503971) </features>
I0501 03:30:15.302758 65502 main.go:141] libmachine: (old-k8s-version-503971) <cpu mode='host-passthrough'>
I0501 03:30:15.302766 65502 main.go:141] libmachine: (old-k8s-version-503971)
I0501 03:30:15.302773 65502 main.go:141] libmachine: (old-k8s-version-503971) </cpu>
I0501 03:30:15.302781 65502 main.go:141] libmachine: (old-k8s-version-503971) <os>
I0501 03:30:15.302788 65502 main.go:141] libmachine: (old-k8s-version-503971) <type>hvm</type>
I0501 03:30:15.302796 65502 main.go:141] libmachine: (old-k8s-version-503971) <boot dev='cdrom'/>
I0501 03:30:15.302803 65502 main.go:141] libmachine: (old-k8s-version-503971) <boot dev='hd'/>
I0501 03:30:15.302812 65502 main.go:141] libmachine: (old-k8s-version-503971) <bootmenu enable='no'/>
I0501 03:30:15.302818 65502 main.go:141] libmachine: (old-k8s-version-503971) </os>
I0501 03:30:15.302830 65502 main.go:141] libmachine: (old-k8s-version-503971) <devices>
I0501 03:30:15.302839 65502 main.go:141] libmachine: (old-k8s-version-503971) <disk type='file' device='cdrom'>
I0501 03:30:15.302853 65502 main.go:141] libmachine: (old-k8s-version-503971) <source file='/home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/boot2docker.iso'/>
I0501 03:30:15.302869 65502 main.go:141] libmachine: (old-k8s-version-503971) <target dev='hdc' bus='scsi'/>
I0501 03:30:15.302880 65502 main.go:141] libmachine: (old-k8s-version-503971) <readonly/>
I0501 03:30:15.302889 65502 main.go:141] libmachine: (old-k8s-version-503971) </disk>
I0501 03:30:15.302903 65502 main.go:141] libmachine: (old-k8s-version-503971) <disk type='file' device='disk'>
I0501 03:30:15.302913 65502 main.go:141] libmachine: (old-k8s-version-503971) <driver name='qemu' type='raw' cache='default' io='threads' />
I0501 03:30:15.302931 65502 main.go:141] libmachine: (old-k8s-version-503971) <source file='/home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/old-k8s-version-503971.rawdisk'/>
I0501 03:30:15.302950 65502 main.go:141] libmachine: (old-k8s-version-503971) <target dev='hda' bus='virtio'/>
I0501 03:30:15.302965 65502 main.go:141] libmachine: (old-k8s-version-503971) </disk>
I0501 03:30:15.302974 65502 main.go:141] libmachine: (old-k8s-version-503971) <interface type='network'>
I0501 03:30:15.302982 65502 main.go:141] libmachine: (old-k8s-version-503971) <source network='mk-old-k8s-version-503971'/>
I0501 03:30:15.302992 65502 main.go:141] libmachine: (old-k8s-version-503971) <model type='virtio'/>
I0501 03:30:15.303005 65502 main.go:141] libmachine: (old-k8s-version-503971) </interface>
I0501 03:30:15.303018 65502 main.go:141] libmachine: (old-k8s-version-503971) <interface type='network'>
I0501 03:30:15.303030 65502 main.go:141] libmachine: (old-k8s-version-503971) <source network='default'/>
I0501 03:30:15.303041 65502 main.go:141] libmachine: (old-k8s-version-503971) <model type='virtio'/>
I0501 03:30:15.303050 65502 main.go:141] libmachine: (old-k8s-version-503971) </interface>
I0501 03:30:15.303060 65502 main.go:141] libmachine: (old-k8s-version-503971) <serial type='pty'>
I0501 03:30:15.303066 65502 main.go:141] libmachine: (old-k8s-version-503971) <target port='0'/>
I0501 03:30:15.303073 65502 main.go:141] libmachine: (old-k8s-version-503971) </serial>
I0501 03:30:15.303085 65502 main.go:141] libmachine: (old-k8s-version-503971) <console type='pty'>
I0501 03:30:15.303097 65502 main.go:141] libmachine: (old-k8s-version-503971) <target type='serial' port='0'/>
I0501 03:30:15.303112 65502 main.go:141] libmachine: (old-k8s-version-503971) </console>
I0501 03:30:15.303123 65502 main.go:141] libmachine: (old-k8s-version-503971) <rng model='virtio'>
I0501 03:30:15.303136 65502 main.go:141] libmachine: (old-k8s-version-503971) <backend model='random'>/dev/random</backend>
I0501 03:30:15.303151 65502 main.go:141] libmachine: (old-k8s-version-503971) </rng>
I0501 03:30:15.303162 65502 main.go:141] libmachine: (old-k8s-version-503971)
I0501 03:30:15.303170 65502 main.go:141] libmachine: (old-k8s-version-503971)
I0501 03:30:15.303177 65502 main.go:141] libmachine: (old-k8s-version-503971) </devices>
I0501 03:30:15.303187 65502 main.go:141] libmachine: (old-k8s-version-503971) </domain>
I0501 03:30:15.303201 65502 main.go:141] libmachine: (old-k8s-version-503971)
I0501 03:30:15.308080 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:a6:40:1a in network default
I0501 03:30:15.308802 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:15.308856 65502 main.go:141] libmachine: (old-k8s-version-503971) Ensuring networks are active...
I0501 03:30:15.310268 65502 main.go:141] libmachine: (old-k8s-version-503971) Ensuring network default is active
I0501 03:30:15.311072 65502 main.go:141] libmachine: (old-k8s-version-503971) Ensuring network mk-old-k8s-version-503971 is active
I0501 03:30:15.311573 65502 main.go:141] libmachine: (old-k8s-version-503971) Getting domain xml...
I0501 03:30:15.312472 65502 main.go:141] libmachine: (old-k8s-version-503971) Creating domain...
I0501 03:30:17.277823 65502 main.go:141] libmachine: (old-k8s-version-503971) Waiting to get IP...
I0501 03:30:17.280395 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:17.281143 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:17.281171 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:17.281098 65721 retry.go:31] will retry after 267.919967ms: waiting for machine to come up
I0501 03:30:17.818484 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:17.818513 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:17.818527 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:17.807964 65721 retry.go:31] will retry after 299.613311ms: waiting for machine to come up
I0501 03:30:18.109799 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:18.115067 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:18.115097 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:18.114959 65721 retry.go:31] will retry after 335.426859ms: waiting for machine to come up
I0501 03:30:18.452457 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:18.452995 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:18.453019 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:18.452976 65721 retry.go:31] will retry after 492.882265ms: waiting for machine to come up
I0501 03:30:18.947462 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:18.948107 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:18.948141 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:18.948047 65721 retry.go:31] will retry after 554.404484ms: waiting for machine to come up
I0501 03:30:19.504659 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:19.505239 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:19.505271 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:19.505183 65721 retry.go:31] will retry after 809.507018ms: waiting for machine to come up
I0501 03:30:20.316619 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:20.317111 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:20.317141 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:20.317070 65721 retry.go:31] will retry after 1.17890373s: waiting for machine to come up
I0501 03:30:21.497732 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:21.498209 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:21.498260 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:21.498160 65721 retry.go:31] will retry after 1.305661751s: waiting for machine to come up
I0501 03:30:22.805627 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:22.806155 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:22.806187 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:22.806102 65721 retry.go:31] will retry after 1.340432437s: waiting for machine to come up
I0501 03:30:24.148432 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:24.148698 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:24.148736 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:24.148658 65721 retry.go:31] will retry after 2.165346193s: waiting for machine to come up
I0501 03:30:26.315686 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:26.316230 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:26.316265 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:26.316167 65721 retry.go:31] will retry after 2.091419447s: waiting for machine to come up
I0501 03:30:28.410637 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:28.411224 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:28.411249 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:28.411164 65721 retry.go:31] will retry after 2.966341708s: waiting for machine to come up
I0501 03:30:31.379569 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:31.379977 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:31.380010 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:31.379935 65721 retry.go:31] will retry after 2.98385883s: waiting for machine to come up
I0501 03:30:34.365139 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:34.365626 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find current IP address of domain old-k8s-version-503971 in network mk-old-k8s-version-503971
I0501 03:30:34.365672 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | I0501 03:30:34.365581 65721 retry.go:31] will retry after 3.807407638s: waiting for machine to come up
I0501 03:30:38.176696 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:38.177157 65502 main.go:141] libmachine: (old-k8s-version-503971) Found IP for machine: 192.168.61.104
I0501 03:30:38.177181 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has current primary IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:38.177187 65502 main.go:141] libmachine: (old-k8s-version-503971) Reserving static IP address...
I0501 03:30:38.177481 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-503971", mac: "52:54:00:7d:68:83", ip: "192.168.61.104"} in network mk-old-k8s-version-503971
I0501 03:30:38.251556 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Getting to WaitForSSH function...
I0501 03:30:38.251590 65502 main.go:141] libmachine: (old-k8s-version-503971) Reserved static IP address: 192.168.61.104
I0501 03:30:38.251612 65502 main.go:141] libmachine: (old-k8s-version-503971) Waiting for SSH to be available...
I0501 03:30:38.254035 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:38.254324 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971
I0501 03:30:38.254351 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | unable to find defined IP address of network mk-old-k8s-version-503971 interface with MAC address 52:54:00:7d:68:83
I0501 03:30:38.254485 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Using SSH client type: external
I0501 03:30:38.254546 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Using SSH private key: /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa (-rw-------)
I0501 03:30:38.254588 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa -p 22] /usr/bin/ssh <nil>}
I0501 03:30:38.254604 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | About to run SSH command:
I0501 03:30:38.254622 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | exit 0
I0501 03:30:38.258117 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | SSH cmd err, output: exit status 255:
I0501 03:30:38.258139 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0501 03:30:38.258146 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | command : exit 0
I0501 03:30:38.258152 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | err : exit status 255
I0501 03:30:38.258159 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | output :
I0501 03:30:41.258384 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Getting to WaitForSSH function...
I0501 03:30:41.260925 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.261296 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.261330 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.261420 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Using SSH client type: external
I0501 03:30:41.261444 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Using SSH private key: /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa (-rw-------)
I0501 03:30:41.261490 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.104 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa -p 22] /usr/bin/ssh <nil>}
I0501 03:30:41.261514 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | About to run SSH command:
I0501 03:30:41.261528 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | exit 0
I0501 03:30:41.386904 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | SSH cmd err, output: <nil>:
I0501 03:30:41.387199 65502 main.go:141] libmachine: (old-k8s-version-503971) KVM machine creation complete!
I0501 03:30:41.387503 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetConfigRaw
I0501 03:30:41.388103 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:41.388344 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:41.388512 65502 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0501 03:30:41.388529 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetState
I0501 03:30:41.389801 65502 main.go:141] libmachine: Detecting operating system of created instance...
I0501 03:30:41.389833 65502 main.go:141] libmachine: Waiting for SSH to be available...
I0501 03:30:41.389844 65502 main.go:141] libmachine: Getting to WaitForSSH function...
I0501 03:30:41.389859 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:41.392182 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.392545 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.392587 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.392746 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:41.393036 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.393232 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.393406 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:41.393565 65502 main.go:141] libmachine: Using SSH client type: native
I0501 03:30:41.393767 65502 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0501 03:30:41.393781 65502 main.go:141] libmachine: About to run SSH command:
exit 0
I0501 03:30:41.494111 65502 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0501 03:30:41.494136 65502 main.go:141] libmachine: Detecting the provisioner...
I0501 03:30:41.494146 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:41.496975 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.497297 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.497330 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.497571 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:41.497760 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.497960 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.498060 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:41.498230 65502 main.go:141] libmachine: Using SSH client type: native
I0501 03:30:41.498471 65502 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0501 03:30:41.498484 65502 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0501 03:30:41.599933 65502 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0501 03:30:41.600009 65502 main.go:141] libmachine: found compatible host: buildroot
I0501 03:30:41.600018 65502 main.go:141] libmachine: Provisioning with buildroot...
I0501 03:30:41.600026 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetMachineName
I0501 03:30:41.600282 65502 buildroot.go:166] provisioning hostname "old-k8s-version-503971"
I0501 03:30:41.600305 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetMachineName
I0501 03:30:41.600459 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:41.603164 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.603594 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.603624 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.603796 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:41.603962 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.604125 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.604272 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:41.604419 65502 main.go:141] libmachine: Using SSH client type: native
I0501 03:30:41.604639 65502 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0501 03:30:41.604658 65502 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-503971 && echo "old-k8s-version-503971" | sudo tee /etc/hostname
I0501 03:30:41.725848 65502 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-503971
I0501 03:30:41.725882 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:41.728561 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.728959 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.729003 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.729180 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:41.729382 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.729513 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:41.729604 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:41.729736 65502 main.go:141] libmachine: Using SSH client type: native
I0501 03:30:41.729907 65502 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0501 03:30:41.729924 65502 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-503971' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-503971/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-503971' | sudo tee -a /etc/hosts;
fi
fi
I0501 03:30:41.841082 65502 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0501 03:30:41.841114 65502 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18779-13391/.minikube CaCertPath:/home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18779-13391/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18779-13391/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18779-13391/.minikube}
I0501 03:30:41.841137 65502 buildroot.go:174] setting up certificates
I0501 03:30:41.841150 65502 provision.go:84] configureAuth start
I0501 03:30:41.841163 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetMachineName
I0501 03:30:41.841471 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetIP
I0501 03:30:41.844393 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.844723 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.844757 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.844942 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:41.847201 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.847511 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:41.847533 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:41.847698 65502 provision.go:143] copyHostCerts
I0501 03:30:41.847749 65502 exec_runner.go:144] found /home/jenkins/minikube-integration/18779-13391/.minikube/ca.pem, removing ...
I0501 03:30:41.847760 65502 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18779-13391/.minikube/ca.pem
I0501 03:30:41.847815 65502 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18779-13391/.minikube/ca.pem (1078 bytes)
I0501 03:30:41.847906 65502 exec_runner.go:144] found /home/jenkins/minikube-integration/18779-13391/.minikube/cert.pem, removing ...
I0501 03:30:41.847918 65502 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18779-13391/.minikube/cert.pem
I0501 03:30:41.847946 65502 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18779-13391/.minikube/cert.pem (1123 bytes)
I0501 03:30:41.848007 65502 exec_runner.go:144] found /home/jenkins/minikube-integration/18779-13391/.minikube/key.pem, removing ...
I0501 03:30:41.848014 65502 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18779-13391/.minikube/key.pem
I0501 03:30:41.848040 65502 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18779-13391/.minikube/key.pem (1675 bytes)
I0501 03:30:41.848101 65502 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18779-13391/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-503971 san=[127.0.0.1 192.168.61.104 localhost minikube old-k8s-version-503971]
I0501 03:30:42.129743 65502 provision.go:177] copyRemoteCerts
I0501 03:30:42.129807 65502 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0501 03:30:42.129834 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:42.132552 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.132883 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.132912 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.133134 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:42.133384 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.133585 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:42.133723 65502 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa Username:docker}
I0501 03:30:42.219090 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0501 03:30:42.247347 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0501 03:30:42.275755 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0501 03:30:42.305243 65502 provision.go:87] duration metric: took 464.078319ms to configureAuth
I0501 03:30:42.305275 65502 buildroot.go:189] setting minikube options for container-runtime
I0501 03:30:42.305461 65502 config.go:182] Loaded profile config "old-k8s-version-503971": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0501 03:30:42.305560 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:42.308502 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.308899 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.308926 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.309137 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:42.309338 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.309522 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.309669 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:42.309839 65502 main.go:141] libmachine: Using SSH client type: native
I0501 03:30:42.309998 65502 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0501 03:30:42.310016 65502 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0501 03:30:42.617007 65502 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0501 03:30:42.617043 65502 main.go:141] libmachine: Checking connection to Docker...
I0501 03:30:42.617070 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetURL
I0501 03:30:42.618412 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | Using libvirt version 6000000
I0501 03:30:42.620667 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.621024 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.621047 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.621237 65502 main.go:141] libmachine: Docker is up and running!
I0501 03:30:42.621253 65502 main.go:141] libmachine: Reticulating splines...
I0501 03:30:42.621265 65502 client.go:171] duration metric: took 27.78581521s to LocalClient.Create
I0501 03:30:42.621301 65502 start.go:167] duration metric: took 27.785892327s to libmachine.API.Create "old-k8s-version-503971"
I0501 03:30:42.621316 65502 start.go:293] postStartSetup for "old-k8s-version-503971" (driver="kvm2")
I0501 03:30:42.621335 65502 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0501 03:30:42.621360 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:42.621643 65502 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0501 03:30:42.621672 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:42.624286 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.624696 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.624726 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.624958 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:42.625164 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.625376 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:42.625547 65502 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa Username:docker}
I0501 03:30:42.713761 65502 ssh_runner.go:195] Run: cat /etc/os-release
I0501 03:30:42.719682 65502 info.go:137] Remote host: Buildroot 2023.02.9
I0501 03:30:42.719708 65502 filesync.go:126] Scanning /home/jenkins/minikube-integration/18779-13391/.minikube/addons for local assets ...
I0501 03:30:42.719769 65502 filesync.go:126] Scanning /home/jenkins/minikube-integration/18779-13391/.minikube/files for local assets ...
I0501 03:30:42.719857 65502 filesync.go:149] local asset: /home/jenkins/minikube-integration/18779-13391/.minikube/files/etc/ssl/certs/207242.pem -> 207242.pem in /etc/ssl/certs
I0501 03:30:42.719975 65502 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0501 03:30:42.732076 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/files/etc/ssl/certs/207242.pem --> /etc/ssl/certs/207242.pem (1708 bytes)
I0501 03:30:42.763447 65502 start.go:296] duration metric: took 142.112552ms for postStartSetup
I0501 03:30:42.763511 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetConfigRaw
I0501 03:30:42.764263 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetIP
I0501 03:30:42.767182 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.767626 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.767657 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.767988 65502 profile.go:143] Saving config to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/config.json ...
I0501 03:30:42.768204 65502 start.go:128] duration metric: took 27.959102304s to createHost
I0501 03:30:42.768232 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:42.770545 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.770891 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.770916 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.771041 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:42.771236 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.771386 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.771545 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:42.771697 65502 main.go:141] libmachine: Using SSH client type: native
I0501 03:30:42.771926 65502 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0501 03:30:42.771941 65502 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0501 03:30:42.871965 65502 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714534242.856037398
I0501 03:30:42.871993 65502 fix.go:216] guest clock: 1714534242.856037398
I0501 03:30:42.872005 65502 fix.go:229] Guest: 2024-05-01 03:30:42.856037398 +0000 UTC Remote: 2024-05-01 03:30:42.768218477 +0000 UTC m=+30.278133484 (delta=87.818921ms)
I0501 03:30:42.872062 65502 fix.go:200] guest clock delta is within tolerance: 87.818921ms
I0501 03:30:42.872074 65502 start.go:83] releasing machines lock for "old-k8s-version-503971", held for 28.063153275s
I0501 03:30:42.872110 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:42.872435 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetIP
I0501 03:30:42.875419 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.875757 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.875782 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.875975 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:42.876502 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:42.876671 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .DriverName
I0501 03:30:42.876773 65502 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0501 03:30:42.876819 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:42.876933 65502 ssh_runner.go:195] Run: cat /version.json
I0501 03:30:42.876956 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHHostname
I0501 03:30:42.879479 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.879734 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.879882 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.879905 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.880002 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:42.880120 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:42.880146 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:42.880156 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.880333 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:42.880346 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHPort
I0501 03:30:42.880504 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHKeyPath
I0501 03:30:42.880513 65502 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa Username:docker}
I0501 03:30:42.880638 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetSSHUsername
I0501 03:30:42.880771 65502 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18779-13391/.minikube/machines/old-k8s-version-503971/id_rsa Username:docker}
I0501 03:30:42.961011 65502 ssh_runner.go:195] Run: systemctl --version
I0501 03:30:42.988631 65502 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0501 03:30:43.163111 65502 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0501 03:30:43.170959 65502 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0501 03:30:43.171037 65502 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0501 03:30:43.198233 65502 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0501 03:30:43.198261 65502 start.go:494] detecting cgroup driver to use...
I0501 03:30:43.198333 65502 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0501 03:30:43.217035 65502 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0501 03:30:43.232313 65502 docker.go:217] disabling cri-docker service (if available) ...
I0501 03:30:43.232400 65502 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0501 03:30:43.251010 65502 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0501 03:30:43.267584 65502 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0501 03:30:43.408987 65502 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0501 03:30:43.581459 65502 docker.go:233] disabling docker service ...
I0501 03:30:43.581529 65502 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0501 03:30:43.599496 65502 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0501 03:30:43.614428 65502 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0501 03:30:43.765839 65502 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0501 03:30:43.903703 65502 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0501 03:30:43.922440 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0501 03:30:43.948364 65502 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0501 03:30:43.948428 65502 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0501 03:30:43.960971 65502 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0501 03:30:43.961039 65502 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0501 03:30:43.972949 65502 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0501 03:30:43.985013 65502 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0501 03:30:43.996978 65502 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0501 03:30:44.009121 65502 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0501 03:30:44.019692 65502 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0501 03:30:44.019749 65502 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0501 03:30:44.035122 65502 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0501 03:30:44.049560 65502 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0501 03:30:44.178215 65502 ssh_runner.go:195] Run: sudo systemctl restart crio
I0501 03:30:44.369046 65502 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0501 03:30:44.369133 65502 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0501 03:30:44.375374 65502 start.go:562] Will wait 60s for crictl version
I0501 03:30:44.375449 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:44.380830 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0501 03:30:44.422063 65502 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0501 03:30:44.422157 65502 ssh_runner.go:195] Run: crio --version
I0501 03:30:44.460265 65502 ssh_runner.go:195] Run: crio --version
I0501 03:30:44.501809 65502 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0501 03:30:44.502920 65502 main.go:141] libmachine: (old-k8s-version-503971) Calling .GetIP
I0501 03:30:44.506073 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:44.506516 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7d:68:83", ip: ""} in network mk-old-k8s-version-503971: {Iface:virbr4 ExpiryTime:2024-05-01 04:30:32 +0000 UTC Type:0 Mac:52:54:00:7d:68:83 Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:old-k8s-version-503971 Clientid:01:52:54:00:7d:68:83}
I0501 03:30:44.506545 65502 main.go:141] libmachine: (old-k8s-version-503971) DBG | domain old-k8s-version-503971 has defined IP address 192.168.61.104 and MAC address 52:54:00:7d:68:83 in network mk-old-k8s-version-503971
I0501 03:30:44.506772 65502 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0501 03:30:44.511654 65502 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0501 03:30:44.527001 65502 kubeadm.go:877] updating cluster {Name:old-k8s-version-503971 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18779/minikube-v1.33.0-1714498396-18779-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-503971 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.104 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0501 03:30:44.527145 65502 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0501 03:30:44.527210 65502 ssh_runner.go:195] Run: sudo crictl images --output json
I0501 03:30:44.576772 65502 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0501 03:30:44.576863 65502 ssh_runner.go:195] Run: which lz4
I0501 03:30:44.582006 65502 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0501 03:30:44.587493 65502 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0501 03:30:44.587530 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0501 03:30:46.840075 65502 crio.go:462] duration metric: took 2.258108991s to copy over tarball
I0501 03:30:46.840154 65502 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0501 03:30:49.842324 65502 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.002139829s)
I0501 03:30:49.842356 65502 crio.go:469] duration metric: took 3.002253578s to extract the tarball
I0501 03:30:49.842366 65502 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0501 03:30:49.890494 65502 ssh_runner.go:195] Run: sudo crictl images --output json
I0501 03:30:49.952833 65502 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0501 03:30:49.952865 65502 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0501 03:30:49.952939 65502 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0501 03:30:49.952973 65502 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0501 03:30:49.952998 65502 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0501 03:30:49.953002 65502 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0501 03:30:49.952978 65502 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0501 03:30:49.952971 65502 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0501 03:30:49.953044 65502 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0501 03:30:49.953095 65502 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0501 03:30:49.954439 65502 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0501 03:30:49.954542 65502 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0501 03:30:49.954562 65502 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0501 03:30:49.954604 65502 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0501 03:30:49.954623 65502 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0501 03:30:49.954709 65502 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0501 03:30:49.954722 65502 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0501 03:30:49.954782 65502 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0501 03:30:50.072986 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0501 03:30:50.118614 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0501 03:30:50.125554 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0501 03:30:50.125751 65502 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0501 03:30:50.125797 65502 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0501 03:30:50.125838 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.176894 65502 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0501 03:30:50.176949 65502 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0501 03:30:50.177007 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.182111 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0501 03:30:50.193301 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0501 03:30:50.193341 65502 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0501 03:30:50.193349 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0501 03:30:50.193377 65502 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0501 03:30:50.193415 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.244120 65502 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0501 03:30:50.244175 65502 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0501 03:30:50.244229 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.272477 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0501 03:30:50.272531 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0501 03:30:50.272597 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0501 03:30:50.272597 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0501 03:30:50.321368 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0501 03:30:50.328355 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0501 03:30:50.328444 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0501 03:30:50.331393 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0501 03:30:50.377703 65502 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0501 03:30:50.377748 65502 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0501 03:30:50.377799 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.384874 65502 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0501 03:30:50.384928 65502 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0501 03:30:50.384999 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.385027 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0501 03:30:50.400233 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0501 03:30:50.431071 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0501 03:30:50.431140 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0501 03:30:50.468327 65502 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0501 03:30:50.468374 65502 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0501 03:30:50.468423 65502 ssh_runner.go:195] Run: which crictl
I0501 03:30:50.483635 65502 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0501 03:30:50.483884 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0501 03:30:50.523093 65502 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0501 03:30:50.883241 65502 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0501 03:30:51.038440 65502 cache_images.go:92] duration metric: took 1.085549933s to LoadCachedImages
W0501 03:30:51.038528 65502 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18779-13391/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0501 03:30:51.038551 65502 kubeadm.go:928] updating node { 192.168.61.104 8443 v1.20.0 crio true true} ...
I0501 03:30:51.038735 65502 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-503971 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.104
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-503971 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0501 03:30:51.038844 65502 ssh_runner.go:195] Run: crio config
I0501 03:30:51.094689 65502 cni.go:84] Creating CNI manager for ""
I0501 03:30:51.094721 65502 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0501 03:30:51.094740 65502 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0501 03:30:51.094766 65502 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.104 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-503971 NodeName:old-k8s-version-503971 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.104"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.104 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0501 03:30:51.094961 65502 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.104
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-503971"
kubeletExtraArgs:
node-ip: 192.168.61.104
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.104"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0501 03:30:51.095038 65502 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0501 03:30:51.107613 65502 binaries.go:44] Found k8s binaries, skipping transfer
I0501 03:30:51.107689 65502 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0501 03:30:51.119057 65502 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0501 03:30:51.139902 65502 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0501 03:30:51.160697 65502 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0501 03:30:51.181308 65502 ssh_runner.go:195] Run: grep 192.168.61.104 control-plane.minikube.internal$ /etc/hosts
I0501 03:30:51.186095 65502 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.104 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0501 03:30:51.200407 65502 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0501 03:30:51.341718 65502 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0501 03:30:51.361824 65502 certs.go:68] Setting up /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971 for IP: 192.168.61.104
I0501 03:30:51.361849 65502 certs.go:194] generating shared ca certs ...
I0501 03:30:51.361886 65502 certs.go:226] acquiring lock for ca certs: {Name:mk85a75d14c00780d4bf09cd9bdaf0f96f1b8fce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.362071 65502 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18779-13391/.minikube/ca.key
I0501 03:30:51.362139 65502 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18779-13391/.minikube/proxy-client-ca.key
I0501 03:30:51.362154 65502 certs.go:256] generating profile certs ...
I0501 03:30:51.362224 65502 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/client.key
I0501 03:30:51.362241 65502 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/client.crt with IP's: []
I0501 03:30:51.545067 65502 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/client.crt ...
I0501 03:30:51.545100 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/client.crt: {Name:mkb291995c78a70d2aa99b3de57a89e0b204a34e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.545321 65502 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/client.key ...
I0501 03:30:51.545341 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/client.key: {Name:mkbd7ea061c299f0c055a413768768a5fe4e6594 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.545470 65502 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.key.760b883a
I0501 03:30:51.545493 65502 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.crt.760b883a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.104]
I0501 03:30:51.858137 65502 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.crt.760b883a ...
I0501 03:30:51.858174 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.crt.760b883a: {Name:mk43b28d265a30fadff81730d277d5e9a53ed81b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.858338 65502 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.key.760b883a ...
I0501 03:30:51.858354 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.key.760b883a: {Name:mk6abbd75de4d0204a5ddb349b7dd731c6dad335 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.858453 65502 certs.go:381] copying /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.crt.760b883a -> /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.crt
I0501 03:30:51.858556 65502 certs.go:385] copying /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.key.760b883a -> /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.key
I0501 03:30:51.858613 65502 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.key
I0501 03:30:51.858629 65502 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.crt with IP's: []
I0501 03:30:51.926667 65502 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.crt ...
I0501 03:30:51.926698 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.crt: {Name:mk06c320401a2419a3c417ef2b2bfd213f5e04ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.951290 65502 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.key ...
I0501 03:30:51.951325 65502 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.key: {Name:mk8232ae44275fffebff8fcc51b89dbe91275d3d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0501 03:30:51.951553 65502 certs.go:484] found cert: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/20724.pem (1338 bytes)
W0501 03:30:51.951624 65502 certs.go:480] ignoring /home/jenkins/minikube-integration/18779-13391/.minikube/certs/20724_empty.pem, impossibly tiny 0 bytes
I0501 03:30:51.951636 65502 certs.go:484] found cert: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca-key.pem (1679 bytes)
I0501 03:30:51.951668 65502 certs.go:484] found cert: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/ca.pem (1078 bytes)
I0501 03:30:51.951700 65502 certs.go:484] found cert: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/cert.pem (1123 bytes)
I0501 03:30:51.951735 65502 certs.go:484] found cert: /home/jenkins/minikube-integration/18779-13391/.minikube/certs/key.pem (1675 bytes)
I0501 03:30:51.951809 65502 certs.go:484] found cert: /home/jenkins/minikube-integration/18779-13391/.minikube/files/etc/ssl/certs/207242.pem (1708 bytes)
I0501 03:30:51.952467 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0501 03:30:51.986170 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0501 03:30:52.013909 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0501 03:30:52.046333 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0501 03:30:52.076235 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0501 03:30:52.109294 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0501 03:30:52.140100 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0501 03:30:52.172091 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/profiles/old-k8s-version-503971/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0501 03:30:52.206615 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0501 03:30:52.247633 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/certs/20724.pem --> /usr/share/ca-certificates/20724.pem (1338 bytes)
I0501 03:30:52.293157 65502 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18779-13391/.minikube/files/etc/ssl/certs/207242.pem --> /usr/share/ca-certificates/207242.pem (1708 bytes)
I0501 03:30:52.325589 65502 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0501 03:30:52.344575 65502 ssh_runner.go:195] Run: openssl version
I0501 03:30:52.351318 65502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207242.pem && ln -fs /usr/share/ca-certificates/207242.pem /etc/ssl/certs/207242.pem"
I0501 03:30:52.363721 65502 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207242.pem
I0501 03:30:52.369508 65502 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 1 02:20 /usr/share/ca-certificates/207242.pem
I0501 03:30:52.369580 65502 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207242.pem
I0501 03:30:52.376486 65502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207242.pem /etc/ssl/certs/3ec20f2e.0"
I0501 03:30:52.389675 65502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0501 03:30:52.402595 65502 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0501 03:30:52.408132 65502 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 1 02:08 /usr/share/ca-certificates/minikubeCA.pem
I0501 03:30:52.408192 65502 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0501 03:30:52.415072 65502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0501 03:30:52.427777 65502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20724.pem && ln -fs /usr/share/ca-certificates/20724.pem /etc/ssl/certs/20724.pem"
I0501 03:30:52.440074 65502 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20724.pem
I0501 03:30:52.445322 65502 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 1 02:20 /usr/share/ca-certificates/20724.pem
I0501 03:30:52.445383 65502 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20724.pem
I0501 03:30:52.451972 65502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20724.pem /etc/ssl/certs/51391683.0"
I0501 03:30:52.464182 65502 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0501 03:30:52.468944 65502 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0501 03:30:52.469006 65502 kubeadm.go:391] StartCluster: {Name:old-k8s-version-503971 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18779/minikube-v1.33.0-1714498396-18779-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-503971 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.104 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0501 03:30:52.469144 65502 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0501 03:30:52.469185 65502 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0501 03:30:52.507958 65502 cri.go:89] found id: ""
I0501 03:30:52.508028 65502 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0501 03:30:52.519327 65502 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0501 03:30:52.530245 65502 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0501 03:30:52.541053 65502 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0501 03:30:52.541073 65502 kubeadm.go:156] found existing configuration files:
I0501 03:30:52.541122 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0501 03:30:52.551167 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0501 03:30:52.551227 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0501 03:30:52.561184 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0501 03:30:52.571255 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0501 03:30:52.571308 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0501 03:30:52.581638 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0501 03:30:52.591465 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0501 03:30:52.591560 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0501 03:30:52.601628 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0501 03:30:52.612311 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0501 03:30:52.612381 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0501 03:30:52.624432 65502 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0501 03:30:52.751406 65502 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0501 03:30:52.751534 65502 kubeadm.go:309] [preflight] Running pre-flight checks
I0501 03:30:52.936474 65502 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0501 03:30:52.936623 65502 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0501 03:30:52.936772 65502 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0501 03:30:53.175705 65502 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0501 03:30:53.177702 65502 out.go:204] - Generating certificates and keys ...
I0501 03:30:53.177814 65502 kubeadm.go:309] [certs] Using existing ca certificate authority
I0501 03:30:53.177917 65502 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0501 03:30:53.284246 65502 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0501 03:30:53.744671 65502 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0501 03:30:53.912918 65502 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0501 03:30:54.082836 65502 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0501 03:30:54.217925 65502 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0501 03:30:54.218391 65502 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-503971] and IPs [192.168.61.104 127.0.0.1 ::1]
I0501 03:30:54.462226 65502 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0501 03:30:54.462608 65502 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-503971] and IPs [192.168.61.104 127.0.0.1 ::1]
I0501 03:30:54.776205 65502 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0501 03:30:54.908978 65502 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0501 03:30:55.044122 65502 kubeadm.go:309] [certs] Generating "sa" key and public key
I0501 03:30:55.044449 65502 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0501 03:30:55.210328 65502 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0501 03:30:55.452313 65502 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0501 03:30:55.640378 65502 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0501 03:30:55.759466 65502 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0501 03:30:55.785297 65502 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0501 03:30:55.787319 65502 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0501 03:30:55.787397 65502 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0501 03:30:55.936196 65502 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0501 03:30:55.939274 65502 out.go:204] - Booting up control plane ...
I0501 03:30:55.939411 65502 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0501 03:30:55.944024 65502 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0501 03:30:55.945218 65502 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0501 03:30:55.946149 65502 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0501 03:30:55.951042 65502 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0501 03:31:35.949222 65502 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0501 03:31:35.949620 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:31:35.949913 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:31:40.950624 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:31:40.950904 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:31:50.951688 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:31:50.951865 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:32:10.953613 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:32:10.953839 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:32:50.953758 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:32:50.954046 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:32:50.954075 65502 kubeadm.go:309]
I0501 03:32:50.954123 65502 kubeadm.go:309] Unfortunately, an error has occurred:
I0501 03:32:50.954178 65502 kubeadm.go:309] timed out waiting for the condition
I0501 03:32:50.954188 65502 kubeadm.go:309]
I0501 03:32:50.954272 65502 kubeadm.go:309] This error is likely caused by:
I0501 03:32:50.954345 65502 kubeadm.go:309] - The kubelet is not running
I0501 03:32:50.954507 65502 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0501 03:32:50.954524 65502 kubeadm.go:309]
I0501 03:32:50.954672 65502 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0501 03:32:50.954720 65502 kubeadm.go:309] - 'systemctl status kubelet'
I0501 03:32:50.954757 65502 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0501 03:32:50.954781 65502 kubeadm.go:309]
I0501 03:32:50.954917 65502 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0501 03:32:50.955035 65502 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0501 03:32:50.955057 65502 kubeadm.go:309]
I0501 03:32:50.955182 65502 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0501 03:32:50.955301 65502 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0501 03:32:50.955414 65502 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0501 03:32:50.955548 65502 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0501 03:32:50.955570 65502 kubeadm.go:309]
I0501 03:32:50.956358 65502 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0501 03:32:50.956483 65502 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0501 03:32:50.956579 65502 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0501 03:32:50.956845 65502 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-503971] and IPs [192.168.61.104 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-503971] and IPs [192.168.61.104 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-503971] and IPs [192.168.61.104 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-503971] and IPs [192.168.61.104 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0501 03:32:50.956908 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0501 03:32:53.526270 65502 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.569327036s)
I0501 03:32:53.526348 65502 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0501 03:32:53.547866 65502 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0501 03:32:53.561519 65502 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0501 03:32:53.561543 65502 kubeadm.go:156] found existing configuration files:
I0501 03:32:53.561596 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0501 03:32:53.575559 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0501 03:32:53.575636 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0501 03:32:53.589689 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0501 03:32:53.600864 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0501 03:32:53.600931 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0501 03:32:53.612113 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0501 03:32:53.622529 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0501 03:32:53.622585 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0501 03:32:53.632969 65502 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0501 03:32:53.643278 65502 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0501 03:32:53.643345 65502 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0501 03:32:53.653978 65502 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0501 03:32:53.912331 65502 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0501 03:34:49.970818 65502 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0501 03:34:49.970928 65502 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0501 03:34:49.972856 65502 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0501 03:34:49.972927 65502 kubeadm.go:309] [preflight] Running pre-flight checks
I0501 03:34:49.973023 65502 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0501 03:34:49.973188 65502 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0501 03:34:49.973300 65502 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0501 03:34:49.973396 65502 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0501 03:34:49.975105 65502 out.go:204] - Generating certificates and keys ...
I0501 03:34:49.975201 65502 kubeadm.go:309] [certs] Using existing ca certificate authority
I0501 03:34:49.975257 65502 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0501 03:34:49.975337 65502 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0501 03:34:49.975396 65502 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0501 03:34:49.975458 65502 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0501 03:34:49.975503 65502 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0501 03:34:49.975577 65502 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0501 03:34:49.975651 65502 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0501 03:34:49.975734 65502 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0501 03:34:49.975850 65502 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0501 03:34:49.975908 65502 kubeadm.go:309] [certs] Using the existing "sa" key
I0501 03:34:49.975997 65502 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0501 03:34:49.976064 65502 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0501 03:34:49.976143 65502 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0501 03:34:49.976208 65502 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0501 03:34:49.976254 65502 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0501 03:34:49.976338 65502 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0501 03:34:49.976408 65502 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0501 03:34:49.976442 65502 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0501 03:34:49.976554 65502 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0501 03:34:49.977969 65502 out.go:204] - Booting up control plane ...
I0501 03:34:49.978062 65502 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0501 03:34:49.978166 65502 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0501 03:34:49.978253 65502 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0501 03:34:49.978370 65502 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0501 03:34:49.978614 65502 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0501 03:34:49.978691 65502 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0501 03:34:49.978760 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:34:49.978925 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:34:49.979001 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:34:49.979246 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:34:49.979341 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:34:49.979518 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:34:49.979593 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:34:49.979777 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:34:49.979876 65502 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0501 03:34:49.980068 65502 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0501 03:34:49.980076 65502 kubeadm.go:309]
I0501 03:34:49.980123 65502 kubeadm.go:309] Unfortunately, an error has occurred:
I0501 03:34:49.980175 65502 kubeadm.go:309] timed out waiting for the condition
I0501 03:34:49.980185 65502 kubeadm.go:309]
I0501 03:34:49.980233 65502 kubeadm.go:309] This error is likely caused by:
I0501 03:34:49.980274 65502 kubeadm.go:309] - The kubelet is not running
I0501 03:34:49.980425 65502 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0501 03:34:49.980441 65502 kubeadm.go:309]
I0501 03:34:49.980568 65502 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0501 03:34:49.980598 65502 kubeadm.go:309] - 'systemctl status kubelet'
I0501 03:34:49.980630 65502 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0501 03:34:49.980640 65502 kubeadm.go:309]
I0501 03:34:49.980739 65502 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0501 03:34:49.980807 65502 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0501 03:34:49.980814 65502 kubeadm.go:309]
I0501 03:34:49.980901 65502 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0501 03:34:49.980977 65502 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0501 03:34:49.981079 65502 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0501 03:34:49.981183 65502 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0501 03:34:49.981250 65502 kubeadm.go:393] duration metric: took 3m57.512247503s to StartCluster
I0501 03:34:49.981262 65502 kubeadm.go:309]
I0501 03:34:49.981294 65502 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0501 03:34:49.981358 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0501 03:34:50.029233 65502 cri.go:89] found id: ""
I0501 03:34:50.029258 65502 logs.go:276] 0 containers: []
W0501 03:34:50.029266 65502 logs.go:278] No container was found matching "kube-apiserver"
I0501 03:34:50.029271 65502 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0501 03:34:50.029318 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0501 03:34:50.070933 65502 cri.go:89] found id: ""
I0501 03:34:50.070959 65502 logs.go:276] 0 containers: []
W0501 03:34:50.070966 65502 logs.go:278] No container was found matching "etcd"
I0501 03:34:50.070972 65502 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0501 03:34:50.071037 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0501 03:34:50.119064 65502 cri.go:89] found id: ""
I0501 03:34:50.119096 65502 logs.go:276] 0 containers: []
W0501 03:34:50.119108 65502 logs.go:278] No container was found matching "coredns"
I0501 03:34:50.119114 65502 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0501 03:34:50.119175 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0501 03:34:50.167167 65502 cri.go:89] found id: ""
I0501 03:34:50.167195 65502 logs.go:276] 0 containers: []
W0501 03:34:50.167203 65502 logs.go:278] No container was found matching "kube-scheduler"
I0501 03:34:50.167218 65502 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0501 03:34:50.167287 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0501 03:34:50.216757 65502 cri.go:89] found id: ""
I0501 03:34:50.216788 65502 logs.go:276] 0 containers: []
W0501 03:34:50.216800 65502 logs.go:278] No container was found matching "kube-proxy"
I0501 03:34:50.216807 65502 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0501 03:34:50.216874 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0501 03:34:50.261048 65502 cri.go:89] found id: ""
I0501 03:34:50.261080 65502 logs.go:276] 0 containers: []
W0501 03:34:50.261092 65502 logs.go:278] No container was found matching "kube-controller-manager"
I0501 03:34:50.261101 65502 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0501 03:34:50.261164 65502 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0501 03:34:50.304428 65502 cri.go:89] found id: ""
I0501 03:34:50.304457 65502 logs.go:276] 0 containers: []
W0501 03:34:50.304477 65502 logs.go:278] No container was found matching "kindnet"
I0501 03:34:50.304490 65502 logs.go:123] Gathering logs for kubelet ...
I0501 03:34:50.304505 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0501 03:34:50.361129 65502 logs.go:123] Gathering logs for dmesg ...
I0501 03:34:50.361185 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0501 03:34:50.390982 65502 logs.go:123] Gathering logs for describe nodes ...
I0501 03:34:50.391021 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0501 03:34:50.577939 65502 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0501 03:34:50.577973 65502 logs.go:123] Gathering logs for CRI-O ...
I0501 03:34:50.577990 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0501 03:34:50.678066 65502 logs.go:123] Gathering logs for container status ...
I0501 03:34:50.678101 65502 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0501 03:34:50.724754 65502 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0501 03:34:50.724800 65502 out.go:239] *
*
W0501 03:34:50.724854 65502 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0501 03:34:50.724886 65502 out.go:239] *
*
W0501 03:34:50.725733 65502 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0501 03:34:50.730217 65502 out.go:177]
W0501 03:34:50.731435 65502 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0501 03:34:50.731499 65502 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0501 03:34:50.731527 65502 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0501 03:34:50.732915 65502 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-503971 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-503971 -n old-k8s-version-503971
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-503971 -n old-k8s-version-503971: exit status 6 (264.096311ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0501 03:34:51.045520 68719 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-503971" does not appear in /home/jenkins/minikube-integration/18779-13391/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-503971" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (278.58s)