=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-933974 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-933974 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m11.30778623s)
-- stdout --
* [old-k8s-version-933974] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20107
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20107-210204/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20107-210204/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-933974" primary control-plane node in "old-k8s-version-933974" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1216 11:47:37.825024 269561 out.go:345] Setting OutFile to fd 1 ...
I1216 11:47:37.825176 269561 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1216 11:47:37.825186 269561 out.go:358] Setting ErrFile to fd 2...
I1216 11:47:37.825191 269561 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1216 11:47:37.825396 269561 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20107-210204/.minikube/bin
I1216 11:47:37.826075 269561 out.go:352] Setting JSON to false
I1216 11:47:37.827220 269561 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":12605,"bootTime":1734337053,"procs":300,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1216 11:47:37.827328 269561 start.go:139] virtualization: kvm guest
I1216 11:47:37.829287 269561 out.go:177] * [old-k8s-version-933974] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I1216 11:47:37.830683 269561 out.go:177] - MINIKUBE_LOCATION=20107
I1216 11:47:37.830738 269561 notify.go:220] Checking for updates...
I1216 11:47:37.832934 269561 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1216 11:47:37.834070 269561 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20107-210204/kubeconfig
I1216 11:47:37.835212 269561 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20107-210204/.minikube
I1216 11:47:37.836246 269561 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1216 11:47:37.837358 269561 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1216 11:47:37.838978 269561 config.go:182] Loaded profile config "bridge-560939": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2
I1216 11:47:37.839067 269561 config.go:182] Loaded profile config "flannel-560939": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2
I1216 11:47:37.839139 269561 config.go:182] Loaded profile config "kubernetes-upgrade-854528": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2
I1216 11:47:37.839225 269561 driver.go:394] Setting default libvirt URI to qemu:///system
I1216 11:47:37.875978 269561 out.go:177] * Using the kvm2 driver based on user configuration
I1216 11:47:37.877114 269561 start.go:297] selected driver: kvm2
I1216 11:47:37.877130 269561 start.go:901] validating driver "kvm2" against <nil>
I1216 11:47:37.877142 269561 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1216 11:47:37.877979 269561 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1216 11:47:37.878086 269561 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20107-210204/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1216 11:47:37.894314 269561 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I1216 11:47:37.894381 269561 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1216 11:47:37.894650 269561 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1216 11:47:37.894685 269561 cni.go:84] Creating CNI manager for ""
I1216 11:47:37.894728 269561 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1216 11:47:37.894737 269561 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1216 11:47:37.894807 269561 start.go:340] cluster config:
{Name:old-k8s-version-933974 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-933974 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1216 11:47:37.894904 269561 iso.go:125] acquiring lock: {Name:mk183fa0ccac365696b97d53fc41bbe189a71824 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1216 11:47:37.896669 269561 out.go:177] * Starting "old-k8s-version-933974" primary control-plane node in "old-k8s-version-933974" cluster
I1216 11:47:37.897825 269561 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1216 11:47:37.897861 269561 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I1216 11:47:37.897868 269561 cache.go:56] Caching tarball of preloaded images
I1216 11:47:37.897945 269561 preload.go:172] Found /home/jenkins/minikube-integration/20107-210204/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1216 11:47:37.897957 269561 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I1216 11:47:37.898052 269561 profile.go:143] Saving config to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/config.json ...
I1216 11:47:37.898070 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/config.json: {Name:mkfe4215b798120ec67203e9963a4936f9ecd548 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:47:37.898191 269561 start.go:360] acquireMachinesLock for old-k8s-version-933974: {Name:mk416695f38f04563a2ca155c5383ee4d8f0f97b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1216 11:48:18.953688 269561 start.go:364] duration metric: took 41.055453726s to acquireMachinesLock for "old-k8s-version-933974"
I1216 11:48:18.953766 269561 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-933974 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20083/minikube-v1.34.0-1733936888-20083-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-933974 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1216 11:48:18.953866 269561 start.go:125] createHost starting for "" (driver="kvm2")
I1216 11:48:18.955940 269561 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1216 11:48:18.956153 269561 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1216 11:48:18.956214 269561 main.go:141] libmachine: Launching plugin server for driver kvm2
I1216 11:48:18.976480 269561 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42487
I1216 11:48:18.977031 269561 main.go:141] libmachine: () Calling .GetVersion
I1216 11:48:18.977679 269561 main.go:141] libmachine: Using API Version 1
I1216 11:48:18.977706 269561 main.go:141] libmachine: () Calling .SetConfigRaw
I1216 11:48:18.978140 269561 main.go:141] libmachine: () Calling .GetMachineName
I1216 11:48:18.978395 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetMachineName
I1216 11:48:18.978603 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:18.978799 269561 start.go:159] libmachine.API.Create for "old-k8s-version-933974" (driver="kvm2")
I1216 11:48:18.978831 269561 client.go:168] LocalClient.Create starting
I1216 11:48:18.978868 269561 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca.pem
I1216 11:48:18.978909 269561 main.go:141] libmachine: Decoding PEM data...
I1216 11:48:18.978929 269561 main.go:141] libmachine: Parsing certificate...
I1216 11:48:18.979012 269561 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20107-210204/.minikube/certs/cert.pem
I1216 11:48:18.979046 269561 main.go:141] libmachine: Decoding PEM data...
I1216 11:48:18.979061 269561 main.go:141] libmachine: Parsing certificate...
I1216 11:48:18.979089 269561 main.go:141] libmachine: Running pre-create checks...
I1216 11:48:18.979103 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .PreCreateCheck
I1216 11:48:18.979583 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetConfigRaw
I1216 11:48:18.980081 269561 main.go:141] libmachine: Creating machine...
I1216 11:48:18.980102 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .Create
I1216 11:48:18.980257 269561 main.go:141] libmachine: (old-k8s-version-933974) creating KVM machine...
I1216 11:48:18.980279 269561 main.go:141] libmachine: (old-k8s-version-933974) creating network...
I1216 11:48:18.981563 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found existing default KVM network
I1216 11:48:18.982812 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:18.982640 270159 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:57:0c:7d} reservation:<nil>}
I1216 11:48:18.983672 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:18.983583 270159 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:21:e6:80} reservation:<nil>}
I1216 11:48:18.984603 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:18.984507 270159 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000301070}
I1216 11:48:18.984624 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | created network xml:
I1216 11:48:18.984640 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | <network>
I1216 11:48:18.984657 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | <name>mk-old-k8s-version-933974</name>
I1216 11:48:18.984688 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | <dns enable='no'/>
I1216 11:48:18.984711 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG |
I1216 11:48:18.984725 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I1216 11:48:18.984754 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | <dhcp>
I1216 11:48:18.984770 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I1216 11:48:18.984784 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | </dhcp>
I1216 11:48:18.984797 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | </ip>
I1216 11:48:18.984808 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG |
I1216 11:48:18.984818 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | </network>
I1216 11:48:18.984828 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG |
I1216 11:48:18.989921 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | trying to create private KVM network mk-old-k8s-version-933974 192.168.61.0/24...
I1216 11:48:19.068601 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | private KVM network mk-old-k8s-version-933974 192.168.61.0/24 created
I1216 11:48:19.068648 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:19.068557 270159 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20107-210204/.minikube
I1216 11:48:19.068667 269561 main.go:141] libmachine: (old-k8s-version-933974) setting up store path in /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974 ...
I1216 11:48:19.068677 269561 main.go:141] libmachine: (old-k8s-version-933974) building disk image from file:///home/jenkins/minikube-integration/20107-210204/.minikube/cache/iso/amd64/minikube-v1.34.0-1733936888-20083-amd64.iso
I1216 11:48:19.068693 269561 main.go:141] libmachine: (old-k8s-version-933974) Downloading /home/jenkins/minikube-integration/20107-210204/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20107-210204/.minikube/cache/iso/amd64/minikube-v1.34.0-1733936888-20083-amd64.iso...
I1216 11:48:19.377862 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:19.377592 270159 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa...
I1216 11:48:19.572325 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:19.572109 270159 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/old-k8s-version-933974.rawdisk...
I1216 11:48:19.572383 269561 main.go:141] libmachine: (old-k8s-version-933974) setting executable bit set on /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974 (perms=drwx------)
I1216 11:48:19.572398 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | Writing magic tar header
I1216 11:48:19.572410 269561 main.go:141] libmachine: (old-k8s-version-933974) setting executable bit set on /home/jenkins/minikube-integration/20107-210204/.minikube/machines (perms=drwxr-xr-x)
I1216 11:48:19.572428 269561 main.go:141] libmachine: (old-k8s-version-933974) setting executable bit set on /home/jenkins/minikube-integration/20107-210204/.minikube (perms=drwxr-xr-x)
I1216 11:48:19.572443 269561 main.go:141] libmachine: (old-k8s-version-933974) setting executable bit set on /home/jenkins/minikube-integration/20107-210204 (perms=drwxrwxr-x)
I1216 11:48:19.572454 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | Writing SSH key tar header
I1216 11:48:19.572473 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:19.572232 270159 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974 ...
I1216 11:48:19.572496 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974
I1216 11:48:19.572519 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20107-210204/.minikube/machines
I1216 11:48:19.572536 269561 main.go:141] libmachine: (old-k8s-version-933974) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I1216 11:48:19.572546 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20107-210204/.minikube
I1216 11:48:19.572558 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20107-210204
I1216 11:48:19.572568 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I1216 11:48:19.572579 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home/jenkins
I1216 11:48:19.572587 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | checking permissions on dir: /home
I1216 11:48:19.572598 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | skipping /home - not owner
I1216 11:48:19.572612 269561 main.go:141] libmachine: (old-k8s-version-933974) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I1216 11:48:19.572624 269561 main.go:141] libmachine: (old-k8s-version-933974) creating domain...
I1216 11:48:19.573873 269561 main.go:141] libmachine: (old-k8s-version-933974) define libvirt domain using xml:
I1216 11:48:19.573901 269561 main.go:141] libmachine: (old-k8s-version-933974) <domain type='kvm'>
I1216 11:48:19.573912 269561 main.go:141] libmachine: (old-k8s-version-933974) <name>old-k8s-version-933974</name>
I1216 11:48:19.573923 269561 main.go:141] libmachine: (old-k8s-version-933974) <memory unit='MiB'>2200</memory>
I1216 11:48:19.573936 269561 main.go:141] libmachine: (old-k8s-version-933974) <vcpu>2</vcpu>
I1216 11:48:19.573942 269561 main.go:141] libmachine: (old-k8s-version-933974) <features>
I1216 11:48:19.573964 269561 main.go:141] libmachine: (old-k8s-version-933974) <acpi/>
I1216 11:48:19.573978 269561 main.go:141] libmachine: (old-k8s-version-933974) <apic/>
I1216 11:48:19.573986 269561 main.go:141] libmachine: (old-k8s-version-933974) <pae/>
I1216 11:48:19.573992 269561 main.go:141] libmachine: (old-k8s-version-933974)
I1216 11:48:19.574027 269561 main.go:141] libmachine: (old-k8s-version-933974) </features>
I1216 11:48:19.574066 269561 main.go:141] libmachine: (old-k8s-version-933974) <cpu mode='host-passthrough'>
I1216 11:48:19.574076 269561 main.go:141] libmachine: (old-k8s-version-933974)
I1216 11:48:19.574082 269561 main.go:141] libmachine: (old-k8s-version-933974) </cpu>
I1216 11:48:19.574090 269561 main.go:141] libmachine: (old-k8s-version-933974) <os>
I1216 11:48:19.574101 269561 main.go:141] libmachine: (old-k8s-version-933974) <type>hvm</type>
I1216 11:48:19.574110 269561 main.go:141] libmachine: (old-k8s-version-933974) <boot dev='cdrom'/>
I1216 11:48:19.574121 269561 main.go:141] libmachine: (old-k8s-version-933974) <boot dev='hd'/>
I1216 11:48:19.574131 269561 main.go:141] libmachine: (old-k8s-version-933974) <bootmenu enable='no'/>
I1216 11:48:19.574139 269561 main.go:141] libmachine: (old-k8s-version-933974) </os>
I1216 11:48:19.574148 269561 main.go:141] libmachine: (old-k8s-version-933974) <devices>
I1216 11:48:19.574159 269561 main.go:141] libmachine: (old-k8s-version-933974) <disk type='file' device='cdrom'>
I1216 11:48:19.574173 269561 main.go:141] libmachine: (old-k8s-version-933974) <source file='/home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/boot2docker.iso'/>
I1216 11:48:19.574186 269561 main.go:141] libmachine: (old-k8s-version-933974) <target dev='hdc' bus='scsi'/>
I1216 11:48:19.574195 269561 main.go:141] libmachine: (old-k8s-version-933974) <readonly/>
I1216 11:48:19.574205 269561 main.go:141] libmachine: (old-k8s-version-933974) </disk>
I1216 11:48:19.574215 269561 main.go:141] libmachine: (old-k8s-version-933974) <disk type='file' device='disk'>
I1216 11:48:19.574227 269561 main.go:141] libmachine: (old-k8s-version-933974) <driver name='qemu' type='raw' cache='default' io='threads' />
I1216 11:48:19.574241 269561 main.go:141] libmachine: (old-k8s-version-933974) <source file='/home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/old-k8s-version-933974.rawdisk'/>
I1216 11:48:19.574252 269561 main.go:141] libmachine: (old-k8s-version-933974) <target dev='hda' bus='virtio'/>
I1216 11:48:19.574263 269561 main.go:141] libmachine: (old-k8s-version-933974) </disk>
I1216 11:48:19.574272 269561 main.go:141] libmachine: (old-k8s-version-933974) <interface type='network'>
I1216 11:48:19.574285 269561 main.go:141] libmachine: (old-k8s-version-933974) <source network='mk-old-k8s-version-933974'/>
I1216 11:48:19.574298 269561 main.go:141] libmachine: (old-k8s-version-933974) <model type='virtio'/>
I1216 11:48:19.574310 269561 main.go:141] libmachine: (old-k8s-version-933974) </interface>
I1216 11:48:19.574320 269561 main.go:141] libmachine: (old-k8s-version-933974) <interface type='network'>
I1216 11:48:19.574330 269561 main.go:141] libmachine: (old-k8s-version-933974) <source network='default'/>
I1216 11:48:19.574340 269561 main.go:141] libmachine: (old-k8s-version-933974) <model type='virtio'/>
I1216 11:48:19.574349 269561 main.go:141] libmachine: (old-k8s-version-933974) </interface>
I1216 11:48:19.574358 269561 main.go:141] libmachine: (old-k8s-version-933974) <serial type='pty'>
I1216 11:48:19.574367 269561 main.go:141] libmachine: (old-k8s-version-933974) <target port='0'/>
I1216 11:48:19.574377 269561 main.go:141] libmachine: (old-k8s-version-933974) </serial>
I1216 11:48:19.574385 269561 main.go:141] libmachine: (old-k8s-version-933974) <console type='pty'>
I1216 11:48:19.574393 269561 main.go:141] libmachine: (old-k8s-version-933974) <target type='serial' port='0'/>
I1216 11:48:19.574411 269561 main.go:141] libmachine: (old-k8s-version-933974) </console>
I1216 11:48:19.574422 269561 main.go:141] libmachine: (old-k8s-version-933974) <rng model='virtio'>
I1216 11:48:19.574432 269561 main.go:141] libmachine: (old-k8s-version-933974) <backend model='random'>/dev/random</backend>
I1216 11:48:19.574442 269561 main.go:141] libmachine: (old-k8s-version-933974) </rng>
I1216 11:48:19.574450 269561 main.go:141] libmachine: (old-k8s-version-933974)
I1216 11:48:19.574460 269561 main.go:141] libmachine: (old-k8s-version-933974)
I1216 11:48:19.574468 269561 main.go:141] libmachine: (old-k8s-version-933974) </devices>
I1216 11:48:19.574478 269561 main.go:141] libmachine: (old-k8s-version-933974) </domain>
I1216 11:48:19.574489 269561 main.go:141] libmachine: (old-k8s-version-933974)
I1216 11:48:19.579127 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:17:0e:b5 in network default
I1216 11:48:19.579738 269561 main.go:141] libmachine: (old-k8s-version-933974) starting domain...
I1216 11:48:19.579758 269561 main.go:141] libmachine: (old-k8s-version-933974) ensuring networks are active...
I1216 11:48:19.579766 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:19.580469 269561 main.go:141] libmachine: (old-k8s-version-933974) Ensuring network default is active
I1216 11:48:19.580759 269561 main.go:141] libmachine: (old-k8s-version-933974) Ensuring network mk-old-k8s-version-933974 is active
I1216 11:48:19.581391 269561 main.go:141] libmachine: (old-k8s-version-933974) getting domain XML...
I1216 11:48:19.582139 269561 main.go:141] libmachine: (old-k8s-version-933974) creating domain...
I1216 11:48:20.967571 269561 main.go:141] libmachine: (old-k8s-version-933974) waiting for IP...
I1216 11:48:20.968494 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:20.969079 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:20.969112 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:20.969053 270159 retry.go:31] will retry after 259.976811ms: waiting for domain to come up
I1216 11:48:21.230656 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:21.231344 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:21.231376 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:21.231322 270159 retry.go:31] will retry after 379.666292ms: waiting for domain to come up
I1216 11:48:21.613133 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:21.613773 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:21.613832 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:21.613747 270159 retry.go:31] will retry after 370.400634ms: waiting for domain to come up
I1216 11:48:21.985483 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:21.985995 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:21.986120 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:21.985993 270159 retry.go:31] will retry after 382.198168ms: waiting for domain to come up
I1216 11:48:22.369871 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:22.370491 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:22.370533 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:22.370445 270159 retry.go:31] will retry after 567.042777ms: waiting for domain to come up
I1216 11:48:22.939189 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:22.939727 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:22.939758 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:22.939677 270159 retry.go:31] will retry after 917.185458ms: waiting for domain to come up
I1216 11:48:23.859034 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:23.859651 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:23.859689 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:23.859626 270159 retry.go:31] will retry after 813.639392ms: waiting for domain to come up
I1216 11:48:24.674598 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:24.675244 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:24.675281 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:24.675225 270159 retry.go:31] will retry after 1.103029475s: waiting for domain to come up
I1216 11:48:25.780461 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:25.781008 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:25.781050 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:25.780995 270159 retry.go:31] will retry after 1.441411901s: waiting for domain to come up
I1216 11:48:27.224826 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:27.225349 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:27.225404 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:27.225338 270159 retry.go:31] will retry after 2.139350607s: waiting for domain to come up
I1216 11:48:29.367015 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:29.367721 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:29.367751 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:29.367687 270159 retry.go:31] will retry after 2.346123865s: waiting for domain to come up
I1216 11:48:31.715131 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:31.715667 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:31.715696 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:31.715623 270159 retry.go:31] will retry after 2.437445621s: waiting for domain to come up
I1216 11:48:34.155079 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:34.155621 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:34.155652 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:34.155583 270159 retry.go:31] will retry after 4.284569216s: waiting for domain to come up
I1216 11:48:38.443181 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:38.443704 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find current IP address of domain old-k8s-version-933974 in network mk-old-k8s-version-933974
I1216 11:48:38.443722 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | I1216 11:48:38.443678 270159 retry.go:31] will retry after 4.237737952s: waiting for domain to come up
I1216 11:48:42.682845 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.683396 269561 main.go:141] libmachine: (old-k8s-version-933974) found domain IP: 192.168.61.2
I1216 11:48:42.683426 269561 main.go:141] libmachine: (old-k8s-version-933974) reserving static IP address...
I1216 11:48:42.683449 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has current primary IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.683865 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-933974", mac: "52:54:00:70:69:8b", ip: "192.168.61.2"} in network mk-old-k8s-version-933974
I1216 11:48:42.765580 269561 main.go:141] libmachine: (old-k8s-version-933974) reserved static IP address 192.168.61.2 for domain old-k8s-version-933974
I1216 11:48:42.765619 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | Getting to WaitForSSH function...
I1216 11:48:42.765633 269561 main.go:141] libmachine: (old-k8s-version-933974) waiting for SSH...
I1216 11:48:42.768117 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.768485 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:minikube Clientid:01:52:54:00:70:69:8b}
I1216 11:48:42.768509 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.768629 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | Using SSH client type: external
I1216 11:48:42.768652 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | Using SSH private key: /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa (-rw-------)
I1216 11:48:42.768689 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.2 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa -p 22] /usr/bin/ssh <nil>}
I1216 11:48:42.768709 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | About to run SSH command:
I1216 11:48:42.768754 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | exit 0
I1216 11:48:42.889016 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | SSH cmd err, output: <nil>:
I1216 11:48:42.889265 269561 main.go:141] libmachine: (old-k8s-version-933974) KVM machine creation complete
I1216 11:48:42.889679 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetConfigRaw
I1216 11:48:42.890291 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:42.890530 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:42.890722 269561 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1216 11:48:42.890738 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetState
I1216 11:48:42.892184 269561 main.go:141] libmachine: Detecting operating system of created instance...
I1216 11:48:42.892198 269561 main.go:141] libmachine: Waiting for SSH to be available...
I1216 11:48:42.892203 269561 main.go:141] libmachine: Getting to WaitForSSH function...
I1216 11:48:42.892208 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:42.894692 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.895059 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:42.895087 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.895240 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:42.895405 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:42.895601 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:42.895793 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:42.895975 269561 main.go:141] libmachine: Using SSH client type: native
I1216 11:48:42.896738 269561 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I1216 11:48:42.896766 269561 main.go:141] libmachine: About to run SSH command:
exit 0
I1216 11:48:42.996252 269561 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1216 11:48:42.996298 269561 main.go:141] libmachine: Detecting the provisioner...
I1216 11:48:42.996313 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:42.999213 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.999594 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:42.999623 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:42.999823 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:43.000026 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.000172 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.000305 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:43.000488 269561 main.go:141] libmachine: Using SSH client type: native
I1216 11:48:43.000672 269561 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I1216 11:48:43.000682 269561 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1216 11:48:43.097473 269561 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1216 11:48:43.097539 269561 main.go:141] libmachine: found compatible host: buildroot
I1216 11:48:43.097549 269561 main.go:141] libmachine: Provisioning with buildroot...
I1216 11:48:43.097559 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetMachineName
I1216 11:48:43.097821 269561 buildroot.go:166] provisioning hostname "old-k8s-version-933974"
I1216 11:48:43.097849 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetMachineName
I1216 11:48:43.098077 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:43.100791 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.101224 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:43.101254 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.101434 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:43.101600 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.101743 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.101837 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:43.101970 269561 main.go:141] libmachine: Using SSH client type: native
I1216 11:48:43.102143 269561 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I1216 11:48:43.102155 269561 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-933974 && echo "old-k8s-version-933974" | sudo tee /etc/hostname
I1216 11:48:43.213714 269561 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-933974
I1216 11:48:43.213747 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:43.216570 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.216897 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:43.216926 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.217142 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:43.217343 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.217490 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.217616 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:43.217773 269561 main.go:141] libmachine: Using SSH client type: native
I1216 11:48:43.217962 269561 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I1216 11:48:43.217985 269561 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-933974' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-933974/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-933974' | sudo tee -a /etc/hosts;
fi
fi
I1216 11:48:43.325286 269561 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1216 11:48:43.325328 269561 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20107-210204/.minikube CaCertPath:/home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20107-210204/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20107-210204/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20107-210204/.minikube}
I1216 11:48:43.325356 269561 buildroot.go:174] setting up certificates
I1216 11:48:43.325374 269561 provision.go:84] configureAuth start
I1216 11:48:43.325385 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetMachineName
I1216 11:48:43.325685 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetIP
I1216 11:48:43.328657 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.329101 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:43.329128 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.329265 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:43.331364 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.331697 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:43.331726 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.331842 269561 provision.go:143] copyHostCerts
I1216 11:48:43.331898 269561 exec_runner.go:144] found /home/jenkins/minikube-integration/20107-210204/.minikube/ca.pem, removing ...
I1216 11:48:43.331908 269561 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20107-210204/.minikube/ca.pem
I1216 11:48:43.331965 269561 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20107-210204/.minikube/ca.pem (1078 bytes)
I1216 11:48:43.332069 269561 exec_runner.go:144] found /home/jenkins/minikube-integration/20107-210204/.minikube/cert.pem, removing ...
I1216 11:48:43.332085 269561 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20107-210204/.minikube/cert.pem
I1216 11:48:43.332107 269561 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20107-210204/.minikube/cert.pem (1123 bytes)
I1216 11:48:43.332170 269561 exec_runner.go:144] found /home/jenkins/minikube-integration/20107-210204/.minikube/key.pem, removing ...
I1216 11:48:43.332177 269561 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20107-210204/.minikube/key.pem
I1216 11:48:43.332195 269561 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20107-210204/.minikube/key.pem (1679 bytes)
I1216 11:48:43.332254 269561 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20107-210204/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-933974 san=[127.0.0.1 192.168.61.2 localhost minikube old-k8s-version-933974]
I1216 11:48:43.566921 269561 provision.go:177] copyRemoteCerts
I1216 11:48:43.566980 269561 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1216 11:48:43.567006 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:43.570644 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.571088 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:43.571120 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.571255 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:43.571461 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.571624 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:43.571790 269561 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa Username:docker}
I1216 11:48:43.651192 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1216 11:48:43.674945 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1216 11:48:43.699773 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1216 11:48:43.724771 269561 provision.go:87] duration metric: took 399.381399ms to configureAuth
I1216 11:48:43.724802 269561 buildroot.go:189] setting minikube options for container-runtime
I1216 11:48:43.724970 269561 config.go:182] Loaded profile config "old-k8s-version-933974": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I1216 11:48:43.725055 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:43.727858 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.728180 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:43.728208 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:43.728423 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:43.728677 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.728941 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:43.729155 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:43.729400 269561 main.go:141] libmachine: Using SSH client type: native
I1216 11:48:43.729572 269561 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I1216 11:48:43.729587 269561 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1216 11:48:44.188735 269561 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1216 11:48:44.188764 269561 main.go:141] libmachine: Checking connection to Docker...
I1216 11:48:44.188774 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetURL
I1216 11:48:44.190145 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | using libvirt version 6000000
I1216 11:48:44.192421 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.192788 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.192822 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.192972 269561 main.go:141] libmachine: Docker is up and running!
I1216 11:48:44.192993 269561 main.go:141] libmachine: Reticulating splines...
I1216 11:48:44.193003 269561 client.go:171] duration metric: took 25.214162555s to LocalClient.Create
I1216 11:48:44.193033 269561 start.go:167] duration metric: took 25.214236241s to libmachine.API.Create "old-k8s-version-933974"
I1216 11:48:44.193045 269561 start.go:293] postStartSetup for "old-k8s-version-933974" (driver="kvm2")
I1216 11:48:44.193055 269561 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1216 11:48:44.193080 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:44.193382 269561 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1216 11:48:44.193407 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:44.195637 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.196020 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.196051 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.196184 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:44.196401 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:44.196562 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:44.196711 269561 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa Username:docker}
I1216 11:48:44.276057 269561 ssh_runner.go:195] Run: cat /etc/os-release
I1216 11:48:44.280657 269561 info.go:137] Remote host: Buildroot 2023.02.9
I1216 11:48:44.280682 269561 filesync.go:126] Scanning /home/jenkins/minikube-integration/20107-210204/.minikube/addons for local assets ...
I1216 11:48:44.280760 269561 filesync.go:126] Scanning /home/jenkins/minikube-integration/20107-210204/.minikube/files for local assets ...
I1216 11:48:44.280849 269561 filesync.go:149] local asset: /home/jenkins/minikube-integration/20107-210204/.minikube/files/etc/ssl/certs/2175192.pem -> 2175192.pem in /etc/ssl/certs
I1216 11:48:44.280988 269561 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1216 11:48:44.291274 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/files/etc/ssl/certs/2175192.pem --> /etc/ssl/certs/2175192.pem (1708 bytes)
I1216 11:48:44.315060 269561 start.go:296] duration metric: took 121.997424ms for postStartSetup
I1216 11:48:44.315132 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetConfigRaw
I1216 11:48:44.315847 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetIP
I1216 11:48:44.318447 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.318793 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.318815 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.319113 269561 profile.go:143] Saving config to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/config.json ...
I1216 11:48:44.319350 269561 start.go:128] duration metric: took 25.365468529s to createHost
I1216 11:48:44.319391 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:44.321791 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.322071 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.322114 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.322249 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:44.322474 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:44.322641 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:44.322856 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:44.322996 269561 main.go:141] libmachine: Using SSH client type: native
I1216 11:48:44.323154 269561 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I1216 11:48:44.323171 269561 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1216 11:48:44.425689 269561 main.go:141] libmachine: SSH cmd err, output: <nil>: 1734349724.401145293
I1216 11:48:44.425718 269561 fix.go:216] guest clock: 1734349724.401145293
I1216 11:48:44.425728 269561 fix.go:229] Guest: 2024-12-16 11:48:44.401145293 +0000 UTC Remote: 2024-12-16 11:48:44.319375574 +0000 UTC m=+66.534966804 (delta=81.769719ms)
I1216 11:48:44.425763 269561 fix.go:200] guest clock delta is within tolerance: 81.769719ms
I1216 11:48:44.425773 269561 start.go:83] releasing machines lock for "old-k8s-version-933974", held for 25.472052379s
I1216 11:48:44.425805 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:44.426113 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetIP
I1216 11:48:44.429140 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.429564 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.429594 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.429726 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:44.430225 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:44.430473 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .DriverName
I1216 11:48:44.430578 269561 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1216 11:48:44.430637 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:44.430708 269561 ssh_runner.go:195] Run: cat /version.json
I1216 11:48:44.430730 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHHostname
I1216 11:48:44.433679 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.433979 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.434099 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.434134 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.434309 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:44.434392 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:44.434421 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:44.434468 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:44.434581 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHPort
I1216 11:48:44.434697 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:44.434774 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHKeyPath
I1216 11:48:44.434861 269561 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa Username:docker}
I1216 11:48:44.434958 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetSSHUsername
I1216 11:48:44.435107 269561 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20107-210204/.minikube/machines/old-k8s-version-933974/id_rsa Username:docker}
I1216 11:48:44.533801 269561 ssh_runner.go:195] Run: systemctl --version
I1216 11:48:44.540416 269561 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1216 11:48:44.704617 269561 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1216 11:48:44.711421 269561 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1216 11:48:44.711488 269561 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1216 11:48:44.727762 269561 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1216 11:48:44.727799 269561 start.go:495] detecting cgroup driver to use...
I1216 11:48:44.727878 269561 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1216 11:48:44.743638 269561 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1216 11:48:44.758267 269561 docker.go:217] disabling cri-docker service (if available) ...
I1216 11:48:44.758353 269561 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1216 11:48:44.771818 269561 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1216 11:48:44.785858 269561 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1216 11:48:44.909488 269561 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1216 11:48:45.053278 269561 docker.go:233] disabling docker service ...
I1216 11:48:45.053350 269561 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1216 11:48:45.069131 269561 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1216 11:48:45.083958 269561 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1216 11:48:45.230076 269561 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1216 11:48:45.359782 269561 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1216 11:48:45.373530 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1216 11:48:45.394101 269561 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I1216 11:48:45.394168 269561 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I1216 11:48:45.405488 269561 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1216 11:48:45.405574 269561 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1216 11:48:45.416529 269561 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1216 11:48:45.427247 269561 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1216 11:48:45.437977 269561 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1216 11:48:45.448385 269561 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1216 11:48:45.458027 269561 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1216 11:48:45.458099 269561 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1216 11:48:45.472308 269561 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1216 11:48:45.483243 269561 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1216 11:48:45.617892 269561 ssh_runner.go:195] Run: sudo systemctl restart crio
I1216 11:48:45.710392 269561 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I1216 11:48:45.710477 269561 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1216 11:48:45.715336 269561 start.go:563] Will wait 60s for crictl version
I1216 11:48:45.715408 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:45.719306 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1216 11:48:45.762964 269561 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I1216 11:48:45.763061 269561 ssh_runner.go:195] Run: crio --version
I1216 11:48:45.794789 269561 ssh_runner.go:195] Run: crio --version
I1216 11:48:45.834569 269561 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I1216 11:48:45.836003 269561 main.go:141] libmachine: (old-k8s-version-933974) Calling .GetIP
I1216 11:48:45.839509 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:45.839932 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:70:69:8b", ip: ""} in network mk-old-k8s-version-933974: {Iface:virbr2 ExpiryTime:2024-12-16 12:48:34 +0000 UTC Type:0 Mac:52:54:00:70:69:8b Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-933974 Clientid:01:52:54:00:70:69:8b}
I1216 11:48:45.839962 269561 main.go:141] libmachine: (old-k8s-version-933974) DBG | domain old-k8s-version-933974 has defined IP address 192.168.61.2 and MAC address 52:54:00:70:69:8b in network mk-old-k8s-version-933974
I1216 11:48:45.840181 269561 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I1216 11:48:45.845052 269561 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1216 11:48:45.859913 269561 kubeadm.go:883] updating cluster {Name:old-k8s-version-933974 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20083/minikube-v1.34.0-1733936888-20083-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-933974 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1216 11:48:45.860024 269561 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1216 11:48:45.860063 269561 ssh_runner.go:195] Run: sudo crictl images --output json
I1216 11:48:45.901862 269561 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1216 11:48:45.901933 269561 ssh_runner.go:195] Run: which lz4
I1216 11:48:45.906865 269561 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I1216 11:48:45.911963 269561 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1216 11:48:45.912007 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I1216 11:48:47.455719 269561 crio.go:462] duration metric: took 1.548883748s to copy over tarball
I1216 11:48:47.455820 269561 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I1216 11:48:50.333095 269561 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.877233973s)
I1216 11:48:50.333146 269561 crio.go:469] duration metric: took 2.877377109s to extract the tarball
I1216 11:48:50.333158 269561 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1216 11:48:50.376949 269561 ssh_runner.go:195] Run: sudo crictl images --output json
I1216 11:48:50.422012 269561 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1216 11:48:50.422052 269561 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I1216 11:48:50.422137 269561 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I1216 11:48:50.422147 269561 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:50.422174 269561 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:50.422147 269561 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:50.422197 269561 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I1216 11:48:50.422178 269561 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I1216 11:48:50.422230 269561 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I1216 11:48:50.422208 269561 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:50.424167 269561 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:50.424199 269561 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I1216 11:48:50.424205 269561 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I1216 11:48:50.424172 269561 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I1216 11:48:50.424252 269561 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:50.424275 269561 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:50.424345 269561 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:50.424422 269561 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I1216 11:48:50.580070 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I1216 11:48:50.582795 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:50.590449 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:50.601217 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:50.608697 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I1216 11:48:50.617259 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:50.619861 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I1216 11:48:50.644868 269561 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I1216 11:48:50.644926 269561 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I1216 11:48:50.644994 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.766502 269561 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I1216 11:48:50.766557 269561 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:50.766612 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.771857 269561 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I1216 11:48:50.771914 269561 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:50.771967 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.779107 269561 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I1216 11:48:50.779161 269561 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:50.779166 269561 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I1216 11:48:50.779203 269561 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I1216 11:48:50.779216 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.779245 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.779278 269561 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I1216 11:48:50.779312 269561 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:50.779339 269561 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I1216 11:48:50.779354 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.779373 269561 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I1216 11:48:50.779419 269561 ssh_runner.go:195] Run: which crictl
I1216 11:48:50.779476 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1216 11:48:50.779561 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:50.783516 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:50.783558 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1216 11:48:50.792620 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1216 11:48:50.792626 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:50.792626 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:50.922462 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:50.926171 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1216 11:48:50.930457 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:50.930926 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1216 11:48:50.949820 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:50.949820 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1216 11:48:50.949820 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:51.080436 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1216 11:48:51.080463 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1216 11:48:51.080442 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1216 11:48:51.080442 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1216 11:48:51.113785 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1216 11:48:51.113856 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1216 11:48:51.117530 269561 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1216 11:48:51.218828 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I1216 11:48:51.218853 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I1216 11:48:51.225843 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I1216 11:48:51.225863 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I1216 11:48:51.244238 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I1216 11:48:51.244275 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I1216 11:48:51.247524 269561 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I1216 11:48:51.424029 269561 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I1216 11:48:51.570996 269561 cache_images.go:92] duration metric: took 1.148919694s to LoadCachedImages
W1216 11:48:51.571123 269561 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20107-210204/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I1216 11:48:51.571142 269561 kubeadm.go:934] updating node { 192.168.61.2 8443 v1.20.0 crio true true} ...
I1216 11:48:51.571308 269561 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-933974 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-933974 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1216 11:48:51.571403 269561 ssh_runner.go:195] Run: crio config
I1216 11:48:51.636403 269561 cni.go:84] Creating CNI manager for ""
I1216 11:48:51.636434 269561 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1216 11:48:51.636447 269561 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1216 11:48:51.636472 269561 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-933974 NodeName:old-k8s-version-933974 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1216 11:48:51.636657 269561 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-933974"
kubeletExtraArgs:
node-ip: 192.168.61.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1216 11:48:51.636741 269561 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1216 11:48:51.647193 269561 binaries.go:44] Found k8s binaries, skipping transfer
I1216 11:48:51.647261 269561 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1216 11:48:51.657405 269561 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (428 bytes)
I1216 11:48:51.675929 269561 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1216 11:48:51.694670 269561 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I1216 11:48:51.714389 269561 ssh_runner.go:195] Run: grep 192.168.61.2 control-plane.minikube.internal$ /etc/hosts
I1216 11:48:51.718684 269561 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1216 11:48:51.731527 269561 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1216 11:48:51.871902 269561 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1216 11:48:51.891206 269561 certs.go:68] Setting up /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974 for IP: 192.168.61.2
I1216 11:48:51.891240 269561 certs.go:194] generating shared ca certs ...
I1216 11:48:51.891264 269561 certs.go:226] acquiring lock for ca certs: {Name:mkd97e0b0fea726104cb674caf81491f1144961d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:51.891464 269561 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20107-210204/.minikube/ca.key
I1216 11:48:51.891518 269561 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20107-210204/.minikube/proxy-client-ca.key
I1216 11:48:51.891527 269561 certs.go:256] generating profile certs ...
I1216 11:48:51.891609 269561 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/client.key
I1216 11:48:51.891637 269561 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/client.crt with IP's: []
I1216 11:48:52.061893 269561 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/client.crt ...
I1216 11:48:52.061935 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/client.crt: {Name:mk0311f7c8e8eefac815e86ae25a88786ac41330 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:52.062186 269561 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/client.key ...
I1216 11:48:52.062211 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/client.key: {Name:mkdddda643e7e058399f49ca7d10b23773d47293 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:52.062345 269561 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.key.52ddef80
I1216 11:48:52.062373 269561 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.crt.52ddef80 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.2]
I1216 11:48:52.137493 269561 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.crt.52ddef80 ...
I1216 11:48:52.137526 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.crt.52ddef80: {Name:mk10d73016b5d55472fab4cc91ac4c6b6a041c1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:52.137740 269561 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.key.52ddef80 ...
I1216 11:48:52.137760 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.key.52ddef80: {Name:mk1b0a78a96e8962b3eff2c66200498b5f6b4248 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:52.137862 269561 certs.go:381] copying /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.crt.52ddef80 -> /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.crt
I1216 11:48:52.137969 269561 certs.go:385] copying /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.key.52ddef80 -> /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.key
I1216 11:48:52.138049 269561 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.key
I1216 11:48:52.138072 269561 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.crt with IP's: []
I1216 11:48:52.193649 269561 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.crt ...
I1216 11:48:52.193692 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.crt: {Name:mk29453a26c5cd95023de251d30c8131dae3e7fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:52.193889 269561 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.key ...
I1216 11:48:52.193910 269561 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.key: {Name:mk93d2a8973cdd8bbb48af4fbe06430f8d2be4ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 11:48:52.194154 269561 certs.go:484] found cert: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/217519.pem (1338 bytes)
W1216 11:48:52.194218 269561 certs.go:480] ignoring /home/jenkins/minikube-integration/20107-210204/.minikube/certs/217519_empty.pem, impossibly tiny 0 bytes
I1216 11:48:52.194233 269561 certs.go:484] found cert: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca-key.pem (1675 bytes)
I1216 11:48:52.194277 269561 certs.go:484] found cert: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/ca.pem (1078 bytes)
I1216 11:48:52.194311 269561 certs.go:484] found cert: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/cert.pem (1123 bytes)
I1216 11:48:52.194349 269561 certs.go:484] found cert: /home/jenkins/minikube-integration/20107-210204/.minikube/certs/key.pem (1679 bytes)
I1216 11:48:52.194404 269561 certs.go:484] found cert: /home/jenkins/minikube-integration/20107-210204/.minikube/files/etc/ssl/certs/2175192.pem (1708 bytes)
I1216 11:48:52.194992 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1216 11:48:52.222434 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1216 11:48:52.247766 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1216 11:48:52.278381 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1216 11:48:52.302627 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1216 11:48:52.331225 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1216 11:48:52.356913 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1216 11:48:52.383054 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/profiles/old-k8s-version-933974/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1216 11:48:52.412107 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1216 11:48:52.436986 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/certs/217519.pem --> /usr/share/ca-certificates/217519.pem (1338 bytes)
I1216 11:48:52.461252 269561 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20107-210204/.minikube/files/etc/ssl/certs/2175192.pem --> /usr/share/ca-certificates/2175192.pem (1708 bytes)
I1216 11:48:52.486087 269561 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1216 11:48:52.502451 269561 ssh_runner.go:195] Run: openssl version
I1216 11:48:52.509276 269561 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/217519.pem && ln -fs /usr/share/ca-certificates/217519.pem /etc/ssl/certs/217519.pem"
I1216 11:48:52.520303 269561 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/217519.pem
I1216 11:48:52.525187 269561 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Dec 16 10:42 /usr/share/ca-certificates/217519.pem
I1216 11:48:52.525258 269561 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/217519.pem
I1216 11:48:52.531015 269561 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/217519.pem /etc/ssl/certs/51391683.0"
I1216 11:48:52.542536 269561 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2175192.pem && ln -fs /usr/share/ca-certificates/2175192.pem /etc/ssl/certs/2175192.pem"
I1216 11:48:52.554533 269561 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2175192.pem
I1216 11:48:52.559129 269561 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Dec 16 10:42 /usr/share/ca-certificates/2175192.pem
I1216 11:48:52.559198 269561 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2175192.pem
I1216 11:48:52.564966 269561 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2175192.pem /etc/ssl/certs/3ec20f2e.0"
I1216 11:48:52.575953 269561 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1216 11:48:52.587400 269561 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1216 11:48:52.592324 269561 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 16 10:32 /usr/share/ca-certificates/minikubeCA.pem
I1216 11:48:52.592399 269561 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1216 11:48:52.598276 269561 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1216 11:48:52.610651 269561 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1216 11:48:52.615277 269561 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1216 11:48:52.615337 269561 kubeadm.go:392] StartCluster: {Name:old-k8s-version-933974 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20083/minikube-v1.34.0-1733936888-20083-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-933974 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1216 11:48:52.615417 269561 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1216 11:48:52.615465 269561 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1216 11:48:52.660098 269561 cri.go:89] found id: ""
I1216 11:48:52.660177 269561 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1216 11:48:52.671061 269561 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1216 11:48:52.681333 269561 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1216 11:48:52.694849 269561 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1216 11:48:52.694870 269561 kubeadm.go:157] found existing configuration files:
I1216 11:48:52.694925 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1216 11:48:52.707758 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1216 11:48:52.707834 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1216 11:48:52.719655 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1216 11:48:52.731542 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1216 11:48:52.731635 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1216 11:48:52.743681 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1216 11:48:52.755486 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1216 11:48:52.755601 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1216 11:48:52.771509 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1216 11:48:52.786371 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1216 11:48:52.786446 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1216 11:48:52.799579 269561 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1216 11:48:52.952372 269561 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1216 11:48:52.952633 269561 kubeadm.go:310] [preflight] Running pre-flight checks
I1216 11:48:53.130326 269561 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1216 11:48:53.130465 269561 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1216 11:48:53.130612 269561 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1216 11:48:53.364371 269561 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1216 11:48:53.365916 269561 out.go:235] - Generating certificates and keys ...
I1216 11:48:53.366042 269561 kubeadm.go:310] [certs] Using existing ca certificate authority
I1216 11:48:53.366174 269561 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1216 11:48:53.713492 269561 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1216 11:48:54.200904 269561 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1216 11:48:54.462543 269561 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1216 11:48:54.557916 269561 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1216 11:48:54.909167 269561 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1216 11:48:54.909443 269561 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-933974] and IPs [192.168.61.2 127.0.0.1 ::1]
I1216 11:48:55.028358 269561 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1216 11:48:55.028595 269561 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-933974] and IPs [192.168.61.2 127.0.0.1 ::1]
I1216 11:48:55.351799 269561 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1216 11:48:55.477191 269561 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1216 11:48:55.841958 269561 kubeadm.go:310] [certs] Generating "sa" key and public key
I1216 11:48:55.842061 269561 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1216 11:48:55.937246 269561 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1216 11:48:56.187549 269561 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1216 11:48:56.333805 269561 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1216 11:48:56.535516 269561 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1216 11:48:56.558174 269561 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1216 11:48:56.558615 269561 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1216 11:48:56.558697 269561 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1216 11:48:56.730978 269561 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1216 11:48:56.733449 269561 out.go:235] - Booting up control plane ...
I1216 11:48:56.733580 269561 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1216 11:48:56.745185 269561 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1216 11:48:56.746054 269561 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1216 11:48:56.746902 269561 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1216 11:48:56.751265 269561 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1216 11:49:36.745428 269561 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1216 11:49:36.745598 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:49:36.745889 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:49:41.746445 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:49:41.747298 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:49:51.746849 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:49:51.747117 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:50:11.746557 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:50:11.746816 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:50:51.747766 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:50:51.748090 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:50:51.748111 269561 kubeadm.go:310]
I1216 11:50:51.748170 269561 kubeadm.go:310] Unfortunately, an error has occurred:
I1216 11:50:51.748258 269561 kubeadm.go:310] timed out waiting for the condition
I1216 11:50:51.748287 269561 kubeadm.go:310]
I1216 11:50:51.748332 269561 kubeadm.go:310] This error is likely caused by:
I1216 11:50:51.748362 269561 kubeadm.go:310] - The kubelet is not running
I1216 11:50:51.748463 269561 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1216 11:50:51.748470 269561 kubeadm.go:310]
I1216 11:50:51.748554 269561 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1216 11:50:51.748590 269561 kubeadm.go:310] - 'systemctl status kubelet'
I1216 11:50:51.748622 269561 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1216 11:50:51.748629 269561 kubeadm.go:310]
I1216 11:50:51.748723 269561 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1216 11:50:51.748804 269561 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1216 11:50:51.748811 269561 kubeadm.go:310]
I1216 11:50:51.748893 269561 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1216 11:50:51.749027 269561 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1216 11:50:51.749122 269561 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1216 11:50:51.749223 269561 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1216 11:50:51.749235 269561 kubeadm.go:310]
I1216 11:50:51.749584 269561 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1216 11:50:51.749664 269561 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1216 11:50:51.749722 269561 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W1216 11:50:51.749844 269561 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-933974] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-933974] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-933974] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-933974] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1216 11:50:51.749883 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I1216 11:50:52.214709 269561 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1216 11:50:52.228655 269561 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1216 11:50:52.237571 269561 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1216 11:50:52.237592 269561 kubeadm.go:157] found existing configuration files:
I1216 11:50:52.237637 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1216 11:50:52.246153 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1216 11:50:52.246239 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1216 11:50:52.254997 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1216 11:50:52.263299 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1216 11:50:52.263368 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1216 11:50:52.272086 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1216 11:50:52.280686 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1216 11:50:52.280743 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1216 11:50:52.289337 269561 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1216 11:50:52.297513 269561 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1216 11:50:52.297573 269561 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1216 11:50:52.306286 269561 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1216 11:50:52.375626 269561 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1216 11:50:52.375686 269561 kubeadm.go:310] [preflight] Running pre-flight checks
I1216 11:50:52.502547 269561 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1216 11:50:52.502713 269561 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1216 11:50:52.502842 269561 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1216 11:50:52.669140 269561 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1216 11:50:52.672084 269561 out.go:235] - Generating certificates and keys ...
I1216 11:50:52.672222 269561 kubeadm.go:310] [certs] Using existing ca certificate authority
I1216 11:50:52.672307 269561 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1216 11:50:52.672420 269561 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1216 11:50:52.672503 269561 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I1216 11:50:52.672603 269561 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I1216 11:50:52.672679 269561 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I1216 11:50:52.672762 269561 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I1216 11:50:52.672845 269561 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I1216 11:50:52.673064 269561 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1216 11:50:52.673187 269561 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1216 11:50:52.673247 269561 kubeadm.go:310] [certs] Using the existing "sa" key
I1216 11:50:52.673320 269561 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1216 11:50:52.804233 269561 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1216 11:50:52.914834 269561 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1216 11:50:52.991027 269561 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1216 11:50:53.316927 269561 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1216 11:50:53.330423 269561 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1216 11:50:53.331359 269561 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1216 11:50:53.331437 269561 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1216 11:50:53.457358 269561 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1216 11:50:53.459341 269561 out.go:235] - Booting up control plane ...
I1216 11:50:53.459471 269561 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1216 11:50:53.463208 269561 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1216 11:50:53.464727 269561 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1216 11:50:53.465448 269561 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1216 11:50:53.475156 269561 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1216 11:51:33.477876 269561 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1216 11:51:33.478098 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:51:33.478338 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:51:38.478718 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:51:38.479016 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:51:48.479360 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:51:48.479653 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:52:08.478217 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:52:08.478544 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:52:48.476890 269561 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 11:52:48.477205 269561 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 11:52:48.477233 269561 kubeadm.go:310]
I1216 11:52:48.477296 269561 kubeadm.go:310] Unfortunately, an error has occurred:
I1216 11:52:48.477358 269561 kubeadm.go:310] timed out waiting for the condition
I1216 11:52:48.477376 269561 kubeadm.go:310]
I1216 11:52:48.477428 269561 kubeadm.go:310] This error is likely caused by:
I1216 11:52:48.477468 269561 kubeadm.go:310] - The kubelet is not running
I1216 11:52:48.477618 269561 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1216 11:52:48.477645 269561 kubeadm.go:310]
I1216 11:52:48.477773 269561 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1216 11:52:48.477820 269561 kubeadm.go:310] - 'systemctl status kubelet'
I1216 11:52:48.477885 269561 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1216 11:52:48.477931 269561 kubeadm.go:310]
I1216 11:52:48.478075 269561 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1216 11:52:48.478210 269561 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1216 11:52:48.478230 269561 kubeadm.go:310]
I1216 11:52:48.478361 269561 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1216 11:52:48.478475 269561 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1216 11:52:48.478583 269561 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1216 11:52:48.478677 269561 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1216 11:52:48.478689 269561 kubeadm.go:310]
I1216 11:52:48.478971 269561 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1216 11:52:48.479099 269561 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1216 11:52:48.479196 269561 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I1216 11:52:48.479295 269561 kubeadm.go:394] duration metric: took 3m55.863953499s to StartCluster
I1216 11:52:48.479416 269561 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1216 11:52:48.479504 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1216 11:52:48.513395 269561 cri.go:89] found id: ""
I1216 11:52:48.513431 269561 logs.go:282] 0 containers: []
W1216 11:52:48.513443 269561 logs.go:284] No container was found matching "kube-apiserver"
I1216 11:52:48.513451 269561 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1216 11:52:48.513511 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1216 11:52:48.547996 269561 cri.go:89] found id: ""
I1216 11:52:48.548039 269561 logs.go:282] 0 containers: []
W1216 11:52:48.548053 269561 logs.go:284] No container was found matching "etcd"
I1216 11:52:48.548063 269561 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1216 11:52:48.548177 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1216 11:52:48.581481 269561 cri.go:89] found id: ""
I1216 11:52:48.581517 269561 logs.go:282] 0 containers: []
W1216 11:52:48.581529 269561 logs.go:284] No container was found matching "coredns"
I1216 11:52:48.581538 269561 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1216 11:52:48.581612 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1216 11:52:48.615886 269561 cri.go:89] found id: ""
I1216 11:52:48.615915 269561 logs.go:282] 0 containers: []
W1216 11:52:48.615925 269561 logs.go:284] No container was found matching "kube-scheduler"
I1216 11:52:48.615931 269561 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1216 11:52:48.615992 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1216 11:52:48.654727 269561 cri.go:89] found id: ""
I1216 11:52:48.654761 269561 logs.go:282] 0 containers: []
W1216 11:52:48.654769 269561 logs.go:284] No container was found matching "kube-proxy"
I1216 11:52:48.654775 269561 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1216 11:52:48.654832 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1216 11:52:48.688346 269561 cri.go:89] found id: ""
I1216 11:52:48.688380 269561 logs.go:282] 0 containers: []
W1216 11:52:48.688392 269561 logs.go:284] No container was found matching "kube-controller-manager"
I1216 11:52:48.688401 269561 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1216 11:52:48.688472 269561 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1216 11:52:48.722953 269561 cri.go:89] found id: ""
I1216 11:52:48.722984 269561 logs.go:282] 0 containers: []
W1216 11:52:48.722995 269561 logs.go:284] No container was found matching "kindnet"
I1216 11:52:48.723009 269561 logs.go:123] Gathering logs for kubelet ...
I1216 11:52:48.723026 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1216 11:52:48.774058 269561 logs.go:123] Gathering logs for dmesg ...
I1216 11:52:48.774098 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1216 11:52:48.788646 269561 logs.go:123] Gathering logs for describe nodes ...
I1216 11:52:48.788693 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1216 11:52:48.903644 269561 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1216 11:52:48.903681 269561 logs.go:123] Gathering logs for CRI-O ...
I1216 11:52:48.903700 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1216 11:52:49.015007 269561 logs.go:123] Gathering logs for container status ...
I1216 11:52:49.015052 269561 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W1216 11:52:49.070355 269561 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1216 11:52:49.070428 269561 out.go:270] *
*
W1216 11:52:49.070495 269561 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1216 11:52:49.070511 269561 out.go:270] *
*
W1216 11:52:49.071629 269561 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1216 11:52:49.075516 269561 out.go:201]
W1216 11:52:49.076813 269561 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1216 11:52:49.076870 269561 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1216 11:52:49.076902 269561 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1216 11:52:49.078362 269561 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-933974 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-933974 -n old-k8s-version-933974
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-933974 -n old-k8s-version-933974: exit status 6 (288.647178ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1216 11:52:49.430122 275904 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-933974" does not appear in /home/jenkins/minikube-integration/20107-210204/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-933974" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (311.67s)