=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-005932 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-005932 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.473561519s)
-- stdout --
* [old-k8s-version-005932] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19758
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19758-661979/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19758-661979/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-005932" primary control-plane node in "old-k8s-version-005932" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1025 22:47:36.764798 720410 out.go:345] Setting OutFile to fd 1 ...
I1025 22:47:36.764919 720410 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1025 22:47:36.764928 720410 out.go:358] Setting ErrFile to fd 2...
I1025 22:47:36.764933 720410 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1025 22:47:36.765139 720410 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19758-661979/.minikube/bin
I1025 22:47:36.765767 720410 out.go:352] Setting JSON to false
I1025 22:47:36.766792 720410 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent","uptime":19801,"bootTime":1729876656,"procs":223,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1025 22:47:36.766910 720410 start.go:139] virtualization: kvm guest
I1025 22:47:36.769508 720410 out.go:177] * [old-k8s-version-005932] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I1025 22:47:36.770875 720410 out.go:177] - MINIKUBE_LOCATION=19758
I1025 22:47:36.770923 720410 notify.go:220] Checking for updates...
I1025 22:47:36.773385 720410 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1025 22:47:36.774744 720410 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19758-661979/kubeconfig
I1025 22:47:36.775999 720410 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19758-661979/.minikube
I1025 22:47:36.777292 720410 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1025 22:47:36.778569 720410 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1025 22:47:36.780415 720410 config.go:182] Loaded profile config "bridge-258147": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I1025 22:47:36.780567 720410 config.go:182] Loaded profile config "embed-certs-601894": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I1025 22:47:36.780695 720410 config.go:182] Loaded profile config "flannel-258147": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I1025 22:47:36.780825 720410 driver.go:394] Setting default libvirt URI to qemu:///system
I1025 22:47:36.817127 720410 out.go:177] * Using the kvm2 driver based on user configuration
I1025 22:47:36.818480 720410 start.go:297] selected driver: kvm2
I1025 22:47:36.818495 720410 start.go:901] validating driver "kvm2" against <nil>
I1025 22:47:36.818509 720410 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1025 22:47:36.819226 720410 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1025 22:47:36.819332 720410 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19758-661979/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1025 22:47:36.835321 720410 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I1025 22:47:36.835390 720410 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1025 22:47:36.835634 720410 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1025 22:47:36.835674 720410 cni.go:84] Creating CNI manager for ""
I1025 22:47:36.835768 720410 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1025 22:47:36.835787 720410 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1025 22:47:36.835854 720410 start.go:340] cluster config:
{Name:old-k8s-version-005932 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729002334-19806@sha256:40e85bdbd09a1ee487c66779d8bda357f3aa054bb4ec597b30029882beba918e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-005932 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1025 22:47:36.835967 720410 iso.go:125] acquiring lock: {Name:mk58f5ded1dd1a6cef12f07ae13108a7f83e0355 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1025 22:47:36.838065 720410 out.go:177] * Starting "old-k8s-version-005932" primary control-plane node in "old-k8s-version-005932" cluster
I1025 22:47:36.839250 720410 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1025 22:47:36.839286 720410 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I1025 22:47:36.839296 720410 cache.go:56] Caching tarball of preloaded images
I1025 22:47:36.839396 720410 preload.go:172] Found /home/jenkins/minikube-integration/19758-661979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1025 22:47:36.839410 720410 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I1025 22:47:36.839504 720410 profile.go:143] Saving config to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/config.json ...
I1025 22:47:36.839523 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/config.json: {Name:mkac4d3c9eb41287c9fdbb20f7d855858d130a4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:47:36.839675 720410 start.go:360] acquireMachinesLock for old-k8s-version-005932: {Name:mkb1c973e2c1c03aebfdabc66f56a99606a6fa0b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1025 22:47:40.273868 720410 start.go:364] duration metric: took 3.434155533s to acquireMachinesLock for "old-k8s-version-005932"
I1025 22:47:40.273930 720410 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-005932 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729002334-19806@sha256:40e85bdbd09a1ee487c66779d8bda357f3aa054bb4ec597b30029882beba918e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-005932 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1025 22:47:40.274021 720410 start.go:125] createHost starting for "" (driver="kvm2")
I1025 22:47:40.276993 720410 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1025 22:47:40.277169 720410 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1025 22:47:40.277233 720410 main.go:141] libmachine: Launching plugin server for driver kvm2
I1025 22:47:40.294603 720410 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38711
I1025 22:47:40.295069 720410 main.go:141] libmachine: () Calling .GetVersion
I1025 22:47:40.295811 720410 main.go:141] libmachine: Using API Version 1
I1025 22:47:40.295867 720410 main.go:141] libmachine: () Calling .SetConfigRaw
I1025 22:47:40.296324 720410 main.go:141] libmachine: () Calling .GetMachineName
I1025 22:47:40.296551 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetMachineName
I1025 22:47:40.296702 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:47:40.296846 720410 start.go:159] libmachine.API.Create for "old-k8s-version-005932" (driver="kvm2")
I1025 22:47:40.296881 720410 client.go:168] LocalClient.Create starting
I1025 22:47:40.296915 720410 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca.pem
I1025 22:47:40.296948 720410 main.go:141] libmachine: Decoding PEM data...
I1025 22:47:40.296980 720410 main.go:141] libmachine: Parsing certificate...
I1025 22:47:40.297065 720410 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19758-661979/.minikube/certs/cert.pem
I1025 22:47:40.297101 720410 main.go:141] libmachine: Decoding PEM data...
I1025 22:47:40.297121 720410 main.go:141] libmachine: Parsing certificate...
I1025 22:47:40.297143 720410 main.go:141] libmachine: Running pre-create checks...
I1025 22:47:40.297154 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .PreCreateCheck
I1025 22:47:40.297573 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetConfigRaw
I1025 22:47:40.298000 720410 main.go:141] libmachine: Creating machine...
I1025 22:47:40.298015 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .Create
I1025 22:47:40.298178 720410 main.go:141] libmachine: (old-k8s-version-005932) creating KVM machine...
I1025 22:47:40.298200 720410 main.go:141] libmachine: (old-k8s-version-005932) creating network...
I1025 22:47:40.299522 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found existing default KVM network
I1025 22:47:40.301362 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:40.301204 720476 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015910}
I1025 22:47:40.301418 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | created network xml:
I1025 22:47:40.301437 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | <network>
I1025 22:47:40.301452 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | <name>mk-old-k8s-version-005932</name>
I1025 22:47:40.301468 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | <dns enable='no'/>
I1025 22:47:40.301480 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG |
I1025 22:47:40.301489 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I1025 22:47:40.301500 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | <dhcp>
I1025 22:47:40.301512 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I1025 22:47:40.301535 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | </dhcp>
I1025 22:47:40.301555 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | </ip>
I1025 22:47:40.301573 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG |
I1025 22:47:40.301581 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | </network>
I1025 22:47:40.301598 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG |
I1025 22:47:40.307266 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | trying to create private KVM network mk-old-k8s-version-005932 192.168.39.0/24...
I1025 22:47:40.386912 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | private KVM network mk-old-k8s-version-005932 192.168.39.0/24 created
I1025 22:47:40.386942 720410 main.go:141] libmachine: (old-k8s-version-005932) setting up store path in /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932 ...
I1025 22:47:40.386964 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:40.386877 720476 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19758-661979/.minikube
I1025 22:47:40.386977 720410 main.go:141] libmachine: (old-k8s-version-005932) building disk image from file:///home/jenkins/minikube-integration/19758-661979/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso
I1025 22:47:40.387082 720410 main.go:141] libmachine: (old-k8s-version-005932) Downloading /home/jenkins/minikube-integration/19758-661979/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19758-661979/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...
I1025 22:47:40.689164 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:40.689044 720476 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa...
I1025 22:47:40.814258 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:40.814120 720476 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/old-k8s-version-005932.rawdisk...
I1025 22:47:40.814289 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | Writing magic tar header
I1025 22:47:40.814302 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | Writing SSH key tar header
I1025 22:47:40.814312 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:40.814236 720476 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932 ...
I1025 22:47:40.814329 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932
I1025 22:47:40.814415 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home/jenkins/minikube-integration/19758-661979/.minikube/machines
I1025 22:47:40.814470 720410 main.go:141] libmachine: (old-k8s-version-005932) setting executable bit set on /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932 (perms=drwx------)
I1025 22:47:40.814480 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home/jenkins/minikube-integration/19758-661979/.minikube
I1025 22:47:40.814512 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home/jenkins/minikube-integration/19758-661979
I1025 22:47:40.814523 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I1025 22:47:40.814535 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home/jenkins
I1025 22:47:40.814548 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | checking permissions on dir: /home
I1025 22:47:40.814560 720410 main.go:141] libmachine: (old-k8s-version-005932) setting executable bit set on /home/jenkins/minikube-integration/19758-661979/.minikube/machines (perms=drwxr-xr-x)
I1025 22:47:40.814577 720410 main.go:141] libmachine: (old-k8s-version-005932) setting executable bit set on /home/jenkins/minikube-integration/19758-661979/.minikube (perms=drwxr-xr-x)
I1025 22:47:40.814587 720410 main.go:141] libmachine: (old-k8s-version-005932) setting executable bit set on /home/jenkins/minikube-integration/19758-661979 (perms=drwxrwxr-x)
I1025 22:47:40.814598 720410 main.go:141] libmachine: (old-k8s-version-005932) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I1025 22:47:40.814606 720410 main.go:141] libmachine: (old-k8s-version-005932) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I1025 22:47:40.814618 720410 main.go:141] libmachine: (old-k8s-version-005932) creating domain...
I1025 22:47:40.814635 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | skipping /home - not owner
I1025 22:47:40.815853 720410 main.go:141] libmachine: (old-k8s-version-005932) define libvirt domain using xml:
I1025 22:47:40.815884 720410 main.go:141] libmachine: (old-k8s-version-005932) <domain type='kvm'>
I1025 22:47:40.815895 720410 main.go:141] libmachine: (old-k8s-version-005932) <name>old-k8s-version-005932</name>
I1025 22:47:40.815902 720410 main.go:141] libmachine: (old-k8s-version-005932) <memory unit='MiB'>2200</memory>
I1025 22:47:40.815911 720410 main.go:141] libmachine: (old-k8s-version-005932) <vcpu>2</vcpu>
I1025 22:47:40.815924 720410 main.go:141] libmachine: (old-k8s-version-005932) <features>
I1025 22:47:40.815932 720410 main.go:141] libmachine: (old-k8s-version-005932) <acpi/>
I1025 22:47:40.815939 720410 main.go:141] libmachine: (old-k8s-version-005932) <apic/>
I1025 22:47:40.815955 720410 main.go:141] libmachine: (old-k8s-version-005932) <pae/>
I1025 22:47:40.815965 720410 main.go:141] libmachine: (old-k8s-version-005932)
I1025 22:47:40.815981 720410 main.go:141] libmachine: (old-k8s-version-005932) </features>
I1025 22:47:40.815992 720410 main.go:141] libmachine: (old-k8s-version-005932) <cpu mode='host-passthrough'>
I1025 22:47:40.816000 720410 main.go:141] libmachine: (old-k8s-version-005932)
I1025 22:47:40.816008 720410 main.go:141] libmachine: (old-k8s-version-005932) </cpu>
I1025 22:47:40.816020 720410 main.go:141] libmachine: (old-k8s-version-005932) <os>
I1025 22:47:40.816031 720410 main.go:141] libmachine: (old-k8s-version-005932) <type>hvm</type>
I1025 22:47:40.816062 720410 main.go:141] libmachine: (old-k8s-version-005932) <boot dev='cdrom'/>
I1025 22:47:40.816087 720410 main.go:141] libmachine: (old-k8s-version-005932) <boot dev='hd'/>
I1025 22:47:40.816098 720410 main.go:141] libmachine: (old-k8s-version-005932) <bootmenu enable='no'/>
I1025 22:47:40.816105 720410 main.go:141] libmachine: (old-k8s-version-005932) </os>
I1025 22:47:40.816116 720410 main.go:141] libmachine: (old-k8s-version-005932) <devices>
I1025 22:47:40.816125 720410 main.go:141] libmachine: (old-k8s-version-005932) <disk type='file' device='cdrom'>
I1025 22:47:40.816140 720410 main.go:141] libmachine: (old-k8s-version-005932) <source file='/home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/boot2docker.iso'/>
I1025 22:47:40.816151 720410 main.go:141] libmachine: (old-k8s-version-005932) <target dev='hdc' bus='scsi'/>
I1025 22:47:40.816159 720410 main.go:141] libmachine: (old-k8s-version-005932) <readonly/>
I1025 22:47:40.816167 720410 main.go:141] libmachine: (old-k8s-version-005932) </disk>
I1025 22:47:40.816177 720410 main.go:141] libmachine: (old-k8s-version-005932) <disk type='file' device='disk'>
I1025 22:47:40.816188 720410 main.go:141] libmachine: (old-k8s-version-005932) <driver name='qemu' type='raw' cache='default' io='threads' />
I1025 22:47:40.816202 720410 main.go:141] libmachine: (old-k8s-version-005932) <source file='/home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/old-k8s-version-005932.rawdisk'/>
I1025 22:47:40.816213 720410 main.go:141] libmachine: (old-k8s-version-005932) <target dev='hda' bus='virtio'/>
I1025 22:47:40.816227 720410 main.go:141] libmachine: (old-k8s-version-005932) </disk>
I1025 22:47:40.816237 720410 main.go:141] libmachine: (old-k8s-version-005932) <interface type='network'>
I1025 22:47:40.816251 720410 main.go:141] libmachine: (old-k8s-version-005932) <source network='mk-old-k8s-version-005932'/>
I1025 22:47:40.816262 720410 main.go:141] libmachine: (old-k8s-version-005932) <model type='virtio'/>
I1025 22:47:40.816271 720410 main.go:141] libmachine: (old-k8s-version-005932) </interface>
I1025 22:47:40.816282 720410 main.go:141] libmachine: (old-k8s-version-005932) <interface type='network'>
I1025 22:47:40.816307 720410 main.go:141] libmachine: (old-k8s-version-005932) <source network='default'/>
I1025 22:47:40.816318 720410 main.go:141] libmachine: (old-k8s-version-005932) <model type='virtio'/>
I1025 22:47:40.816330 720410 main.go:141] libmachine: (old-k8s-version-005932) </interface>
I1025 22:47:40.816338 720410 main.go:141] libmachine: (old-k8s-version-005932) <serial type='pty'>
I1025 22:47:40.816353 720410 main.go:141] libmachine: (old-k8s-version-005932) <target port='0'/>
I1025 22:47:40.816362 720410 main.go:141] libmachine: (old-k8s-version-005932) </serial>
I1025 22:47:40.816373 720410 main.go:141] libmachine: (old-k8s-version-005932) <console type='pty'>
I1025 22:47:40.816381 720410 main.go:141] libmachine: (old-k8s-version-005932) <target type='serial' port='0'/>
I1025 22:47:40.816393 720410 main.go:141] libmachine: (old-k8s-version-005932) </console>
I1025 22:47:40.816402 720410 main.go:141] libmachine: (old-k8s-version-005932) <rng model='virtio'>
I1025 22:47:40.816412 720410 main.go:141] libmachine: (old-k8s-version-005932) <backend model='random'>/dev/random</backend>
I1025 22:47:40.816421 720410 main.go:141] libmachine: (old-k8s-version-005932) </rng>
I1025 22:47:40.816429 720410 main.go:141] libmachine: (old-k8s-version-005932)
I1025 22:47:40.816443 720410 main.go:141] libmachine: (old-k8s-version-005932)
I1025 22:47:40.816484 720410 main.go:141] libmachine: (old-k8s-version-005932) </devices>
I1025 22:47:40.816503 720410 main.go:141] libmachine: (old-k8s-version-005932) </domain>
I1025 22:47:40.816516 720410 main.go:141] libmachine: (old-k8s-version-005932)
I1025 22:47:40.820979 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:f5:a5:aa in network default
I1025 22:47:40.821805 720410 main.go:141] libmachine: (old-k8s-version-005932) starting domain...
I1025 22:47:40.821826 720410 main.go:141] libmachine: (old-k8s-version-005932) ensuring networks are active...
I1025 22:47:40.821838 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:40.822951 720410 main.go:141] libmachine: (old-k8s-version-005932) Ensuring network default is active
I1025 22:47:40.823098 720410 main.go:141] libmachine: (old-k8s-version-005932) Ensuring network mk-old-k8s-version-005932 is active
I1025 22:47:40.824006 720410 main.go:141] libmachine: (old-k8s-version-005932) getting domain XML...
I1025 22:47:40.824923 720410 main.go:141] libmachine: (old-k8s-version-005932) creating domain...
I1025 22:47:42.212663 720410 main.go:141] libmachine: (old-k8s-version-005932) waiting for IP...
I1025 22:47:42.215004 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:42.215587 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:42.215656 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:42.215575 720476 retry.go:31] will retry after 276.667921ms: waiting for domain to come up
I1025 22:47:42.494253 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:42.495019 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:42.495050 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:42.494982 720476 retry.go:31] will retry after 239.8324ms: waiting for domain to come up
I1025 22:47:42.736708 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:42.737282 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:42.737310 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:42.737266 720476 retry.go:31] will retry after 307.834847ms: waiting for domain to come up
I1025 22:47:43.047020 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:43.047709 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:43.047742 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:43.047661 720476 retry.go:31] will retry after 381.957222ms: waiting for domain to come up
I1025 22:47:43.431400 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:43.432016 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:43.432083 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:43.431998 720476 retry.go:31] will retry after 737.569257ms: waiting for domain to come up
I1025 22:47:44.170955 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:44.171598 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:44.171630 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:44.171533 720476 retry.go:31] will retry after 802.64843ms: waiting for domain to come up
I1025 22:47:44.975646 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:44.976103 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:44.976167 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:44.976079 720476 retry.go:31] will retry after 1.153314628s: waiting for domain to come up
I1025 22:47:46.131163 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:46.131625 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:46.131657 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:46.131601 720476 retry.go:31] will retry after 1.378906761s: waiting for domain to come up
I1025 22:47:47.512200 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:47.512693 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:47.512720 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:47.512681 720476 retry.go:31] will retry after 1.292779227s: waiting for domain to come up
I1025 22:47:48.806687 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:48.807277 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:48.807308 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:48.807252 720476 retry.go:31] will retry after 2.280599669s: waiting for domain to come up
I1025 22:47:51.089293 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:51.090012 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:51.090042 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:51.089911 720476 retry.go:31] will retry after 1.978378219s: waiting for domain to come up
I1025 22:47:53.070121 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:53.070652 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:53.070686 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:53.070620 720476 retry.go:31] will retry after 2.687850352s: waiting for domain to come up
I1025 22:47:55.759911 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:55.760543 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:55.760577 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:55.760515 720476 retry.go:31] will retry after 3.249637593s: waiting for domain to come up
I1025 22:47:59.153036 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:47:59.153845 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find current IP address of domain old-k8s-version-005932 in network mk-old-k8s-version-005932
I1025 22:47:59.153975 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | I1025 22:47:59.153827 720476 retry.go:31] will retry after 3.581762967s: waiting for domain to come up
I1025 22:48:02.738207 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:02.738775 720410 main.go:141] libmachine: (old-k8s-version-005932) found domain IP: 192.168.39.215
I1025 22:48:02.738821 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has current primary IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:02.738835 720410 main.go:141] libmachine: (old-k8s-version-005932) reserving static IP address...
I1025 22:48:02.739148 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-005932", mac: "52:54:00:fd:66:94", ip: "192.168.39.215"} in network mk-old-k8s-version-005932
I1025 22:48:02.818785 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | Getting to WaitForSSH function...
I1025 22:48:02.818819 720410 main.go:141] libmachine: (old-k8s-version-005932) reserved static IP address 192.168.39.215 for domain old-k8s-version-005932
I1025 22:48:02.818834 720410 main.go:141] libmachine: (old-k8s-version-005932) waiting for SSH...
I1025 22:48:02.822044 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:02.822493 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:minikube Clientid:01:52:54:00:fd:66:94}
I1025 22:48:02.822520 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:02.822715 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | Using SSH client type: external
I1025 22:48:02.822766 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | Using SSH private key: /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa (-rw-------)
I1025 22:48:02.822802 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.215 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa -p 22] /usr/bin/ssh <nil>}
I1025 22:48:02.822820 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | About to run SSH command:
I1025 22:48:02.822835 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | exit 0
I1025 22:48:02.957071 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | SSH cmd err, output: <nil>:
I1025 22:48:02.957297 720410 main.go:141] libmachine: (old-k8s-version-005932) KVM machine creation complete
I1025 22:48:02.957652 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetConfigRaw
I1025 22:48:02.958242 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:02.958441 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:02.958634 720410 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1025 22:48:02.958647 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetState
I1025 22:48:02.960012 720410 main.go:141] libmachine: Detecting operating system of created instance...
I1025 22:48:02.960028 720410 main.go:141] libmachine: Waiting for SSH to be available...
I1025 22:48:02.960035 720410 main.go:141] libmachine: Getting to WaitForSSH function...
I1025 22:48:02.960044 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:02.962569 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:02.962946 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:02.962983 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:02.963125 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:02.963285 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:02.963479 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:02.963659 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:02.963849 720410 main.go:141] libmachine: Using SSH client type: native
I1025 22:48:02.964102 720410 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865fa0] 0x868c80 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I1025 22:48:02.964117 720410 main.go:141] libmachine: About to run SSH command:
exit 0
I1025 22:48:03.076511 720410 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1025 22:48:03.076535 720410 main.go:141] libmachine: Detecting the provisioner...
I1025 22:48:03.076544 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:03.079865 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.080309 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:03.080342 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.080451 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:03.080665 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:03.080867 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:03.081067 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:03.081283 720410 main.go:141] libmachine: Using SSH client type: native
I1025 22:48:03.081508 720410 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865fa0] 0x868c80 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I1025 22:48:03.081525 720410 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1025 22:48:03.202339 720410 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1025 22:48:03.202472 720410 main.go:141] libmachine: found compatible host: buildroot
I1025 22:48:03.202489 720410 main.go:141] libmachine: Provisioning with buildroot...
I1025 22:48:03.202503 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetMachineName
I1025 22:48:03.202827 720410 buildroot.go:166] provisioning hostname "old-k8s-version-005932"
I1025 22:48:03.202860 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetMachineName
I1025 22:48:03.203078 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:03.206236 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.206763 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:03.206807 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.206972 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:03.207151 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:03.207371 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:03.207534 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:03.207737 720410 main.go:141] libmachine: Using SSH client type: native
I1025 22:48:03.207964 720410 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865fa0] 0x868c80 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I1025 22:48:03.207982 720410 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-005932 && echo "old-k8s-version-005932" | sudo tee /etc/hostname
I1025 22:48:03.337255 720410 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-005932
I1025 22:48:03.337293 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:03.340814 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.341338 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:03.341370 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.341595 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:03.341860 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:03.342070 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:03.342316 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:03.342535 720410 main.go:141] libmachine: Using SSH client type: native
I1025 22:48:03.342770 720410 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865fa0] 0x868c80 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I1025 22:48:03.342811 720410 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-005932' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-005932/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-005932' | sudo tee -a /etc/hosts;
fi
fi
I1025 22:48:03.470720 720410 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1025 22:48:03.470754 720410 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19758-661979/.minikube CaCertPath:/home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19758-661979/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19758-661979/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19758-661979/.minikube}
I1025 22:48:03.470774 720410 buildroot.go:174] setting up certificates
I1025 22:48:03.470786 720410 provision.go:84] configureAuth start
I1025 22:48:03.470795 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetMachineName
I1025 22:48:03.471068 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetIP
I1025 22:48:03.474161 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.474664 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:03.474691 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.474908 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:03.477526 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.477941 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:03.477961 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:03.478133 720410 provision.go:143] copyHostCerts
I1025 22:48:03.478212 720410 exec_runner.go:144] found /home/jenkins/minikube-integration/19758-661979/.minikube/ca.pem, removing ...
I1025 22:48:03.478227 720410 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19758-661979/.minikube/ca.pem
I1025 22:48:03.478291 720410 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19758-661979/.minikube/ca.pem (1082 bytes)
I1025 22:48:03.478424 720410 exec_runner.go:144] found /home/jenkins/minikube-integration/19758-661979/.minikube/cert.pem, removing ...
I1025 22:48:03.478436 720410 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19758-661979/.minikube/cert.pem
I1025 22:48:03.478476 720410 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19758-661979/.minikube/cert.pem (1123 bytes)
I1025 22:48:03.478567 720410 exec_runner.go:144] found /home/jenkins/minikube-integration/19758-661979/.minikube/key.pem, removing ...
I1025 22:48:03.478579 720410 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19758-661979/.minikube/key.pem
I1025 22:48:03.478608 720410 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19758-661979/.minikube/key.pem (1675 bytes)
I1025 22:48:03.478702 720410 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19758-661979/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-005932 san=[127.0.0.1 192.168.39.215 localhost minikube old-k8s-version-005932]
I1025 22:48:04.226796 720410 provision.go:177] copyRemoteCerts
I1025 22:48:04.226859 720410 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1025 22:48:04.226886 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:04.229745 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.230164 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.230197 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.230408 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:04.230631 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.230841 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:04.231002 720410 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa Username:docker}
I1025 22:48:04.324599 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1025 22:48:04.352065 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1025 22:48:04.379612 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1025 22:48:04.411343 720410 provision.go:87] duration metric: took 940.540579ms to configureAuth
I1025 22:48:04.411380 720410 buildroot.go:189] setting minikube options for container-runtime
I1025 22:48:04.411597 720410 config.go:182] Loaded profile config "old-k8s-version-005932": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I1025 22:48:04.411722 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:04.415074 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.415442 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.415475 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.415598 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:04.415804 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.416038 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.416191 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:04.416352 720410 main.go:141] libmachine: Using SSH client type: native
I1025 22:48:04.416521 720410 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865fa0] 0x868c80 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I1025 22:48:04.416538 720410 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1025 22:48:04.663703 720410 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1025 22:48:04.663734 720410 main.go:141] libmachine: Checking connection to Docker...
I1025 22:48:04.663745 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetURL
I1025 22:48:04.665176 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | using libvirt version 6000000
I1025 22:48:04.667421 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.667839 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.667862 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.668191 720410 main.go:141] libmachine: Docker is up and running!
I1025 22:48:04.668229 720410 main.go:141] libmachine: Reticulating splines...
I1025 22:48:04.668238 720410 client.go:171] duration metric: took 24.37134628s to LocalClient.Create
I1025 22:48:04.668264 720410 start.go:167] duration metric: took 24.371419777s to libmachine.API.Create "old-k8s-version-005932"
I1025 22:48:04.668275 720410 start.go:293] postStartSetup for "old-k8s-version-005932" (driver="kvm2")
I1025 22:48:04.668285 720410 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1025 22:48:04.668304 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:04.668597 720410 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1025 22:48:04.668644 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:04.671270 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.671751 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.671794 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.671874 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:04.672086 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.672266 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:04.672427 720410 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa Username:docker}
I1025 22:48:04.767813 720410 ssh_runner.go:195] Run: cat /etc/os-release
I1025 22:48:04.772516 720410 info.go:137] Remote host: Buildroot 2023.02.9
I1025 22:48:04.772545 720410 filesync.go:126] Scanning /home/jenkins/minikube-integration/19758-661979/.minikube/addons for local assets ...
I1025 22:48:04.772621 720410 filesync.go:126] Scanning /home/jenkins/minikube-integration/19758-661979/.minikube/files for local assets ...
I1025 22:48:04.772737 720410 filesync.go:149] local asset: /home/jenkins/minikube-integration/19758-661979/.minikube/files/etc/ssl/certs/6691772.pem -> 6691772.pem in /etc/ssl/certs
I1025 22:48:04.772868 720410 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1025 22:48:04.783603 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/files/etc/ssl/certs/6691772.pem --> /etc/ssl/certs/6691772.pem (1708 bytes)
I1025 22:48:04.813896 720410 start.go:296] duration metric: took 145.603352ms for postStartSetup
I1025 22:48:04.813969 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetConfigRaw
I1025 22:48:04.814671 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetIP
I1025 22:48:04.817546 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.817992 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.818026 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.818299 720410 profile.go:143] Saving config to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/config.json ...
I1025 22:48:04.818498 720410 start.go:128] duration metric: took 24.544461525s to createHost
I1025 22:48:04.818528 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:04.821268 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.821705 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.821738 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.821844 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:04.822038 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.822349 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.822642 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:04.822866 720410 main.go:141] libmachine: Using SSH client type: native
I1025 22:48:04.823059 720410 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865fa0] 0x868c80 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I1025 22:48:04.823073 720410 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1025 22:48:04.946257 720410 main.go:141] libmachine: SSH cmd err, output: <nil>: 1729896484.915487223
I1025 22:48:04.946285 720410 fix.go:216] guest clock: 1729896484.915487223
I1025 22:48:04.946295 720410 fix.go:229] Guest: 2024-10-25 22:48:04.915487223 +0000 UTC Remote: 2024-10-25 22:48:04.818514507 +0000 UTC m=+28.093023756 (delta=96.972716ms)
I1025 22:48:04.946347 720410 fix.go:200] guest clock delta is within tolerance: 96.972716ms
I1025 22:48:04.946357 720410 start.go:83] releasing machines lock for "old-k8s-version-005932", held for 24.672459301s
I1025 22:48:04.946401 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:04.946712 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetIP
I1025 22:48:04.950006 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.950419 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.950451 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.950580 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:04.951155 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:04.951349 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .DriverName
I1025 22:48:04.951440 720410 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1025 22:48:04.951505 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:04.951614 720410 ssh_runner.go:195] Run: cat /version.json
I1025 22:48:04.951643 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHHostname
I1025 22:48:04.954492 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.954781 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.954911 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.954956 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.955043 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:04.955128 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:04.955149 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:04.955189 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.955314 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHPort
I1025 22:48:04.955377 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:04.955512 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHKeyPath
I1025 22:48:04.955587 720410 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa Username:docker}
I1025 22:48:04.955658 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetSSHUsername
I1025 22:48:04.955810 720410 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19758-661979/.minikube/machines/old-k8s-version-005932/id_rsa Username:docker}
I1025 22:48:05.065371 720410 ssh_runner.go:195] Run: systemctl --version
I1025 22:48:05.074598 720410 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1025 22:48:05.246509 720410 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1025 22:48:05.253803 720410 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1025 22:48:05.253883 720410 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1025 22:48:05.271142 720410 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1025 22:48:05.271182 720410 start.go:495] detecting cgroup driver to use...
I1025 22:48:05.271266 720410 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1025 22:48:05.293511 720410 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1025 22:48:05.310082 720410 docker.go:217] disabling cri-docker service (if available) ...
I1025 22:48:05.310153 720410 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1025 22:48:05.327016 720410 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1025 22:48:05.342097 720410 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1025 22:48:05.488441 720410 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1025 22:48:05.668508 720410 docker.go:233] disabling docker service ...
I1025 22:48:05.668598 720410 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1025 22:48:05.689639 720410 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1025 22:48:05.707617 720410 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1025 22:48:05.888914 720410 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1025 22:48:06.057330 720410 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1025 22:48:06.076889 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1025 22:48:06.108396 720410 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I1025 22:48:06.108477 720410 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I1025 22:48:06.122878 720410 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1025 22:48:06.122960 720410 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1025 22:48:06.136877 720410 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1025 22:48:06.151587 720410 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1025 22:48:06.164939 720410 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1025 22:48:06.181180 720410 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1025 22:48:06.195160 720410 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1025 22:48:06.195240 720410 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1025 22:48:06.214393 720410 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1025 22:48:06.226225 720410 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1025 22:48:06.379416 720410 ssh_runner.go:195] Run: sudo systemctl restart crio
I1025 22:48:06.481060 720410 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I1025 22:48:06.481171 720410 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1025 22:48:06.487758 720410 start.go:563] Will wait 60s for crictl version
I1025 22:48:06.487834 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:06.492973 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1025 22:48:06.543782 720410 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I1025 22:48:06.543883 720410 ssh_runner.go:195] Run: crio --version
I1025 22:48:06.575072 720410 ssh_runner.go:195] Run: crio --version
I1025 22:48:06.612758 720410 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I1025 22:48:06.614087 720410 main.go:141] libmachine: (old-k8s-version-005932) Calling .GetIP
I1025 22:48:06.618134 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:06.618644 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fd:66:94", ip: ""} in network mk-old-k8s-version-005932: {Iface:virbr3 ExpiryTime:2024-10-25 23:47:57 +0000 UTC Type:0 Mac:52:54:00:fd:66:94 Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:old-k8s-version-005932 Clientid:01:52:54:00:fd:66:94}
I1025 22:48:06.618683 720410 main.go:141] libmachine: (old-k8s-version-005932) DBG | domain old-k8s-version-005932 has defined IP address 192.168.39.215 and MAC address 52:54:00:fd:66:94 in network mk-old-k8s-version-005932
I1025 22:48:06.618889 720410 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I1025 22:48:06.623913 720410 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1025 22:48:06.644160 720410 kubeadm.go:883] updating cluster {Name:old-k8s-version-005932 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729002334-19806@sha256:40e85bdbd09a1ee487c66779d8bda357f3aa054bb4ec597b30029882beba918e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-005932 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.215 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1025 22:48:06.644305 720410 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1025 22:48:06.644364 720410 ssh_runner.go:195] Run: sudo crictl images --output json
I1025 22:48:06.680786 720410 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1025 22:48:06.680895 720410 ssh_runner.go:195] Run: which lz4
I1025 22:48:06.685318 720410 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I1025 22:48:06.689952 720410 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1025 22:48:06.689983 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I1025 22:48:08.461146 720410 crio.go:462] duration metric: took 1.775859012s to copy over tarball
I1025 22:48:08.461266 720410 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I1025 22:48:11.168929 720410 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.707616501s)
I1025 22:48:11.168974 720410 crio.go:469] duration metric: took 2.70778646s to extract the tarball
I1025 22:48:11.168986 720410 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1025 22:48:11.211061 720410 ssh_runner.go:195] Run: sudo crictl images --output json
I1025 22:48:11.255609 720410 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1025 22:48:11.255647 720410 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I1025 22:48:11.255723 720410 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.255759 720410 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:11.255772 720410 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I1025 22:48:11.255778 720410 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I1025 22:48:11.255729 720410 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I1025 22:48:11.255758 720410 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I1025 22:48:11.255882 720410 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.255742 720410 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.257547 720410 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I1025 22:48:11.257555 720410 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I1025 22:48:11.257578 720410 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I1025 22:48:11.257562 720410 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.257595 720410 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.257547 720410 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:11.257638 720410 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.257671 720410 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I1025 22:48:11.417381 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.423430 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.436740 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.450247 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I1025 22:48:11.477021 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I1025 22:48:11.486123 720410 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I1025 22:48:11.486171 720410 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.486219 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.487402 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I1025 22:48:11.494040 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:11.508588 720410 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I1025 22:48:11.508651 720410 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.508703 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.556732 720410 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I1025 22:48:11.556781 720410 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.556836 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.562713 720410 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I1025 22:48:11.562764 720410 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I1025 22:48:11.562816 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.615205 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.615218 720410 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I1025 22:48:11.615277 720410 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I1025 22:48:11.615321 720410 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:11.615358 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.615373 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.615389 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.615292 720410 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I1025 22:48:11.615442 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1025 22:48:11.615452 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.615225 720410 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I1025 22:48:11.615508 720410 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I1025 22:48:11.615535 720410 ssh_runner.go:195] Run: which crictl
I1025 22:48:11.717496 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.730654 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.730664 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:11.730731 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1025 22:48:11.730808 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.734507 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1025 22:48:11.734509 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1025 22:48:11.809009 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1025 22:48:11.879006 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1025 22:48:11.895038 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1025 22:48:11.901007 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1025 22:48:11.901146 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:11.904639 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1025 22:48:11.904647 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1025 22:48:11.976839 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I1025 22:48:12.019770 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1025 22:48:12.060033 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I1025 22:48:12.060117 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1025 22:48:12.060141 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I1025 22:48:12.083889 720410 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1025 22:48:12.083936 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I1025 22:48:12.118277 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I1025 22:48:12.131674 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I1025 22:48:12.144797 720410 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I1025 22:48:12.422202 720410 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I1025 22:48:12.566436 720410 cache_images.go:92] duration metric: took 1.310765759s to LoadCachedImages
W1025 22:48:12.566533 720410 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19758-661979/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I1025 22:48:12.566552 720410 kubeadm.go:934] updating node { 192.168.39.215 8443 v1.20.0 crio true true} ...
I1025 22:48:12.566692 720410 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-005932 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.215
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-005932 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1025 22:48:12.566781 720410 ssh_runner.go:195] Run: crio config
I1025 22:48:12.618477 720410 cni.go:84] Creating CNI manager for ""
I1025 22:48:12.618510 720410 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1025 22:48:12.618524 720410 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1025 22:48:12.618554 720410 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.215 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-005932 NodeName:old-k8s-version-005932 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.215"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.215 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1025 22:48:12.618743 720410 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.215
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-005932"
kubeletExtraArgs:
node-ip: 192.168.39.215
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.215"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1025 22:48:12.618820 720410 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1025 22:48:12.629775 720410 binaries.go:44] Found k8s binaries, skipping transfer
I1025 22:48:12.629860 720410 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1025 22:48:12.640404 720410 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I1025 22:48:12.657684 720410 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1025 22:48:12.676828 720410 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I1025 22:48:12.696552 720410 ssh_runner.go:195] Run: grep 192.168.39.215 control-plane.minikube.internal$ /etc/hosts
I1025 22:48:12.701952 720410 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.215 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1025 22:48:12.714622 720410 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1025 22:48:12.846997 720410 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1025 22:48:12.863720 720410 certs.go:68] Setting up /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932 for IP: 192.168.39.215
I1025 22:48:12.863753 720410 certs.go:194] generating shared ca certs ...
I1025 22:48:12.863778 720410 certs.go:226] acquiring lock for ca certs: {Name:mkb3c0b02dcf77d22d8e250175d24731a46db4bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:12.863955 720410 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19758-661979/.minikube/ca.key
I1025 22:48:12.864025 720410 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19758-661979/.minikube/proxy-client-ca.key
I1025 22:48:12.864039 720410 certs.go:256] generating profile certs ...
I1025 22:48:12.864111 720410 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/client.key
I1025 22:48:12.864130 720410 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/client.crt with IP's: []
I1025 22:48:13.120690 720410 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/client.crt ...
I1025 22:48:13.120724 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/client.crt: {Name:mkb25e4b27898e24fd6f06069cb6f8fcdb024907 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:13.120924 720410 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/client.key ...
I1025 22:48:13.120943 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/client.key: {Name:mkcfd190b90697daed4d642707174145f6f920ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:13.121078 720410 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.key.fb60c9ca
I1025 22:48:13.121109 720410 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.crt.fb60c9ca with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.215]
I1025 22:48:13.300666 720410 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.crt.fb60c9ca ...
I1025 22:48:13.300698 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.crt.fb60c9ca: {Name:mk4ebe75859114a4b51b5b243dc769b64c816470 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:13.300898 720410 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.key.fb60c9ca ...
I1025 22:48:13.300919 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.key.fb60c9ca: {Name:mk069f1ab7484d0be783774fd4ec86c8ac483662 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:13.301046 720410 certs.go:381] copying /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.crt.fb60c9ca -> /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.crt
I1025 22:48:13.301148 720410 certs.go:385] copying /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.key.fb60c9ca -> /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.key
I1025 22:48:13.301261 720410 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.key
I1025 22:48:13.301288 720410 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.crt with IP's: []
I1025 22:48:13.457985 720410 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.crt ...
I1025 22:48:13.458023 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.crt: {Name:mkde74935c30cd4c94113a0ee5df5e268dea234c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:13.540569 720410 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.key ...
I1025 22:48:13.540622 720410 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.key: {Name:mk5addb08ece68ac0b4420267af1dd44d9b88e34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1025 22:48:13.540925 720410 certs.go:484] found cert: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/669177.pem (1338 bytes)
W1025 22:48:13.541064 720410 certs.go:480] ignoring /home/jenkins/minikube-integration/19758-661979/.minikube/certs/669177_empty.pem, impossibly tiny 0 bytes
I1025 22:48:13.541083 720410 certs.go:484] found cert: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca-key.pem (1679 bytes)
I1025 22:48:13.541116 720410 certs.go:484] found cert: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/ca.pem (1082 bytes)
I1025 22:48:13.541147 720410 certs.go:484] found cert: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/cert.pem (1123 bytes)
I1025 22:48:13.541177 720410 certs.go:484] found cert: /home/jenkins/minikube-integration/19758-661979/.minikube/certs/key.pem (1675 bytes)
I1025 22:48:13.541228 720410 certs.go:484] found cert: /home/jenkins/minikube-integration/19758-661979/.minikube/files/etc/ssl/certs/6691772.pem (1708 bytes)
I1025 22:48:13.542093 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1025 22:48:13.570043 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1025 22:48:13.594232 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1025 22:48:13.619309 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1025 22:48:13.643913 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1025 22:48:13.683519 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1025 22:48:13.712588 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1025 22:48:13.742598 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/profiles/old-k8s-version-005932/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1025 22:48:13.776715 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1025 22:48:13.811704 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/certs/669177.pem --> /usr/share/ca-certificates/669177.pem (1338 bytes)
I1025 22:48:13.839609 720410 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19758-661979/.minikube/files/etc/ssl/certs/6691772.pem --> /usr/share/ca-certificates/6691772.pem (1708 bytes)
I1025 22:48:13.865878 720410 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1025 22:48:13.884273 720410 ssh_runner.go:195] Run: openssl version
I1025 22:48:13.890795 720410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/669177.pem && ln -fs /usr/share/ca-certificates/669177.pem /etc/ssl/certs/669177.pem"
I1025 22:48:13.903784 720410 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/669177.pem
I1025 22:48:13.908843 720410 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 25 21:46 /usr/share/ca-certificates/669177.pem
I1025 22:48:13.908911 720410 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/669177.pem
I1025 22:48:13.915282 720410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/669177.pem /etc/ssl/certs/51391683.0"
I1025 22:48:13.928243 720410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6691772.pem && ln -fs /usr/share/ca-certificates/6691772.pem /etc/ssl/certs/6691772.pem"
I1025 22:48:13.940353 720410 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6691772.pem
I1025 22:48:13.946111 720410 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 25 21:46 /usr/share/ca-certificates/6691772.pem
I1025 22:48:13.946171 720410 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6691772.pem
I1025 22:48:13.952605 720410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6691772.pem /etc/ssl/certs/3ec20f2e.0"
I1025 22:48:13.964601 720410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1025 22:48:13.976288 720410 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1025 22:48:13.981423 720410 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 25 21:36 /usr/share/ca-certificates/minikubeCA.pem
I1025 22:48:13.981490 720410 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1025 22:48:13.987259 720410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1025 22:48:13.999189 720410 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1025 22:48:14.005280 720410 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1025 22:48:14.005338 720410 kubeadm.go:392] StartCluster: {Name:old-k8s-version-005932 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729002334-19806@sha256:40e85bdbd09a1ee487c66779d8bda357f3aa054bb4ec597b30029882beba918e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-005932 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.215 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1025 22:48:14.005432 720410 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1025 22:48:14.005491 720410 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1025 22:48:14.059239 720410 cri.go:89] found id: ""
I1025 22:48:14.059320 720410 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1025 22:48:14.074285 720410 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1025 22:48:14.086200 720410 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1025 22:48:14.097808 720410 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1025 22:48:14.097834 720410 kubeadm.go:157] found existing configuration files:
I1025 22:48:14.097885 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1025 22:48:14.109437 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1025 22:48:14.109511 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1025 22:48:14.120292 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1025 22:48:14.130057 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1025 22:48:14.130141 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1025 22:48:14.143165 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1025 22:48:14.154274 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1025 22:48:14.154343 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1025 22:48:14.168495 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1025 22:48:14.180973 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1025 22:48:14.181045 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1025 22:48:14.194807 720410 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1025 22:48:14.339193 720410 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1025 22:48:14.339288 720410 kubeadm.go:310] [preflight] Running pre-flight checks
I1025 22:48:14.519585 720410 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1025 22:48:14.519763 720410 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1025 22:48:14.519916 720410 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1025 22:48:14.757954 720410 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1025 22:48:14.760996 720410 out.go:235] - Generating certificates and keys ...
I1025 22:48:14.761109 720410 kubeadm.go:310] [certs] Using existing ca certificate authority
I1025 22:48:14.761193 720410 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1025 22:48:14.867835 720410 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1025 22:48:15.166652 720410 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1025 22:48:15.272687 720410 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1025 22:48:15.699611 720410 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1025 22:48:15.979002 720410 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1025 22:48:15.979335 720410 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-005932] and IPs [192.168.39.215 127.0.0.1 ::1]
I1025 22:48:16.201278 720410 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1025 22:48:16.201486 720410 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-005932] and IPs [192.168.39.215 127.0.0.1 ::1]
I1025 22:48:16.347482 720410 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1025 22:48:16.602488 720410 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1025 22:48:16.918158 720410 kubeadm.go:310] [certs] Generating "sa" key and public key
I1025 22:48:16.918238 720410 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1025 22:48:17.050593 720410 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1025 22:48:17.202006 720410 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1025 22:48:17.367300 720410 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1025 22:48:17.837405 720410 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1025 22:48:17.859378 720410 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1025 22:48:17.868611 720410 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1025 22:48:17.868680 720410 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1025 22:48:18.040396 720410 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1025 22:48:18.042329 720410 out.go:235] - Booting up control plane ...
I1025 22:48:18.042465 720410 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1025 22:48:18.055429 720410 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1025 22:48:18.057549 720410 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1025 22:48:18.058621 720410 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1025 22:48:18.066500 720410 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1025 22:48:58.058860 720410 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1025 22:48:58.060321 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:48:58.060574 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:49:03.060647 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:49:03.060984 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:49:13.059785 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:49:13.060014 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:49:33.059061 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:49:33.059362 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:50:13.059727 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:50:13.060001 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:50:13.060041 720410 kubeadm.go:310]
I1025 22:50:13.060077 720410 kubeadm.go:310] Unfortunately, an error has occurred:
I1025 22:50:13.060110 720410 kubeadm.go:310] timed out waiting for the condition
I1025 22:50:13.060113 720410 kubeadm.go:310]
I1025 22:50:13.060162 720410 kubeadm.go:310] This error is likely caused by:
I1025 22:50:13.060216 720410 kubeadm.go:310] - The kubelet is not running
I1025 22:50:13.060331 720410 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1025 22:50:13.060340 720410 kubeadm.go:310]
I1025 22:50:13.060492 720410 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1025 22:50:13.060560 720410 kubeadm.go:310] - 'systemctl status kubelet'
I1025 22:50:13.060609 720410 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1025 22:50:13.060618 720410 kubeadm.go:310]
I1025 22:50:13.060778 720410 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1025 22:50:13.060905 720410 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1025 22:50:13.060918 720410 kubeadm.go:310]
I1025 22:50:13.061051 720410 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1025 22:50:13.061132 720410 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1025 22:50:13.061234 720410 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1025 22:50:13.061336 720410 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1025 22:50:13.061349 720410 kubeadm.go:310]
I1025 22:50:13.062055 720410 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1025 22:50:13.062148 720410 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1025 22:50:13.062219 720410 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W1025 22:50:13.062394 720410 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-005932] and IPs [192.168.39.215 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-005932] and IPs [192.168.39.215 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-005932] and IPs [192.168.39.215 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-005932] and IPs [192.168.39.215 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1025 22:50:13.062442 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I1025 22:50:13.516449 720410 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1025 22:50:13.531200 720410 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1025 22:50:13.541592 720410 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1025 22:50:13.541618 720410 kubeadm.go:157] found existing configuration files:
I1025 22:50:13.541671 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1025 22:50:13.550958 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1025 22:50:13.551022 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1025 22:50:13.560586 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1025 22:50:13.569987 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1025 22:50:13.570046 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1025 22:50:13.579264 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1025 22:50:13.588231 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1025 22:50:13.588288 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1025 22:50:13.597661 720410 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1025 22:50:13.606926 720410 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1025 22:50:13.606988 720410 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1025 22:50:13.616887 720410 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1025 22:50:13.683942 720410 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1025 22:50:13.684016 720410 kubeadm.go:310] [preflight] Running pre-flight checks
I1025 22:50:13.832032 720410 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1025 22:50:13.832173 720410 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1025 22:50:13.832333 720410 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1025 22:50:14.009956 720410 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1025 22:50:14.011823 720410 out.go:235] - Generating certificates and keys ...
I1025 22:50:14.011939 720410 kubeadm.go:310] [certs] Using existing ca certificate authority
I1025 22:50:14.012064 720410 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1025 22:50:14.012187 720410 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1025 22:50:14.012276 720410 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I1025 22:50:14.012377 720410 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I1025 22:50:14.012449 720410 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I1025 22:50:14.012540 720410 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I1025 22:50:14.012655 720410 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I1025 22:50:14.013271 720410 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1025 22:50:14.013983 720410 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1025 22:50:14.014180 720410 kubeadm.go:310] [certs] Using the existing "sa" key
I1025 22:50:14.014264 720410 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1025 22:50:14.448119 720410 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1025 22:50:14.604836 720410 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1025 22:50:14.838712 720410 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1025 22:50:15.392247 720410 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1025 22:50:15.412263 720410 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1025 22:50:15.413306 720410 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1025 22:50:15.413380 720410 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1025 22:50:15.556022 720410 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1025 22:50:15.557888 720410 out.go:235] - Booting up control plane ...
I1025 22:50:15.557998 720410 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1025 22:50:15.562139 720410 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1025 22:50:15.570720 720410 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1025 22:50:15.571789 720410 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1025 22:50:15.574563 720410 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1025 22:50:55.576874 720410 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1025 22:50:55.577017 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:50:55.577284 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:51:00.577815 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:51:00.578107 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:51:10.578801 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:51:10.579083 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:51:30.578568 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:51:30.578778 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:52:10.578929 720410 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1025 22:52:10.579153 720410 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1025 22:52:10.579168 720410 kubeadm.go:310]
I1025 22:52:10.579218 720410 kubeadm.go:310] Unfortunately, an error has occurred:
I1025 22:52:10.579307 720410 kubeadm.go:310] timed out waiting for the condition
I1025 22:52:10.579334 720410 kubeadm.go:310]
I1025 22:52:10.579385 720410 kubeadm.go:310] This error is likely caused by:
I1025 22:52:10.579420 720410 kubeadm.go:310] - The kubelet is not running
I1025 22:52:10.579564 720410 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1025 22:52:10.579600 720410 kubeadm.go:310]
I1025 22:52:10.579744 720410 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1025 22:52:10.579798 720410 kubeadm.go:310] - 'systemctl status kubelet'
I1025 22:52:10.579847 720410 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1025 22:52:10.579858 720410 kubeadm.go:310]
I1025 22:52:10.580005 720410 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1025 22:52:10.580132 720410 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1025 22:52:10.580145 720410 kubeadm.go:310]
I1025 22:52:10.580285 720410 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1025 22:52:10.580404 720410 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1025 22:52:10.580504 720410 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1025 22:52:10.580599 720410 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1025 22:52:10.580611 720410 kubeadm.go:310]
I1025 22:52:10.580895 720410 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1025 22:52:10.581056 720410 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1025 22:52:10.581168 720410 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I1025 22:52:10.581221 720410 kubeadm.go:394] duration metric: took 3m56.575887717s to StartCluster
I1025 22:52:10.581280 720410 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1025 22:52:10.581347 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1025 22:52:10.631733 720410 cri.go:89] found id: ""
I1025 22:52:10.631771 720410 logs.go:282] 0 containers: []
W1025 22:52:10.631779 720410 logs.go:284] No container was found matching "kube-apiserver"
I1025 22:52:10.631787 720410 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1025 22:52:10.631854 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1025 22:52:10.668172 720410 cri.go:89] found id: ""
I1025 22:52:10.668204 720410 logs.go:282] 0 containers: []
W1025 22:52:10.668213 720410 logs.go:284] No container was found matching "etcd"
I1025 22:52:10.668219 720410 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1025 22:52:10.668279 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1025 22:52:10.702685 720410 cri.go:89] found id: ""
I1025 22:52:10.702716 720410 logs.go:282] 0 containers: []
W1025 22:52:10.702727 720410 logs.go:284] No container was found matching "coredns"
I1025 22:52:10.702746 720410 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1025 22:52:10.702816 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1025 22:52:10.739470 720410 cri.go:89] found id: ""
I1025 22:52:10.739509 720410 logs.go:282] 0 containers: []
W1025 22:52:10.739521 720410 logs.go:284] No container was found matching "kube-scheduler"
I1025 22:52:10.739529 720410 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1025 22:52:10.739584 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1025 22:52:10.772856 720410 cri.go:89] found id: ""
I1025 22:52:10.772885 720410 logs.go:282] 0 containers: []
W1025 22:52:10.772893 720410 logs.go:284] No container was found matching "kube-proxy"
I1025 22:52:10.772898 720410 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1025 22:52:10.772969 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1025 22:52:10.808401 720410 cri.go:89] found id: ""
I1025 22:52:10.808434 720410 logs.go:282] 0 containers: []
W1025 22:52:10.808451 720410 logs.go:284] No container was found matching "kube-controller-manager"
I1025 22:52:10.808458 720410 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1025 22:52:10.808512 720410 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1025 22:52:10.842968 720410 cri.go:89] found id: ""
I1025 22:52:10.842999 720410 logs.go:282] 0 containers: []
W1025 22:52:10.843008 720410 logs.go:284] No container was found matching "kindnet"
I1025 22:52:10.843019 720410 logs.go:123] Gathering logs for kubelet ...
I1025 22:52:10.843032 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1025 22:52:10.894603 720410 logs.go:123] Gathering logs for dmesg ...
I1025 22:52:10.894636 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1025 22:52:10.908999 720410 logs.go:123] Gathering logs for describe nodes ...
I1025 22:52:10.909033 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1025 22:52:11.032160 720410 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1025 22:52:11.032186 720410 logs.go:123] Gathering logs for CRI-O ...
I1025 22:52:11.032201 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1025 22:52:11.138969 720410 logs.go:123] Gathering logs for container status ...
I1025 22:52:11.139029 720410 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W1025 22:52:11.180565 720410 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1025 22:52:11.180630 720410 out.go:270] *
*
W1025 22:52:11.180687 720410 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1025 22:52:11.180700 720410 out.go:270] *
*
W1025 22:52:11.181591 720410 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1025 22:52:11.185263 720410 out.go:201]
W1025 22:52:11.186489 720410 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1025 22:52:11.186538 720410 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1025 22:52:11.186557 720410 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1025 22:52:11.187860 720410 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-005932 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-005932 -n old-k8s-version-005932
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-005932 -n old-k8s-version-005932: exit status 6 (245.219057ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1025 22:52:11.474801 725849 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-005932" does not appear in /home/jenkins/minikube-integration/19758-661979/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-005932" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.77s)