=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-593412 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-593412 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m44.708355508s)
-- stdout --
* [old-k8s-version-593412] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19672
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19672-9614/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-9614/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-593412" primary control-plane node in "old-k8s-version-593412" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0920 22:10:31.562128 61195 out.go:345] Setting OutFile to fd 1 ...
I0920 22:10:31.562244 61195 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 22:10:31.562253 61195 out.go:358] Setting ErrFile to fd 2...
I0920 22:10:31.562258 61195 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 22:10:31.562433 61195 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19672-9614/.minikube/bin
I0920 22:10:31.563037 61195 out.go:352] Setting JSON to false
I0920 22:10:31.563920 61195 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":6780,"bootTime":1726863452,"procs":212,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0920 22:10:31.564025 61195 start.go:139] virtualization: kvm guest
I0920 22:10:31.566322 61195 out.go:177] * [old-k8s-version-593412] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0920 22:10:31.567952 61195 notify.go:220] Checking for updates...
I0920 22:10:31.567975 61195 out.go:177] - MINIKUBE_LOCATION=19672
I0920 22:10:31.569500 61195 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 22:10:31.571072 61195 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19672-9614/kubeconfig
I0920 22:10:31.572304 61195 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-9614/.minikube
I0920 22:10:31.573401 61195 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0920 22:10:31.574474 61195 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 22:10:31.576116 61195 config.go:182] Loaded profile config "cert-expiration-673228": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 22:10:31.576280 61195 config.go:182] Loaded profile config "cert-options-335786": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 22:10:31.576404 61195 config.go:182] Loaded profile config "kubernetes-upgrade-696728": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 22:10:31.576515 61195 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 22:10:31.611702 61195 out.go:177] * Using the kvm2 driver based on user configuration
I0920 22:10:31.612941 61195 start.go:297] selected driver: kvm2
I0920 22:10:31.612956 61195 start.go:901] validating driver "kvm2" against <nil>
I0920 22:10:31.612967 61195 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 22:10:31.613790 61195 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 22:10:31.613883 61195 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19672-9614/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0920 22:10:31.631689 61195 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0920 22:10:31.631749 61195 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 22:10:31.632059 61195 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 22:10:31.632094 61195 cni.go:84] Creating CNI manager for ""
I0920 22:10:31.632148 61195 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0920 22:10:31.632158 61195 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0920 22:10:31.632217 61195 start.go:340] cluster config:
{Name:old-k8s-version-593412 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-593412 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 22:10:31.632357 61195 iso.go:125] acquiring lock: {Name:mk1ccde703058df9ac74e8f7388117bc62d90ea2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 22:10:31.634549 61195 out.go:177] * Starting "old-k8s-version-593412" primary control-plane node in "old-k8s-version-593412" cluster
I0920 22:10:31.635904 61195 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0920 22:10:31.635977 61195 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0920 22:10:31.635991 61195 cache.go:56] Caching tarball of preloaded images
I0920 22:10:31.636084 61195 preload.go:172] Found /home/jenkins/minikube-integration/19672-9614/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0920 22:10:31.636097 61195 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0920 22:10:31.636223 61195 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/config.json ...
I0920 22:10:31.636255 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/config.json: {Name:mk099905874d4790d3cd5d40a42020a73df0478f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:10:31.636897 61195 start.go:360] acquireMachinesLock for old-k8s-version-593412: {Name:mk05e9a22914d0a2faa27183f9c04ab590ad3d64 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0920 22:10:45.640257 61195 start.go:364] duration metric: took 14.003272272s to acquireMachinesLock for "old-k8s-version-593412"
I0920 22:10:45.640349 61195 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-593412 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19672/minikube-v1.34.0-1726784654-19672-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-593412 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0920 22:10:45.640468 61195 start.go:125] createHost starting for "" (driver="kvm2")
I0920 22:10:45.642513 61195 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0920 22:10:45.642738 61195 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0920 22:10:45.642789 61195 main.go:141] libmachine: Launching plugin server for driver kvm2
I0920 22:10:45.663541 61195 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43127
I0920 22:10:45.663964 61195 main.go:141] libmachine: () Calling .GetVersion
I0920 22:10:45.664612 61195 main.go:141] libmachine: Using API Version 1
I0920 22:10:45.664634 61195 main.go:141] libmachine: () Calling .SetConfigRaw
I0920 22:10:45.664979 61195 main.go:141] libmachine: () Calling .GetMachineName
I0920 22:10:45.665198 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetMachineName
I0920 22:10:45.665369 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:10:45.665551 61195 start.go:159] libmachine.API.Create for "old-k8s-version-593412" (driver="kvm2")
I0920 22:10:45.665601 61195 client.go:168] LocalClient.Create starting
I0920 22:10:45.665637 61195 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca.pem
I0920 22:10:45.665680 61195 main.go:141] libmachine: Decoding PEM data...
I0920 22:10:45.665702 61195 main.go:141] libmachine: Parsing certificate...
I0920 22:10:45.665768 61195 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19672-9614/.minikube/certs/cert.pem
I0920 22:10:45.665795 61195 main.go:141] libmachine: Decoding PEM data...
I0920 22:10:45.665810 61195 main.go:141] libmachine: Parsing certificate...
I0920 22:10:45.665839 61195 main.go:141] libmachine: Running pre-create checks...
I0920 22:10:45.665850 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .PreCreateCheck
I0920 22:10:45.666243 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetConfigRaw
I0920 22:10:45.666732 61195 main.go:141] libmachine: Creating machine...
I0920 22:10:45.666751 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .Create
I0920 22:10:45.666994 61195 main.go:141] libmachine: (old-k8s-version-593412) Creating KVM machine...
I0920 22:10:45.668387 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found existing default KVM network
I0920 22:10:45.669996 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:45.669811 61331 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b2:f2:5e} reservation:<nil>}
I0920 22:10:45.670933 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:45.670839 61331 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:9e:f3:10} reservation:<nil>}
I0920 22:10:45.672026 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:45.671929 61331 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002850f0}
I0920 22:10:45.672054 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | created network xml:
I0920 22:10:45.672067 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | <network>
I0920 22:10:45.672076 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | <name>mk-old-k8s-version-593412</name>
I0920 22:10:45.672090 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | <dns enable='no'/>
I0920 22:10:45.672097 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG |
I0920 22:10:45.672107 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0920 22:10:45.672115 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | <dhcp>
I0920 22:10:45.672153 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0920 22:10:45.672174 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | </dhcp>
I0920 22:10:45.672185 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | </ip>
I0920 22:10:45.672193 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG |
I0920 22:10:45.672202 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | </network>
I0920 22:10:45.672210 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG |
I0920 22:10:45.677676 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | trying to create private KVM network mk-old-k8s-version-593412 192.168.61.0/24...
I0920 22:10:45.753070 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | private KVM network mk-old-k8s-version-593412 192.168.61.0/24 created
I0920 22:10:45.753111 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting up store path in /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412 ...
I0920 22:10:45.753126 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:45.752996 61331 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19672-9614/.minikube
I0920 22:10:45.753192 61195 main.go:141] libmachine: (old-k8s-version-593412) Building disk image from file:///home/jenkins/minikube-integration/19672-9614/.minikube/cache/iso/amd64/minikube-v1.34.0-1726784654-19672-amd64.iso
I0920 22:10:45.753226 61195 main.go:141] libmachine: (old-k8s-version-593412) Downloading /home/jenkins/minikube-integration/19672-9614/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19672-9614/.minikube/cache/iso/amd64/minikube-v1.34.0-1726784654-19672-amd64.iso...
I0920 22:10:46.015026 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:46.014890 61331 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa...
I0920 22:10:46.210076 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:46.209946 61331 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/old-k8s-version-593412.rawdisk...
I0920 22:10:46.210105 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Writing magic tar header
I0920 22:10:46.210143 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Writing SSH key tar header
I0920 22:10:46.210181 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:46.210083 61331 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412 ...
I0920 22:10:46.210207 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412
I0920 22:10:46.210328 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting executable bit set on /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412 (perms=drwx------)
I0920 22:10:46.210357 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting executable bit set on /home/jenkins/minikube-integration/19672-9614/.minikube/machines (perms=drwxr-xr-x)
I0920 22:10:46.210372 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-9614/.minikube/machines
I0920 22:10:46.210390 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting executable bit set on /home/jenkins/minikube-integration/19672-9614/.minikube (perms=drwxr-xr-x)
I0920 22:10:46.210408 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting executable bit set on /home/jenkins/minikube-integration/19672-9614 (perms=drwxrwxr-x)
I0920 22:10:46.210419 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0920 22:10:46.210430 61195 main.go:141] libmachine: (old-k8s-version-593412) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0920 22:10:46.210437 61195 main.go:141] libmachine: (old-k8s-version-593412) Creating domain...
I0920 22:10:46.210454 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-9614/.minikube
I0920 22:10:46.210463 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-9614
I0920 22:10:46.210490 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0920 22:10:46.210503 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home/jenkins
I0920 22:10:46.210517 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Checking permissions on dir: /home
I0920 22:10:46.210526 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Skipping /home - not owner
I0920 22:10:46.211502 61195 main.go:141] libmachine: (old-k8s-version-593412) define libvirt domain using xml:
I0920 22:10:46.211523 61195 main.go:141] libmachine: (old-k8s-version-593412) <domain type='kvm'>
I0920 22:10:46.211533 61195 main.go:141] libmachine: (old-k8s-version-593412) <name>old-k8s-version-593412</name>
I0920 22:10:46.211546 61195 main.go:141] libmachine: (old-k8s-version-593412) <memory unit='MiB'>2200</memory>
I0920 22:10:46.211554 61195 main.go:141] libmachine: (old-k8s-version-593412) <vcpu>2</vcpu>
I0920 22:10:46.211564 61195 main.go:141] libmachine: (old-k8s-version-593412) <features>
I0920 22:10:46.211572 61195 main.go:141] libmachine: (old-k8s-version-593412) <acpi/>
I0920 22:10:46.211599 61195 main.go:141] libmachine: (old-k8s-version-593412) <apic/>
I0920 22:10:46.211608 61195 main.go:141] libmachine: (old-k8s-version-593412) <pae/>
I0920 22:10:46.211613 61195 main.go:141] libmachine: (old-k8s-version-593412)
I0920 22:10:46.211638 61195 main.go:141] libmachine: (old-k8s-version-593412) </features>
I0920 22:10:46.211660 61195 main.go:141] libmachine: (old-k8s-version-593412) <cpu mode='host-passthrough'>
I0920 22:10:46.211670 61195 main.go:141] libmachine: (old-k8s-version-593412)
I0920 22:10:46.211679 61195 main.go:141] libmachine: (old-k8s-version-593412) </cpu>
I0920 22:10:46.211703 61195 main.go:141] libmachine: (old-k8s-version-593412) <os>
I0920 22:10:46.211715 61195 main.go:141] libmachine: (old-k8s-version-593412) <type>hvm</type>
I0920 22:10:46.211734 61195 main.go:141] libmachine: (old-k8s-version-593412) <boot dev='cdrom'/>
I0920 22:10:46.211750 61195 main.go:141] libmachine: (old-k8s-version-593412) <boot dev='hd'/>
I0920 22:10:46.211759 61195 main.go:141] libmachine: (old-k8s-version-593412) <bootmenu enable='no'/>
I0920 22:10:46.211765 61195 main.go:141] libmachine: (old-k8s-version-593412) </os>
I0920 22:10:46.211773 61195 main.go:141] libmachine: (old-k8s-version-593412) <devices>
I0920 22:10:46.211780 61195 main.go:141] libmachine: (old-k8s-version-593412) <disk type='file' device='cdrom'>
I0920 22:10:46.211792 61195 main.go:141] libmachine: (old-k8s-version-593412) <source file='/home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/boot2docker.iso'/>
I0920 22:10:46.211800 61195 main.go:141] libmachine: (old-k8s-version-593412) <target dev='hdc' bus='scsi'/>
I0920 22:10:46.211810 61195 main.go:141] libmachine: (old-k8s-version-593412) <readonly/>
I0920 22:10:46.211830 61195 main.go:141] libmachine: (old-k8s-version-593412) </disk>
I0920 22:10:46.211839 61195 main.go:141] libmachine: (old-k8s-version-593412) <disk type='file' device='disk'>
I0920 22:10:46.211847 61195 main.go:141] libmachine: (old-k8s-version-593412) <driver name='qemu' type='raw' cache='default' io='threads' />
I0920 22:10:46.211861 61195 main.go:141] libmachine: (old-k8s-version-593412) <source file='/home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/old-k8s-version-593412.rawdisk'/>
I0920 22:10:46.211868 61195 main.go:141] libmachine: (old-k8s-version-593412) <target dev='hda' bus='virtio'/>
I0920 22:10:46.211874 61195 main.go:141] libmachine: (old-k8s-version-593412) </disk>
I0920 22:10:46.211881 61195 main.go:141] libmachine: (old-k8s-version-593412) <interface type='network'>
I0920 22:10:46.211900 61195 main.go:141] libmachine: (old-k8s-version-593412) <source network='mk-old-k8s-version-593412'/>
I0920 22:10:46.211923 61195 main.go:141] libmachine: (old-k8s-version-593412) <model type='virtio'/>
I0920 22:10:46.211932 61195 main.go:141] libmachine: (old-k8s-version-593412) </interface>
I0920 22:10:46.211938 61195 main.go:141] libmachine: (old-k8s-version-593412) <interface type='network'>
I0920 22:10:46.211946 61195 main.go:141] libmachine: (old-k8s-version-593412) <source network='default'/>
I0920 22:10:46.211953 61195 main.go:141] libmachine: (old-k8s-version-593412) <model type='virtio'/>
I0920 22:10:46.211961 61195 main.go:141] libmachine: (old-k8s-version-593412) </interface>
I0920 22:10:46.211968 61195 main.go:141] libmachine: (old-k8s-version-593412) <serial type='pty'>
I0920 22:10:46.211975 61195 main.go:141] libmachine: (old-k8s-version-593412) <target port='0'/>
I0920 22:10:46.211981 61195 main.go:141] libmachine: (old-k8s-version-593412) </serial>
I0920 22:10:46.211990 61195 main.go:141] libmachine: (old-k8s-version-593412) <console type='pty'>
I0920 22:10:46.212002 61195 main.go:141] libmachine: (old-k8s-version-593412) <target type='serial' port='0'/>
I0920 22:10:46.212010 61195 main.go:141] libmachine: (old-k8s-version-593412) </console>
I0920 22:10:46.212016 61195 main.go:141] libmachine: (old-k8s-version-593412) <rng model='virtio'>
I0920 22:10:46.212025 61195 main.go:141] libmachine: (old-k8s-version-593412) <backend model='random'>/dev/random</backend>
I0920 22:10:46.212032 61195 main.go:141] libmachine: (old-k8s-version-593412) </rng>
I0920 22:10:46.212039 61195 main.go:141] libmachine: (old-k8s-version-593412)
I0920 22:10:46.212046 61195 main.go:141] libmachine: (old-k8s-version-593412)
I0920 22:10:46.212054 61195 main.go:141] libmachine: (old-k8s-version-593412) </devices>
I0920 22:10:46.212060 61195 main.go:141] libmachine: (old-k8s-version-593412) </domain>
I0920 22:10:46.212069 61195 main.go:141] libmachine: (old-k8s-version-593412)
I0920 22:10:46.216509 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:f2:39:fa in network default
I0920 22:10:46.217103 61195 main.go:141] libmachine: (old-k8s-version-593412) Ensuring networks are active...
I0920 22:10:46.217128 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:46.217821 61195 main.go:141] libmachine: (old-k8s-version-593412) Ensuring network default is active
I0920 22:10:46.218243 61195 main.go:141] libmachine: (old-k8s-version-593412) Ensuring network mk-old-k8s-version-593412 is active
I0920 22:10:46.218815 61195 main.go:141] libmachine: (old-k8s-version-593412) Getting domain xml...
I0920 22:10:46.219679 61195 main.go:141] libmachine: (old-k8s-version-593412) Creating domain...
I0920 22:10:47.626222 61195 main.go:141] libmachine: (old-k8s-version-593412) Waiting to get IP...
I0920 22:10:47.627225 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:47.627788 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:47.627813 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:47.627773 61331 retry.go:31] will retry after 310.808996ms: waiting for machine to come up
I0920 22:10:47.940497 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:47.941113 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:47.941248 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:47.941190 61331 retry.go:31] will retry after 305.075758ms: waiting for machine to come up
I0920 22:10:48.247714 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:48.248312 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:48.248342 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:48.248266 61331 retry.go:31] will retry after 297.080577ms: waiting for machine to come up
I0920 22:10:48.547063 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:48.547703 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:48.547741 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:48.547644 61331 retry.go:31] will retry after 502.566104ms: waiting for machine to come up
I0920 22:10:49.051531 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:49.052149 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:49.052171 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:49.052094 61331 retry.go:31] will retry after 497.215322ms: waiting for machine to come up
I0920 22:10:49.550772 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:49.551280 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:49.551400 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:49.551352 61331 retry.go:31] will retry after 790.444362ms: waiting for machine to come up
I0920 22:10:50.342917 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:50.343440 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:50.343456 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:50.343413 61331 retry.go:31] will retry after 916.276521ms: waiting for machine to come up
I0920 22:10:51.260899 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:51.261401 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:51.261460 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:51.261389 61331 retry.go:31] will retry after 1.366940244s: waiting for machine to come up
I0920 22:10:52.630007 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:52.630538 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:52.630569 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:52.630479 61331 retry.go:31] will retry after 1.347446229s: waiting for machine to come up
I0920 22:10:53.979873 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:53.980455 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:53.980481 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:53.980403 61331 retry.go:31] will retry after 1.583851577s: waiting for machine to come up
I0920 22:10:55.566284 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:55.566732 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:55.566762 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:55.566675 61331 retry.go:31] will retry after 1.837610862s: waiting for machine to come up
I0920 22:10:57.406775 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:10:57.407466 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:10:57.407496 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:10:57.407418 61331 retry.go:31] will retry after 3.169825194s: waiting for machine to come up
I0920 22:11:00.580086 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:00.580574 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:11:00.580600 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:11:00.580532 61331 retry.go:31] will retry after 3.614679602s: waiting for machine to come up
I0920 22:11:04.196429 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:04.196864 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find current IP address of domain old-k8s-version-593412 in network mk-old-k8s-version-593412
I0920 22:11:04.196894 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | I0920 22:11:04.196792 61331 retry.go:31] will retry after 4.148422946s: waiting for machine to come up
I0920 22:11:08.347985 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.348514 61195 main.go:141] libmachine: (old-k8s-version-593412) Found IP for machine: 192.168.61.2
I0920 22:11:08.348548 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has current primary IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.348557 61195 main.go:141] libmachine: (old-k8s-version-593412) Reserving static IP address...
I0920 22:11:08.348932 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-593412", mac: "52:54:00:7f:66:3d", ip: "192.168.61.2"} in network mk-old-k8s-version-593412
I0920 22:11:08.427387 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Getting to WaitForSSH function...
I0920 22:11:08.427439 61195 main.go:141] libmachine: (old-k8s-version-593412) Reserved static IP address: 192.168.61.2
I0920 22:11:08.427453 61195 main.go:141] libmachine: (old-k8s-version-593412) Waiting for SSH to be available...
I0920 22:11:08.430504 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.430876 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:minikube Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:08.430912 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.431099 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Using SSH client type: external
I0920 22:11:08.431138 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Using SSH private key: /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa (-rw-------)
I0920 22:11:08.431177 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.2 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa -p 22] /usr/bin/ssh <nil>}
I0920 22:11:08.431202 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | About to run SSH command:
I0920 22:11:08.431228 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | exit 0
I0920 22:11:08.563455 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | SSH cmd err, output: <nil>:
I0920 22:11:08.563763 61195 main.go:141] libmachine: (old-k8s-version-593412) KVM machine creation complete!
I0920 22:11:08.564069 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetConfigRaw
I0920 22:11:08.564718 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:08.564912 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:08.565070 61195 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0920 22:11:08.565087 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetState
I0920 22:11:08.566385 61195 main.go:141] libmachine: Detecting operating system of created instance...
I0920 22:11:08.566398 61195 main.go:141] libmachine: Waiting for SSH to be available...
I0920 22:11:08.566403 61195 main.go:141] libmachine: Getting to WaitForSSH function...
I0920 22:11:08.566408 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:08.568838 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.569214 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:08.569242 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.569365 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:08.569523 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.569659 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.569810 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:08.569937 61195 main.go:141] libmachine: Using SSH client type: native
I0920 22:11:08.570220 61195 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I0920 22:11:08.570239 61195 main.go:141] libmachine: About to run SSH command:
exit 0
I0920 22:11:08.690857 61195 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 22:11:08.690885 61195 main.go:141] libmachine: Detecting the provisioner...
I0920 22:11:08.690895 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:08.694148 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.694544 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:08.694569 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.694785 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:08.695034 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.695216 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.695373 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:08.695526 61195 main.go:141] libmachine: Using SSH client type: native
I0920 22:11:08.695702 61195 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I0920 22:11:08.695712 61195 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0920 22:11:08.820566 61195 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0920 22:11:08.820684 61195 main.go:141] libmachine: found compatible host: buildroot
I0920 22:11:08.820699 61195 main.go:141] libmachine: Provisioning with buildroot...
I0920 22:11:08.820714 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetMachineName
I0920 22:11:08.820996 61195 buildroot.go:166] provisioning hostname "old-k8s-version-593412"
I0920 22:11:08.821019 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetMachineName
I0920 22:11:08.821200 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:08.824131 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.824550 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:08.824578 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.824777 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:08.825017 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.825223 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.825359 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:08.825548 61195 main.go:141] libmachine: Using SSH client type: native
I0920 22:11:08.825808 61195 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I0920 22:11:08.825827 61195 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-593412 && echo "old-k8s-version-593412" | sudo tee /etc/hostname
I0920 22:11:08.957512 61195 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-593412
I0920 22:11:08.957544 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:08.961239 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.961721 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:08.961751 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:08.961968 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:08.962163 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.962380 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:08.962532 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:08.962680 61195 main.go:141] libmachine: Using SSH client type: native
I0920 22:11:08.962841 61195 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I0920 22:11:08.962857 61195 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-593412' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-593412/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-593412' | sudo tee -a /etc/hosts;
fi
fi
I0920 22:11:09.085061 61195 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 22:11:09.085116 61195 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19672-9614/.minikube CaCertPath:/home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19672-9614/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19672-9614/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19672-9614/.minikube}
I0920 22:11:09.085142 61195 buildroot.go:174] setting up certificates
I0920 22:11:09.085156 61195 provision.go:84] configureAuth start
I0920 22:11:09.085173 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetMachineName
I0920 22:11:09.085477 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetIP
I0920 22:11:09.088394 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.088792 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.088829 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.088999 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.091337 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.091652 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.091692 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.091795 61195 provision.go:143] copyHostCerts
I0920 22:11:09.091850 61195 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-9614/.minikube/ca.pem, removing ...
I0920 22:11:09.091872 61195 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-9614/.minikube/ca.pem
I0920 22:11:09.091950 61195 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19672-9614/.minikube/ca.pem (1078 bytes)
I0920 22:11:09.092127 61195 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-9614/.minikube/cert.pem, removing ...
I0920 22:11:09.092139 61195 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-9614/.minikube/cert.pem
I0920 22:11:09.092172 61195 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19672-9614/.minikube/cert.pem (1123 bytes)
I0920 22:11:09.092262 61195 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-9614/.minikube/key.pem, removing ...
I0920 22:11:09.092272 61195 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-9614/.minikube/key.pem
I0920 22:11:09.092298 61195 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19672-9614/.minikube/key.pem (1679 bytes)
I0920 22:11:09.092375 61195 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19672-9614/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-593412 san=[127.0.0.1 192.168.61.2 localhost minikube old-k8s-version-593412]
I0920 22:11:09.241309 61195 provision.go:177] copyRemoteCerts
I0920 22:11:09.241372 61195 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 22:11:09.241399 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.244141 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.244454 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.244493 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.244643 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:09.244821 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.244994 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:09.245145 61195 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa Username:docker}
I0920 22:11:09.336260 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0920 22:11:09.362480 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0920 22:11:09.389045 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0920 22:11:09.413697 61195 provision.go:87] duration metric: took 328.525516ms to configureAuth
I0920 22:11:09.413745 61195 buildroot.go:189] setting minikube options for container-runtime
I0920 22:11:09.413938 61195 config.go:182] Loaded profile config "old-k8s-version-593412": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0920 22:11:09.414015 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.416615 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.416962 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.417007 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.417150 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:09.417305 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.417482 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.417658 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:09.417835 61195 main.go:141] libmachine: Using SSH client type: native
I0920 22:11:09.418071 61195 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I0920 22:11:09.418092 61195 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0920 22:11:09.669740 61195 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0920 22:11:09.669825 61195 main.go:141] libmachine: Checking connection to Docker...
I0920 22:11:09.669840 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetURL
I0920 22:11:09.671417 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | Using libvirt version 6000000
I0920 22:11:09.674306 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.674626 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.674655 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.674855 61195 main.go:141] libmachine: Docker is up and running!
I0920 22:11:09.674872 61195 main.go:141] libmachine: Reticulating splines...
I0920 22:11:09.674880 61195 client.go:171] duration metric: took 24.009268702s to LocalClient.Create
I0920 22:11:09.674906 61195 start.go:167] duration metric: took 24.009358408s to libmachine.API.Create "old-k8s-version-593412"
I0920 22:11:09.674917 61195 start.go:293] postStartSetup for "old-k8s-version-593412" (driver="kvm2")
I0920 22:11:09.674929 61195 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 22:11:09.674951 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:09.675202 61195 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 22:11:09.675244 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.677490 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.677808 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.677836 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.677987 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:09.678183 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.678361 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:09.678517 61195 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa Username:docker}
I0920 22:11:09.765383 61195 ssh_runner.go:195] Run: cat /etc/os-release
I0920 22:11:09.769766 61195 info.go:137] Remote host: Buildroot 2023.02.9
I0920 22:11:09.769789 61195 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-9614/.minikube/addons for local assets ...
I0920 22:11:09.769851 61195 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-9614/.minikube/files for local assets ...
I0920 22:11:09.769947 61195 filesync.go:149] local asset: /home/jenkins/minikube-integration/19672-9614/.minikube/files/etc/ssl/certs/167852.pem -> 167852.pem in /etc/ssl/certs
I0920 22:11:09.770066 61195 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0920 22:11:09.780182 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/files/etc/ssl/certs/167852.pem --> /etc/ssl/certs/167852.pem (1708 bytes)
I0920 22:11:09.806621 61195 start.go:296] duration metric: took 131.691184ms for postStartSetup
I0920 22:11:09.806665 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetConfigRaw
I0920 22:11:09.807293 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetIP
I0920 22:11:09.810021 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.810446 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.810477 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.810693 61195 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/config.json ...
I0920 22:11:09.810905 61195 start.go:128] duration metric: took 24.170425111s to createHost
I0920 22:11:09.810926 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.813525 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.813841 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.813877 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.814089 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:09.814262 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.814426 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.814522 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:09.814657 61195 main.go:141] libmachine: Using SSH client type: native
I0920 22:11:09.814884 61195 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.61.2 22 <nil> <nil>}
I0920 22:11:09.814896 61195 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0920 22:11:09.933043 61195 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726870269.901927309
I0920 22:11:09.933071 61195 fix.go:216] guest clock: 1726870269.901927309
I0920 22:11:09.933081 61195 fix.go:229] Guest: 2024-09-20 22:11:09.901927309 +0000 UTC Remote: 2024-09-20 22:11:09.810916219 +0000 UTC m=+38.285344566 (delta=91.01109ms)
I0920 22:11:09.933137 61195 fix.go:200] guest clock delta is within tolerance: 91.01109ms
I0920 22:11:09.933149 61195 start.go:83] releasing machines lock for "old-k8s-version-593412", held for 24.292835276s
I0920 22:11:09.933212 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:09.933524 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetIP
I0920 22:11:09.936810 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.937169 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.937198 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.937400 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:09.937885 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:09.938087 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .DriverName
I0920 22:11:09.938196 61195 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 22:11:09.938239 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.938335 61195 ssh_runner.go:195] Run: cat /version.json
I0920 22:11:09.938360 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHHostname
I0920 22:11:09.941530 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.941718 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.941960 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.941997 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.942264 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:09.942422 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:09.942430 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.942483 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:09.942593 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHPort
I0920 22:11:09.942662 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:09.942753 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHKeyPath
I0920 22:11:09.942914 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetSSHUsername
I0920 22:11:09.942915 61195 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa Username:docker}
I0920 22:11:09.943049 61195 sshutil.go:53] new ssh client: &{IP:192.168.61.2 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-9614/.minikube/machines/old-k8s-version-593412/id_rsa Username:docker}
I0920 22:11:10.028373 61195 ssh_runner.go:195] Run: systemctl --version
I0920 22:11:10.057467 61195 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0920 22:11:10.236787 61195 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0920 22:11:10.246471 61195 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0920 22:11:10.246548 61195 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 22:11:10.265996 61195 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0920 22:11:10.266028 61195 start.go:495] detecting cgroup driver to use...
I0920 22:11:10.266106 61195 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0920 22:11:10.289030 61195 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0920 22:11:10.307350 61195 docker.go:217] disabling cri-docker service (if available) ...
I0920 22:11:10.307436 61195 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0920 22:11:10.324682 61195 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0920 22:11:10.343455 61195 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0920 22:11:10.484982 61195 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0920 22:11:10.652002 61195 docker.go:233] disabling docker service ...
I0920 22:11:10.652072 61195 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0920 22:11:10.668019 61195 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0920 22:11:10.683298 61195 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0920 22:11:10.840832 61195 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0920 22:11:10.997730 61195 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0920 22:11:11.013827 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0920 22:11:11.037710 61195 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0920 22:11:11.037779 61195 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 22:11:11.050522 61195 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0920 22:11:11.050607 61195 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 22:11:11.062222 61195 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0920 22:11:11.072953 61195 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0920 22:11:11.084283 61195 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 22:11:11.096046 61195 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 22:11:11.109800 61195 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0920 22:11:11.109875 61195 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0920 22:11:11.131367 61195 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 22:11:11.145546 61195 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 22:11:11.268716 61195 ssh_runner.go:195] Run: sudo systemctl restart crio
I0920 22:11:11.393820 61195 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0920 22:11:11.393919 61195 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0920 22:11:11.399333 61195 start.go:563] Will wait 60s for crictl version
I0920 22:11:11.399402 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:11.404727 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 22:11:11.461428 61195 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0920 22:11:11.461515 61195 ssh_runner.go:195] Run: crio --version
I0920 22:11:11.492371 61195 ssh_runner.go:195] Run: crio --version
I0920 22:11:11.526738 61195 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0920 22:11:11.528094 61195 main.go:141] libmachine: (old-k8s-version-593412) Calling .GetIP
I0920 22:11:11.531895 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:11.533623 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:66:3d", ip: ""} in network mk-old-k8s-version-593412: {Iface:virbr3 ExpiryTime:2024-09-20 23:11:01 +0000 UTC Type:0 Mac:52:54:00:7f:66:3d Iaid: IPaddr:192.168.61.2 Prefix:24 Hostname:old-k8s-version-593412 Clientid:01:52:54:00:7f:66:3d}
I0920 22:11:11.533648 61195 main.go:141] libmachine: (old-k8s-version-593412) DBG | domain old-k8s-version-593412 has defined IP address 192.168.61.2 and MAC address 52:54:00:7f:66:3d in network mk-old-k8s-version-593412
I0920 22:11:11.533878 61195 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0920 22:11:11.538932 61195 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 22:11:11.553400 61195 kubeadm.go:883] updating cluster {Name:old-k8s-version-593412 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19672/minikube-v1.34.0-1726784654-19672-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-593412 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 22:11:11.553520 61195 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0920 22:11:11.553570 61195 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 22:11:11.588456 61195 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0920 22:11:11.588532 61195 ssh_runner.go:195] Run: which lz4
I0920 22:11:11.593230 61195 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0920 22:11:11.597798 61195 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0920 22:11:11.597834 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0920 22:11:13.454227 61195 crio.go:462] duration metric: took 1.861025841s to copy over tarball
I0920 22:11:13.454327 61195 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0920 22:11:16.446728 61195 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.992360699s)
I0920 22:11:16.446768 61195 crio.go:469] duration metric: took 2.992493221s to extract the tarball
I0920 22:11:16.446776 61195 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0920 22:11:16.512697 61195 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 22:11:16.612476 61195 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0920 22:11:16.612500 61195 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0920 22:11:16.612561 61195 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0920 22:11:16.612581 61195 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:16.612608 61195 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0920 22:11:16.612638 61195 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0920 22:11:16.612665 61195 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0920 22:11:16.612679 61195 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:16.612689 61195 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:16.612809 61195 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:16.614326 61195 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:16.614328 61195 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0920 22:11:16.614326 61195 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0920 22:11:16.614328 61195 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:16.614372 61195 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0920 22:11:16.614331 61195 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:16.614382 61195 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0920 22:11:16.614334 61195 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:16.776046 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0920 22:11:16.785501 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:16.791595 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:16.795423 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0920 22:11:16.803137 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:16.816674 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:16.829242 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0920 22:11:16.875757 61195 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0920 22:11:16.875804 61195 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0920 22:11:16.875850 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:16.940082 61195 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0920 22:11:16.940120 61195 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:16.940161 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:17.013044 61195 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0920 22:11:17.013098 61195 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:17.013111 61195 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0920 22:11:17.013142 61195 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0920 22:11:17.013149 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:17.013189 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:17.013143 61195 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0920 22:11:17.013222 61195 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:17.013234 61195 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0920 22:11:17.013263 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:17.013301 61195 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0920 22:11:17.013318 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 22:11:17.013265 61195 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:17.013331 61195 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0920 22:11:17.013345 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:17.013352 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:17.013357 61195 ssh_runner.go:195] Run: which crictl
I0920 22:11:17.033662 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:17.033740 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:17.101033 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 22:11:17.101084 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:17.101113 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:17.101154 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 22:11:17.101121 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 22:11:17.135514 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:17.155894 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:17.253648 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 22:11:17.256305 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 22:11:17.283288 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 22:11:17.289283 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 22:11:17.289411 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:17.312255 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 22:11:17.319837 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 22:11:17.429384 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 22:11:17.429485 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0920 22:11:17.465062 61195 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0920 22:11:17.470920 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0920 22:11:17.470980 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 22:11:17.470987 61195 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 22:11:17.508423 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0920 22:11:17.512072 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0920 22:11:17.587365 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0920 22:11:17.700228 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0920 22:11:17.700253 61195 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0920 22:11:17.700352 61195 cache_images.go:92] duration metric: took 1.087840742s to LoadCachedImages
W0920 22:11:17.700429 61195 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19672-9614/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0920 22:11:17.700446 61195 kubeadm.go:934] updating node { 192.168.61.2 8443 v1.20.0 crio true true} ...
I0920 22:11:17.700572 61195 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-593412 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-593412 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 22:11:17.700665 61195 ssh_runner.go:195] Run: crio config
I0920 22:11:17.765582 61195 cni.go:84] Creating CNI manager for ""
I0920 22:11:17.765607 61195 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0920 22:11:17.765618 61195 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 22:11:17.765643 61195 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-593412 NodeName:old-k8s-version-593412 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0920 22:11:17.765817 61195 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-593412"
kubeletExtraArgs:
node-ip: 192.168.61.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 22:11:17.765893 61195 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0920 22:11:17.776924 61195 binaries.go:44] Found k8s binaries, skipping transfer
I0920 22:11:17.777022 61195 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 22:11:17.788314 61195 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (428 bytes)
I0920 22:11:17.807049 61195 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 22:11:17.828747 61195 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0920 22:11:17.851690 61195 ssh_runner.go:195] Run: grep 192.168.61.2 control-plane.minikube.internal$ /etc/hosts
I0920 22:11:17.856366 61195 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 22:11:17.870373 61195 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 22:11:18.008072 61195 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 22:11:18.029077 61195 certs.go:68] Setting up /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412 for IP: 192.168.61.2
I0920 22:11:18.029104 61195 certs.go:194] generating shared ca certs ...
I0920 22:11:18.029126 61195 certs.go:226] acquiring lock for ca certs: {Name:mk021d7d1c007b65983ab506ab378319a6623d64 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.029296 61195 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19672-9614/.minikube/ca.key
I0920 22:11:18.029350 61195 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19672-9614/.minikube/proxy-client-ca.key
I0920 22:11:18.029364 61195 certs.go:256] generating profile certs ...
I0920 22:11:18.029432 61195 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/client.key
I0920 22:11:18.029449 61195 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/client.crt with IP's: []
I0920 22:11:18.125137 61195 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/client.crt ...
I0920 22:11:18.125171 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/client.crt: {Name:mkf27b12b0b52b30cad3667f9240addbe98128d0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.161801 61195 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/client.key ...
I0920 22:11:18.161842 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/client.key: {Name:mk9f85268888a8a9cf947e0391bcb071aa5febf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.162104 61195 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.key.2074c1da
I0920 22:11:18.162128 61195 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.crt.2074c1da with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.2]
I0920 22:11:18.295857 61195 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.crt.2074c1da ...
I0920 22:11:18.295906 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.crt.2074c1da: {Name:mk41ed0925408b62da1fcc4695e69d900c5406be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.296094 61195 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.key.2074c1da ...
I0920 22:11:18.296110 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.key.2074c1da: {Name:mkdb5559385e232f54db2f54c0d8a41d6092bd68 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.296218 61195 certs.go:381] copying /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.crt.2074c1da -> /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.crt
I0920 22:11:18.296317 61195 certs.go:385] copying /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.key.2074c1da -> /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.key
I0920 22:11:18.296408 61195 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.key
I0920 22:11:18.296434 61195 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.crt with IP's: []
I0920 22:11:18.503543 61195 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.crt ...
I0920 22:11:18.503573 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.crt: {Name:mke9d525e6b46d9f419cd9a1f9b224910b83b90d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.503775 61195 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.key ...
I0920 22:11:18.503795 61195 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.key: {Name:mka12173ec14d9ca2888d9e3ce6bd2e19437648e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:11:18.504031 61195 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/16785.pem (1338 bytes)
W0920 22:11:18.504073 61195 certs.go:480] ignoring /home/jenkins/minikube-integration/19672-9614/.minikube/certs/16785_empty.pem, impossibly tiny 0 bytes
I0920 22:11:18.504081 61195 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca-key.pem (1675 bytes)
I0920 22:11:18.504103 61195 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/ca.pem (1078 bytes)
I0920 22:11:18.504133 61195 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/cert.pem (1123 bytes)
I0920 22:11:18.504159 61195 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-9614/.minikube/certs/key.pem (1679 bytes)
I0920 22:11:18.504198 61195 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-9614/.minikube/files/etc/ssl/certs/167852.pem (1708 bytes)
I0920 22:11:18.504847 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 22:11:18.535395 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0920 22:11:18.563749 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 22:11:18.592681 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0920 22:11:18.620880 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0920 22:11:18.652399 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0920 22:11:18.682525 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 22:11:18.718053 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/profiles/old-k8s-version-593412/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0920 22:11:18.751528 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/certs/16785.pem --> /usr/share/ca-certificates/16785.pem (1338 bytes)
I0920 22:11:18.783927 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/files/etc/ssl/certs/167852.pem --> /usr/share/ca-certificates/167852.pem (1708 bytes)
I0920 22:11:18.814757 61195 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-9614/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 22:11:18.849868 61195 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 22:11:18.873627 61195 ssh_runner.go:195] Run: openssl version
I0920 22:11:18.882672 61195 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16785.pem && ln -fs /usr/share/ca-certificates/16785.pem /etc/ssl/certs/16785.pem"
I0920 22:11:18.900895 61195 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16785.pem
I0920 22:11:18.908857 61195 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 20 21:05 /usr/share/ca-certificates/16785.pem
I0920 22:11:18.908943 61195 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16785.pem
I0920 22:11:18.917788 61195 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/16785.pem /etc/ssl/certs/51391683.0"
I0920 22:11:18.936073 61195 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/167852.pem && ln -fs /usr/share/ca-certificates/167852.pem /etc/ssl/certs/167852.pem"
I0920 22:11:18.956589 61195 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/167852.pem
I0920 22:11:18.965157 61195 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 20 21:05 /usr/share/ca-certificates/167852.pem
I0920 22:11:18.965224 61195 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/167852.pem
I0920 22:11:18.972824 61195 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/167852.pem /etc/ssl/certs/3ec20f2e.0"
I0920 22:11:18.990165 61195 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 22:11:19.006540 61195 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 22:11:19.013219 61195 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 20:48 /usr/share/ca-certificates/minikubeCA.pem
I0920 22:11:19.013288 61195 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 22:11:19.026759 61195 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 22:11:19.046931 61195 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 22:11:19.052767 61195 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0920 22:11:19.052837 61195 kubeadm.go:392] StartCluster: {Name:old-k8s-version-593412 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19672/minikube-v1.34.0-1726784654-19672-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-593412 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 22:11:19.052958 61195 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0920 22:11:19.053021 61195 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0920 22:11:19.104733 61195 cri.go:89] found id: ""
I0920 22:11:19.104828 61195 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 22:11:19.117341 61195 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0920 22:11:19.128289 61195 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 22:11:19.143223 61195 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 22:11:19.143243 61195 kubeadm.go:157] found existing configuration files:
I0920 22:11:19.143297 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 22:11:19.158884 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 22:11:19.159454 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 22:11:19.171541 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 22:11:19.182287 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 22:11:19.182356 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 22:11:19.192461 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 22:11:19.205853 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 22:11:19.205922 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 22:11:19.217694 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 22:11:19.229948 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 22:11:19.230014 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 22:11:19.241704 61195 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0920 22:11:19.571908 61195 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 22:13:17.700857 61195 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0920 22:13:17.700937 61195 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0920 22:13:17.702478 61195 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0920 22:13:17.702558 61195 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 22:13:17.702666 61195 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 22:13:17.702790 61195 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 22:13:17.702912 61195 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0920 22:13:17.703033 61195 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 22:13:17.704933 61195 out.go:235] - Generating certificates and keys ...
I0920 22:13:17.705024 61195 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 22:13:17.705116 61195 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 22:13:17.705213 61195 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0920 22:13:17.705286 61195 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0920 22:13:17.705364 61195 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0920 22:13:17.705439 61195 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0920 22:13:17.705510 61195 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0920 22:13:17.705643 61195 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-593412] and IPs [192.168.61.2 127.0.0.1 ::1]
I0920 22:13:17.705718 61195 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0920 22:13:17.705875 61195 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-593412] and IPs [192.168.61.2 127.0.0.1 ::1]
I0920 22:13:17.705967 61195 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0920 22:13:17.706052 61195 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0920 22:13:17.706115 61195 kubeadm.go:310] [certs] Generating "sa" key and public key
I0920 22:13:17.706186 61195 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 22:13:17.706263 61195 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 22:13:17.706317 61195 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 22:13:17.706372 61195 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 22:13:17.706445 61195 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 22:13:17.706586 61195 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 22:13:17.706666 61195 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 22:13:17.706710 61195 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 22:13:17.706772 61195 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 22:13:17.708865 61195 out.go:235] - Booting up control plane ...
I0920 22:13:17.708979 61195 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 22:13:17.709073 61195 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 22:13:17.709158 61195 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 22:13:17.709264 61195 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 22:13:17.709488 61195 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0920 22:13:17.709568 61195 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0920 22:13:17.709675 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:13:17.709924 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:13:17.709987 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:13:17.710146 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:13:17.710204 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:13:17.710460 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:13:17.710553 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:13:17.710768 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:13:17.710855 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:13:17.711057 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:13:17.711067 61195 kubeadm.go:310]
I0920 22:13:17.711101 61195 kubeadm.go:310] Unfortunately, an error has occurred:
I0920 22:13:17.711147 61195 kubeadm.go:310] timed out waiting for the condition
I0920 22:13:17.711153 61195 kubeadm.go:310]
I0920 22:13:17.711182 61195 kubeadm.go:310] This error is likely caused by:
I0920 22:13:17.711221 61195 kubeadm.go:310] - The kubelet is not running
I0920 22:13:17.711334 61195 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0920 22:13:17.711343 61195 kubeadm.go:310]
I0920 22:13:17.711471 61195 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0920 22:13:17.711507 61195 kubeadm.go:310] - 'systemctl status kubelet'
I0920 22:13:17.711536 61195 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0920 22:13:17.711542 61195 kubeadm.go:310]
I0920 22:13:17.711639 61195 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0920 22:13:17.711709 61195 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0920 22:13:17.711721 61195 kubeadm.go:310]
I0920 22:13:17.711827 61195 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0920 22:13:17.711904 61195 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0920 22:13:17.712019 61195 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0920 22:13:17.712129 61195 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0920 22:13:17.712158 61195 kubeadm.go:310]
W0920 22:13:17.712274 61195 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-593412] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-593412] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-593412] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-593412] and IPs [192.168.61.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0920 22:13:17.712321 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0920 22:13:18.778862 61195 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.066515421s)
I0920 22:13:18.778941 61195 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0920 22:13:18.793701 61195 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 22:13:18.804265 61195 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 22:13:18.804290 61195 kubeadm.go:157] found existing configuration files:
I0920 22:13:18.804335 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 22:13:18.813970 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 22:13:18.814044 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 22:13:18.824460 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 22:13:18.834029 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 22:13:18.834108 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 22:13:18.844022 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 22:13:18.853549 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 22:13:18.853608 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 22:13:18.863414 61195 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 22:13:18.872777 61195 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 22:13:18.872840 61195 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 22:13:18.883011 61195 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0920 22:13:19.124761 61195 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 22:15:15.567844 61195 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0920 22:15:15.567924 61195 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0920 22:15:15.569420 61195 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0920 22:15:15.569497 61195 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 22:15:15.569592 61195 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 22:15:15.569675 61195 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 22:15:15.569761 61195 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0920 22:15:15.569814 61195 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 22:15:15.572413 61195 out.go:235] - Generating certificates and keys ...
I0920 22:15:15.572499 61195 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 22:15:15.572566 61195 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 22:15:15.572653 61195 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0920 22:15:15.572738 61195 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0920 22:15:15.572832 61195 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0920 22:15:15.572909 61195 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0920 22:15:15.573011 61195 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0920 22:15:15.573097 61195 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0920 22:15:15.573196 61195 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0920 22:15:15.573302 61195 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0920 22:15:15.573359 61195 kubeadm.go:310] [certs] Using the existing "sa" key
I0920 22:15:15.573435 61195 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 22:15:15.573508 61195 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 22:15:15.573593 61195 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 22:15:15.573655 61195 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 22:15:15.573728 61195 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 22:15:15.573854 61195 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 22:15:15.573974 61195 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 22:15:15.574025 61195 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 22:15:15.574110 61195 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 22:15:15.575275 61195 out.go:235] - Booting up control plane ...
I0920 22:15:15.575366 61195 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 22:15:15.575450 61195 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 22:15:15.575546 61195 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 22:15:15.575647 61195 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 22:15:15.575814 61195 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0920 22:15:15.575883 61195 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0920 22:15:15.575963 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:15:15.576175 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:15:15.576255 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:15:15.576446 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:15:15.576518 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:15:15.576684 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:15:15.576745 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:15:15.576907 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:15:15.576973 61195 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 22:15:15.577143 61195 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 22:15:15.577154 61195 kubeadm.go:310]
I0920 22:15:15.577212 61195 kubeadm.go:310] Unfortunately, an error has occurred:
I0920 22:15:15.577249 61195 kubeadm.go:310] timed out waiting for the condition
I0920 22:15:15.577259 61195 kubeadm.go:310]
I0920 22:15:15.577289 61195 kubeadm.go:310] This error is likely caused by:
I0920 22:15:15.577318 61195 kubeadm.go:310] - The kubelet is not running
I0920 22:15:15.577405 61195 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0920 22:15:15.577413 61195 kubeadm.go:310]
I0920 22:15:15.577539 61195 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0920 22:15:15.577597 61195 kubeadm.go:310] - 'systemctl status kubelet'
I0920 22:15:15.577647 61195 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0920 22:15:15.577657 61195 kubeadm.go:310]
I0920 22:15:15.577741 61195 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0920 22:15:15.577812 61195 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0920 22:15:15.577818 61195 kubeadm.go:310]
I0920 22:15:15.577909 61195 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0920 22:15:15.577984 61195 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0920 22:15:15.578055 61195 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0920 22:15:15.578136 61195 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0920 22:15:15.578218 61195 kubeadm.go:310]
I0920 22:15:15.578222 61195 kubeadm.go:394] duration metric: took 3m56.52538682s to StartCluster
I0920 22:15:15.578267 61195 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0920 22:15:15.578319 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 22:15:15.621956 61195 cri.go:89] found id: ""
I0920 22:15:15.621984 61195 logs.go:276] 0 containers: []
W0920 22:15:15.621994 61195 logs.go:278] No container was found matching "kube-apiserver"
I0920 22:15:15.622008 61195 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0920 22:15:15.622065 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 22:15:15.670134 61195 cri.go:89] found id: ""
I0920 22:15:15.670161 61195 logs.go:276] 0 containers: []
W0920 22:15:15.670171 61195 logs.go:278] No container was found matching "etcd"
I0920 22:15:15.670178 61195 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0920 22:15:15.670241 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 22:15:15.706653 61195 cri.go:89] found id: ""
I0920 22:15:15.706689 61195 logs.go:276] 0 containers: []
W0920 22:15:15.706697 61195 logs.go:278] No container was found matching "coredns"
I0920 22:15:15.706702 61195 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0920 22:15:15.706757 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 22:15:15.740843 61195 cri.go:89] found id: ""
I0920 22:15:15.740875 61195 logs.go:276] 0 containers: []
W0920 22:15:15.740883 61195 logs.go:278] No container was found matching "kube-scheduler"
I0920 22:15:15.740889 61195 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0920 22:15:15.740946 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 22:15:15.774608 61195 cri.go:89] found id: ""
I0920 22:15:15.774634 61195 logs.go:276] 0 containers: []
W0920 22:15:15.774642 61195 logs.go:278] No container was found matching "kube-proxy"
I0920 22:15:15.774648 61195 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0920 22:15:15.774711 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 22:15:15.809236 61195 cri.go:89] found id: ""
I0920 22:15:15.809270 61195 logs.go:276] 0 containers: []
W0920 22:15:15.809279 61195 logs.go:278] No container was found matching "kube-controller-manager"
I0920 22:15:15.809285 61195 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0920 22:15:15.809339 61195 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 22:15:15.845748 61195 cri.go:89] found id: ""
I0920 22:15:15.845780 61195 logs.go:276] 0 containers: []
W0920 22:15:15.845788 61195 logs.go:278] No container was found matching "kindnet"
I0920 22:15:15.845797 61195 logs.go:123] Gathering logs for container status ...
I0920 22:15:15.845808 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 22:15:15.896058 61195 logs.go:123] Gathering logs for kubelet ...
I0920 22:15:15.896085 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0920 22:15:15.965900 61195 logs.go:123] Gathering logs for dmesg ...
I0920 22:15:15.965952 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 22:15:15.987373 61195 logs.go:123] Gathering logs for describe nodes ...
I0920 22:15:15.987399 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0920 22:15:16.111974 61195 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0920 22:15:16.112007 61195 logs.go:123] Gathering logs for CRI-O ...
I0920 22:15:16.112026 61195 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0920 22:15:16.216792 61195 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 22:15:16.216859 61195 out.go:270] *
*
W0920 22:15:16.216914 61195 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 22:15:16.216932 61195 out.go:270] *
*
W0920 22:15:16.217929 61195 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0920 22:15:16.221586 61195 out.go:201]
W0920 22:15:16.223079 61195 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 22:15:16.223138 61195 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0920 22:15:16.223155 61195 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0920 22:15:16.224747 61195 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-593412 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-593412 -n old-k8s-version-593412
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-593412 -n old-k8s-version-593412: exit status 6 (229.079959ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0920 22:15:16.503898 64170 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-593412" does not appear in /home/jenkins/minikube-integration/19672-9614/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-593412" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (285.00s)