=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-612261 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-612261 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m44.926057899s)
-- stdout --
* [old-k8s-version-612261] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19711
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19711-14935/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19711-14935/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-612261" primary control-plane node in "old-k8s-version-612261" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0927 01:31:03.782059 64877 out.go:345] Setting OutFile to fd 1 ...
I0927 01:31:03.782311 64877 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:31:03.782320 64877 out.go:358] Setting ErrFile to fd 2...
I0927 01:31:03.782326 64877 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:31:03.782497 64877 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19711-14935/.minikube/bin
I0927 01:31:03.783067 64877 out.go:352] Setting JSON to false
I0927 01:31:03.783969 64877 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":8009,"bootTime":1727392655,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0927 01:31:03.784102 64877 start.go:139] virtualization: kvm guest
I0927 01:31:03.786007 64877 out.go:177] * [old-k8s-version-612261] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0927 01:31:03.787250 64877 notify.go:220] Checking for updates...
I0927 01:31:03.787275 64877 out.go:177] - MINIKUBE_LOCATION=19711
I0927 01:31:03.788530 64877 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0927 01:31:03.789636 64877 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19711-14935/kubeconfig
I0927 01:31:03.790851 64877 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19711-14935/.minikube
I0927 01:31:03.791993 64877 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0927 01:31:03.793124 64877 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0927 01:31:03.794732 64877 config.go:182] Loaded profile config "NoKubernetes-719096": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0927 01:31:03.794861 64877 config.go:182] Loaded profile config "cert-expiration-595331": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0927 01:31:03.794987 64877 config.go:182] Loaded profile config "kubernetes-upgrade-637447": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0927 01:31:03.795095 64877 driver.go:394] Setting default libvirt URI to qemu:///system
I0927 01:31:03.828033 64877 out.go:177] * Using the kvm2 driver based on user configuration
I0927 01:31:03.829369 64877 start.go:297] selected driver: kvm2
I0927 01:31:03.829381 64877 start.go:901] validating driver "kvm2" against <nil>
I0927 01:31:03.829391 64877 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0927 01:31:03.830051 64877 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:31:03.830130 64877 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19711-14935/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0927 01:31:03.845810 64877 install.go:137] /home/jenkins/minikube-integration/19711-14935/.minikube/bin/docker-machine-driver-kvm2 version is 1.34.0
I0927 01:31:03.845864 64877 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0927 01:31:03.846093 64877 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 01:31:03.846124 64877 cni.go:84] Creating CNI manager for ""
I0927 01:31:03.846160 64877 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0927 01:31:03.846168 64877 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0927 01:31:03.846212 64877 start.go:340] cluster config:
{Name:old-k8s-version-612261 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-612261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:31:03.846316 64877 iso.go:125] acquiring lock: {Name:mkc202a14fbe20838e31e7efc444c4f65351f9ab Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:31:03.847949 64877 out.go:177] * Starting "old-k8s-version-612261" primary control-plane node in "old-k8s-version-612261" cluster
I0927 01:31:03.849146 64877 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0927 01:31:03.849180 64877 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0927 01:31:03.849189 64877 cache.go:56] Caching tarball of preloaded images
I0927 01:31:03.849251 64877 preload.go:172] Found /home/jenkins/minikube-integration/19711-14935/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0927 01:31:03.849260 64877 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0927 01:31:03.849342 64877 profile.go:143] Saving config to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/config.json ...
I0927 01:31:03.849358 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/config.json: {Name:mk177889279167f886e19dbcc4f3f884ae14b59e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:03.849474 64877 start.go:360] acquireMachinesLock for old-k8s-version-612261: {Name:mkef866a3f2eb57063758ef06140cca3a2e40b18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0927 01:31:17.420327 64877 start.go:364] duration metric: took 13.570807321s to acquireMachinesLock for "old-k8s-version-612261"
I0927 01:31:17.420416 64877 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-612261 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-612261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0927 01:31:17.420529 64877 start.go:125] createHost starting for "" (driver="kvm2")
I0927 01:31:17.584121 64877 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0927 01:31:17.584345 64877 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19711-14935/.minikube/bin/docker-machine-driver-kvm2
I0927 01:31:17.584396 64877 main.go:141] libmachine: Launching plugin server for driver kvm2
I0927 01:31:17.599697 64877 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41353
I0927 01:31:17.600102 64877 main.go:141] libmachine: () Calling .GetVersion
I0927 01:31:17.600653 64877 main.go:141] libmachine: Using API Version 1
I0927 01:31:17.600680 64877 main.go:141] libmachine: () Calling .SetConfigRaw
I0927 01:31:17.601039 64877 main.go:141] libmachine: () Calling .GetMachineName
I0927 01:31:17.601249 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetMachineName
I0927 01:31:17.601402 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:17.601572 64877 start.go:159] libmachine.API.Create for "old-k8s-version-612261" (driver="kvm2")
I0927 01:31:17.601607 64877 client.go:168] LocalClient.Create starting
I0927 01:31:17.601642 64877 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca.pem
I0927 01:31:17.601690 64877 main.go:141] libmachine: Decoding PEM data...
I0927 01:31:17.601715 64877 main.go:141] libmachine: Parsing certificate...
I0927 01:31:17.601803 64877 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19711-14935/.minikube/certs/cert.pem
I0927 01:31:17.601832 64877 main.go:141] libmachine: Decoding PEM data...
I0927 01:31:17.601850 64877 main.go:141] libmachine: Parsing certificate...
I0927 01:31:17.601877 64877 main.go:141] libmachine: Running pre-create checks...
I0927 01:31:17.601906 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .PreCreateCheck
I0927 01:31:17.602299 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetConfigRaw
I0927 01:31:17.602724 64877 main.go:141] libmachine: Creating machine...
I0927 01:31:17.602739 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .Create
I0927 01:31:17.602861 64877 main.go:141] libmachine: (old-k8s-version-612261) Creating KVM machine...
I0927 01:31:17.604138 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found existing default KVM network
I0927 01:31:17.605761 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:17.605607 65054 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:74:66:6a} reservation:<nil>}
I0927 01:31:17.606732 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:17.606649 65054 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:02:a0:8f} reservation:<nil>}
I0927 01:31:17.607636 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:17.607568 65054 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:76:b1:b5} reservation:<nil>}
I0927 01:31:17.608827 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:17.608748 65054 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00028d9b0}
I0927 01:31:17.608843 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | created network xml:
I0927 01:31:17.608854 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | <network>
I0927 01:31:17.608863 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | <name>mk-old-k8s-version-612261</name>
I0927 01:31:17.608872 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | <dns enable='no'/>
I0927 01:31:17.608879 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG |
I0927 01:31:17.608889 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0927 01:31:17.608898 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | <dhcp>
I0927 01:31:17.608910 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0927 01:31:17.608935 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | </dhcp>
I0927 01:31:17.608944 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | </ip>
I0927 01:31:17.608953 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG |
I0927 01:31:17.608975 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | </network>
I0927 01:31:17.608985 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG |
I0927 01:31:17.694183 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | trying to create private KVM network mk-old-k8s-version-612261 192.168.72.0/24...
I0927 01:31:17.775280 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | private KVM network mk-old-k8s-version-612261 192.168.72.0/24 created
I0927 01:31:17.775398 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting up store path in /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261 ...
I0927 01:31:17.775416 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:17.775255 65054 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19711-14935/.minikube
I0927 01:31:17.775476 64877 main.go:141] libmachine: (old-k8s-version-612261) Building disk image from file:///home/jenkins/minikube-integration/19711-14935/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso
I0927 01:31:17.775507 64877 main.go:141] libmachine: (old-k8s-version-612261) Downloading /home/jenkins/minikube-integration/19711-14935/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19711-14935/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...
I0927 01:31:18.018451 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:18.018318 65054 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa...
I0927 01:31:18.194282 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:18.194122 65054 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/old-k8s-version-612261.rawdisk...
I0927 01:31:18.194320 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Writing magic tar header
I0927 01:31:18.194343 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Writing SSH key tar header
I0927 01:31:18.194355 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:18.194306 65054 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261 ...
I0927 01:31:18.194490 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261
I0927 01:31:18.194524 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting executable bit set on /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261 (perms=drwx------)
I0927 01:31:18.194537 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19711-14935/.minikube/machines
I0927 01:31:18.194552 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19711-14935/.minikube
I0927 01:31:18.194560 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19711-14935
I0927 01:31:18.194570 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0927 01:31:18.194577 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home/jenkins
I0927 01:31:18.194588 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Checking permissions on dir: /home
I0927 01:31:18.194595 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Skipping /home - not owner
I0927 01:31:18.194634 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting executable bit set on /home/jenkins/minikube-integration/19711-14935/.minikube/machines (perms=drwxr-xr-x)
I0927 01:31:18.194664 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting executable bit set on /home/jenkins/minikube-integration/19711-14935/.minikube (perms=drwxr-xr-x)
I0927 01:31:18.194680 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting executable bit set on /home/jenkins/minikube-integration/19711-14935 (perms=drwxrwxr-x)
I0927 01:31:18.194696 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0927 01:31:18.194710 64877 main.go:141] libmachine: (old-k8s-version-612261) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0927 01:31:18.194726 64877 main.go:141] libmachine: (old-k8s-version-612261) Creating domain...
I0927 01:31:18.196003 64877 main.go:141] libmachine: (old-k8s-version-612261) define libvirt domain using xml:
I0927 01:31:18.196027 64877 main.go:141] libmachine: (old-k8s-version-612261) <domain type='kvm'>
I0927 01:31:18.196048 64877 main.go:141] libmachine: (old-k8s-version-612261) <name>old-k8s-version-612261</name>
I0927 01:31:18.196063 64877 main.go:141] libmachine: (old-k8s-version-612261) <memory unit='MiB'>2200</memory>
I0927 01:31:18.196076 64877 main.go:141] libmachine: (old-k8s-version-612261) <vcpu>2</vcpu>
I0927 01:31:18.196085 64877 main.go:141] libmachine: (old-k8s-version-612261) <features>
I0927 01:31:18.196099 64877 main.go:141] libmachine: (old-k8s-version-612261) <acpi/>
I0927 01:31:18.196109 64877 main.go:141] libmachine: (old-k8s-version-612261) <apic/>
I0927 01:31:18.196117 64877 main.go:141] libmachine: (old-k8s-version-612261) <pae/>
I0927 01:31:18.196123 64877 main.go:141] libmachine: (old-k8s-version-612261)
I0927 01:31:18.196136 64877 main.go:141] libmachine: (old-k8s-version-612261) </features>
I0927 01:31:18.196143 64877 main.go:141] libmachine: (old-k8s-version-612261) <cpu mode='host-passthrough'>
I0927 01:31:18.196155 64877 main.go:141] libmachine: (old-k8s-version-612261)
I0927 01:31:18.196164 64877 main.go:141] libmachine: (old-k8s-version-612261) </cpu>
I0927 01:31:18.196173 64877 main.go:141] libmachine: (old-k8s-version-612261) <os>
I0927 01:31:18.196183 64877 main.go:141] libmachine: (old-k8s-version-612261) <type>hvm</type>
I0927 01:31:18.196195 64877 main.go:141] libmachine: (old-k8s-version-612261) <boot dev='cdrom'/>
I0927 01:31:18.196205 64877 main.go:141] libmachine: (old-k8s-version-612261) <boot dev='hd'/>
I0927 01:31:18.196213 64877 main.go:141] libmachine: (old-k8s-version-612261) <bootmenu enable='no'/>
I0927 01:31:18.196221 64877 main.go:141] libmachine: (old-k8s-version-612261) </os>
I0927 01:31:18.196228 64877 main.go:141] libmachine: (old-k8s-version-612261) <devices>
I0927 01:31:18.196240 64877 main.go:141] libmachine: (old-k8s-version-612261) <disk type='file' device='cdrom'>
I0927 01:31:18.196253 64877 main.go:141] libmachine: (old-k8s-version-612261) <source file='/home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/boot2docker.iso'/>
I0927 01:31:18.196263 64877 main.go:141] libmachine: (old-k8s-version-612261) <target dev='hdc' bus='scsi'/>
I0927 01:31:18.196271 64877 main.go:141] libmachine: (old-k8s-version-612261) <readonly/>
I0927 01:31:18.196290 64877 main.go:141] libmachine: (old-k8s-version-612261) </disk>
I0927 01:31:18.196303 64877 main.go:141] libmachine: (old-k8s-version-612261) <disk type='file' device='disk'>
I0927 01:31:18.196316 64877 main.go:141] libmachine: (old-k8s-version-612261) <driver name='qemu' type='raw' cache='default' io='threads' />
I0927 01:31:18.196332 64877 main.go:141] libmachine: (old-k8s-version-612261) <source file='/home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/old-k8s-version-612261.rawdisk'/>
I0927 01:31:18.196340 64877 main.go:141] libmachine: (old-k8s-version-612261) <target dev='hda' bus='virtio'/>
I0927 01:31:18.196348 64877 main.go:141] libmachine: (old-k8s-version-612261) </disk>
I0927 01:31:18.196357 64877 main.go:141] libmachine: (old-k8s-version-612261) <interface type='network'>
I0927 01:31:18.196367 64877 main.go:141] libmachine: (old-k8s-version-612261) <source network='mk-old-k8s-version-612261'/>
I0927 01:31:18.196376 64877 main.go:141] libmachine: (old-k8s-version-612261) <model type='virtio'/>
I0927 01:31:18.196385 64877 main.go:141] libmachine: (old-k8s-version-612261) </interface>
I0927 01:31:18.196395 64877 main.go:141] libmachine: (old-k8s-version-612261) <interface type='network'>
I0927 01:31:18.196413 64877 main.go:141] libmachine: (old-k8s-version-612261) <source network='default'/>
I0927 01:31:18.196420 64877 main.go:141] libmachine: (old-k8s-version-612261) <model type='virtio'/>
I0927 01:31:18.196433 64877 main.go:141] libmachine: (old-k8s-version-612261) </interface>
I0927 01:31:18.196445 64877 main.go:141] libmachine: (old-k8s-version-612261) <serial type='pty'>
I0927 01:31:18.196453 64877 main.go:141] libmachine: (old-k8s-version-612261) <target port='0'/>
I0927 01:31:18.196460 64877 main.go:141] libmachine: (old-k8s-version-612261) </serial>
I0927 01:31:18.196472 64877 main.go:141] libmachine: (old-k8s-version-612261) <console type='pty'>
I0927 01:31:18.196482 64877 main.go:141] libmachine: (old-k8s-version-612261) <target type='serial' port='0'/>
I0927 01:31:18.196492 64877 main.go:141] libmachine: (old-k8s-version-612261) </console>
I0927 01:31:18.196499 64877 main.go:141] libmachine: (old-k8s-version-612261) <rng model='virtio'>
I0927 01:31:18.196509 64877 main.go:141] libmachine: (old-k8s-version-612261) <backend model='random'>/dev/random</backend>
I0927 01:31:18.196519 64877 main.go:141] libmachine: (old-k8s-version-612261) </rng>
I0927 01:31:18.196527 64877 main.go:141] libmachine: (old-k8s-version-612261)
I0927 01:31:18.196537 64877 main.go:141] libmachine: (old-k8s-version-612261)
I0927 01:31:18.196545 64877 main.go:141] libmachine: (old-k8s-version-612261) </devices>
I0927 01:31:18.196554 64877 main.go:141] libmachine: (old-k8s-version-612261) </domain>
I0927 01:31:18.196565 64877 main.go:141] libmachine: (old-k8s-version-612261)
I0927 01:31:18.279141 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:bf:89:9f in network default
I0927 01:31:18.279853 64877 main.go:141] libmachine: (old-k8s-version-612261) Ensuring networks are active...
I0927 01:31:18.279885 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:18.280831 64877 main.go:141] libmachine: (old-k8s-version-612261) Ensuring network default is active
I0927 01:31:18.281321 64877 main.go:141] libmachine: (old-k8s-version-612261) Ensuring network mk-old-k8s-version-612261 is active
I0927 01:31:18.282035 64877 main.go:141] libmachine: (old-k8s-version-612261) Getting domain xml...
I0927 01:31:18.282761 64877 main.go:141] libmachine: (old-k8s-version-612261) Creating domain...
I0927 01:31:19.804109 64877 main.go:141] libmachine: (old-k8s-version-612261) Waiting to get IP...
I0927 01:31:19.804924 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:19.805368 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:19.805394 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:19.805348 65054 retry.go:31] will retry after 233.261285ms: waiting for machine to come up
I0927 01:31:20.039858 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:20.040411 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:20.040439 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:20.040354 65054 retry.go:31] will retry after 353.295076ms: waiting for machine to come up
I0927 01:31:20.394929 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:20.395538 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:20.395567 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:20.395474 65054 retry.go:31] will retry after 333.571623ms: waiting for machine to come up
I0927 01:31:20.730811 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:20.731273 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:20.731310 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:20.731241 65054 retry.go:31] will retry after 415.534476ms: waiting for machine to come up
I0927 01:31:21.148801 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:21.149238 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:21.149267 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:21.149203 65054 retry.go:31] will retry after 562.578322ms: waiting for machine to come up
I0927 01:31:21.713422 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:21.713781 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:21.713823 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:21.713756 65054 retry.go:31] will retry after 628.513435ms: waiting for machine to come up
I0927 01:31:22.343611 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:22.344144 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:22.344177 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:22.344089 65054 retry.go:31] will retry after 1.162650327s: waiting for machine to come up
I0927 01:31:23.508330 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:23.508839 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:23.508864 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:23.508804 65054 retry.go:31] will retry after 1.479051053s: waiting for machine to come up
I0927 01:31:24.989664 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:24.990344 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:24.990375 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:24.990271 65054 retry.go:31] will retry after 1.354016831s: waiting for machine to come up
I0927 01:31:26.345624 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:26.346207 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:26.346234 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:26.346163 65054 retry.go:31] will retry after 1.515087295s: waiting for machine to come up
I0927 01:31:27.862614 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:27.863078 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:27.863104 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:27.863035 65054 retry.go:31] will retry after 2.487539142s: waiting for machine to come up
I0927 01:31:30.353037 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:30.353665 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:30.353695 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:30.353602 65054 retry.go:31] will retry after 2.427598006s: waiting for machine to come up
I0927 01:31:32.783016 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:32.783658 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:32.783688 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:32.783600 65054 retry.go:31] will retry after 4.483955853s: waiting for machine to come up
I0927 01:31:37.270860 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:37.271414 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find current IP address of domain old-k8s-version-612261 in network mk-old-k8s-version-612261
I0927 01:31:37.271436 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | I0927 01:31:37.271380 65054 retry.go:31] will retry after 5.400728659s: waiting for machine to come up
I0927 01:31:42.673553 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:42.674084 64877 main.go:141] libmachine: (old-k8s-version-612261) Found IP for machine: 192.168.72.129
I0927 01:31:42.674121 64877 main.go:141] libmachine: (old-k8s-version-612261) Reserving static IP address...
I0927 01:31:42.674141 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has current primary IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:42.674531 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-612261", mac: "52:54:00:f1:a6:2e", ip: "192.168.72.129"} in network mk-old-k8s-version-612261
I0927 01:31:42.753237 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Getting to WaitForSSH function...
I0927 01:31:42.753260 64877 main.go:141] libmachine: (old-k8s-version-612261) Reserved static IP address: 192.168.72.129
I0927 01:31:42.753270 64877 main.go:141] libmachine: (old-k8s-version-612261) Waiting for SSH to be available...
I0927 01:31:42.755702 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:42.756130 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:minikube Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:42.756167 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:42.756245 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Using SSH client type: external
I0927 01:31:42.756271 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Using SSH private key: /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa (-rw-------)
I0927 01:31:42.756307 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.129 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa -p 22] /usr/bin/ssh <nil>}
I0927 01:31:42.756333 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | About to run SSH command:
I0927 01:31:42.756356 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | exit 0
I0927 01:31:42.887573 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | SSH cmd err, output: <nil>:
I0927 01:31:42.887817 64877 main.go:141] libmachine: (old-k8s-version-612261) KVM machine creation complete!
I0927 01:31:42.888152 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetConfigRaw
I0927 01:31:42.888662 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:42.888874 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:42.888993 64877 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0927 01:31:42.889017 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetState
I0927 01:31:42.890193 64877 main.go:141] libmachine: Detecting operating system of created instance...
I0927 01:31:42.890207 64877 main.go:141] libmachine: Waiting for SSH to be available...
I0927 01:31:42.890213 64877 main.go:141] libmachine: Getting to WaitForSSH function...
I0927 01:31:42.890220 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:42.892688 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:42.893034 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:42.893055 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:42.893174 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:42.893497 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:42.893645 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:42.893758 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:42.893906 64877 main.go:141] libmachine: Using SSH client type: native
I0927 01:31:42.894120 64877 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.129 22 <nil> <nil>}
I0927 01:31:42.894132 64877 main.go:141] libmachine: About to run SSH command:
exit 0
I0927 01:31:43.002596 64877 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0927 01:31:43.002617 64877 main.go:141] libmachine: Detecting the provisioner...
I0927 01:31:43.002624 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.005537 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.005903 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.005926 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.006160 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:43.006354 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.006506 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.006617 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:43.006754 64877 main.go:141] libmachine: Using SSH client type: native
I0927 01:31:43.006957 64877 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.129 22 <nil> <nil>}
I0927 01:31:43.006968 64877 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0927 01:31:43.115852 64877 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0927 01:31:43.115979 64877 main.go:141] libmachine: found compatible host: buildroot
I0927 01:31:43.115991 64877 main.go:141] libmachine: Provisioning with buildroot...
I0927 01:31:43.115998 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetMachineName
I0927 01:31:43.116281 64877 buildroot.go:166] provisioning hostname "old-k8s-version-612261"
I0927 01:31:43.116309 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetMachineName
I0927 01:31:43.116492 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.119026 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.119391 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.119424 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.119550 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:43.119713 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.119901 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.120068 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:43.120255 64877 main.go:141] libmachine: Using SSH client type: native
I0927 01:31:43.120415 64877 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.129 22 <nil> <nil>}
I0927 01:31:43.120428 64877 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-612261 && echo "old-k8s-version-612261" | sudo tee /etc/hostname
I0927 01:31:43.246862 64877 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-612261
I0927 01:31:43.246942 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.250154 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.250489 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.250516 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.250708 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:43.250950 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.251106 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.251287 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:43.251460 64877 main.go:141] libmachine: Using SSH client type: native
I0927 01:31:43.251675 64877 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.129 22 <nil> <nil>}
I0927 01:31:43.251703 64877 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-612261' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-612261/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-612261' | sudo tee -a /etc/hosts;
fi
fi
I0927 01:31:43.373427 64877 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0927 01:31:43.373451 64877 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19711-14935/.minikube CaCertPath:/home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19711-14935/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19711-14935/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19711-14935/.minikube}
I0927 01:31:43.373490 64877 buildroot.go:174] setting up certificates
I0927 01:31:43.373500 64877 provision.go:84] configureAuth start
I0927 01:31:43.373511 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetMachineName
I0927 01:31:43.373808 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetIP
I0927 01:31:43.376263 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.376646 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.376672 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.376864 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.379019 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.379371 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.379396 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.379559 64877 provision.go:143] copyHostCerts
I0927 01:31:43.379617 64877 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-14935/.minikube/key.pem, removing ...
I0927 01:31:43.379628 64877 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-14935/.minikube/key.pem
I0927 01:31:43.379695 64877 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19711-14935/.minikube/key.pem (1675 bytes)
I0927 01:31:43.379805 64877 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-14935/.minikube/ca.pem, removing ...
I0927 01:31:43.379813 64877 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-14935/.minikube/ca.pem
I0927 01:31:43.379833 64877 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19711-14935/.minikube/ca.pem (1078 bytes)
I0927 01:31:43.379897 64877 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-14935/.minikube/cert.pem, removing ...
I0927 01:31:43.379906 64877 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-14935/.minikube/cert.pem
I0927 01:31:43.379923 64877 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19711-14935/.minikube/cert.pem (1123 bytes)
I0927 01:31:43.379983 64877 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19711-14935/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-612261 san=[127.0.0.1 192.168.72.129 localhost minikube old-k8s-version-612261]
I0927 01:31:43.564123 64877 provision.go:177] copyRemoteCerts
I0927 01:31:43.564197 64877 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0927 01:31:43.564219 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.567076 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.567484 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.567513 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.567699 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:43.567864 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.567996 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:43.568110 64877 sshutil.go:53] new ssh client: &{IP:192.168.72.129 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa Username:docker}
I0927 01:31:43.653915 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0927 01:31:43.681516 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0927 01:31:43.705826 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0927 01:31:43.729530 64877 provision.go:87] duration metric: took 356.017058ms to configureAuth
I0927 01:31:43.729557 64877 buildroot.go:189] setting minikube options for container-runtime
I0927 01:31:43.729736 64877 config.go:182] Loaded profile config "old-k8s-version-612261": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0927 01:31:43.729826 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.732453 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.732805 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.732832 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.733017 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:43.733210 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.733376 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.733559 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:43.733734 64877 main.go:141] libmachine: Using SSH client type: native
I0927 01:31:43.733885 64877 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.129 22 <nil> <nil>}
I0927 01:31:43.733906 64877 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0927 01:31:43.959791 64877 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0927 01:31:43.959814 64877 main.go:141] libmachine: Checking connection to Docker...
I0927 01:31:43.959823 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetURL
I0927 01:31:43.961149 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | Using libvirt version 6000000
I0927 01:31:43.963322 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.963758 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.963786 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.963957 64877 main.go:141] libmachine: Docker is up and running!
I0927 01:31:43.963974 64877 main.go:141] libmachine: Reticulating splines...
I0927 01:31:43.963982 64877 client.go:171] duration metric: took 26.362364403s to LocalClient.Create
I0927 01:31:43.964009 64877 start.go:167] duration metric: took 26.362437384s to libmachine.API.Create "old-k8s-version-612261"
I0927 01:31:43.964022 64877 start.go:293] postStartSetup for "old-k8s-version-612261" (driver="kvm2")
I0927 01:31:43.964037 64877 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0927 01:31:43.964073 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:43.964296 64877 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0927 01:31:43.964323 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:43.966456 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.966823 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:43.966850 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:43.967035 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:43.967232 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:43.967413 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:43.967588 64877 sshutil.go:53] new ssh client: &{IP:192.168.72.129 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa Username:docker}
I0927 01:31:44.054185 64877 ssh_runner.go:195] Run: cat /etc/os-release
I0927 01:31:44.058695 64877 info.go:137] Remote host: Buildroot 2023.02.9
I0927 01:31:44.058723 64877 filesync.go:126] Scanning /home/jenkins/minikube-integration/19711-14935/.minikube/addons for local assets ...
I0927 01:31:44.058801 64877 filesync.go:126] Scanning /home/jenkins/minikube-integration/19711-14935/.minikube/files for local assets ...
I0927 01:31:44.058898 64877 filesync.go:149] local asset: /home/jenkins/minikube-integration/19711-14935/.minikube/files/etc/ssl/certs/221382.pem -> 221382.pem in /etc/ssl/certs
I0927 01:31:44.059027 64877 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0927 01:31:44.068978 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/files/etc/ssl/certs/221382.pem --> /etc/ssl/certs/221382.pem (1708 bytes)
I0927 01:31:44.096274 64877 start.go:296] duration metric: took 132.236848ms for postStartSetup
I0927 01:31:44.096350 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetConfigRaw
I0927 01:31:44.097035 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetIP
I0927 01:31:44.099665 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.099993 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:44.100035 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.100234 64877 profile.go:143] Saving config to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/config.json ...
I0927 01:31:44.100410 64877 start.go:128] duration metric: took 26.679871586s to createHost
I0927 01:31:44.100430 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:44.102607 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.102933 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:44.102970 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.103082 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:44.103237 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:44.103384 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:44.103548 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:44.103668 64877 main.go:141] libmachine: Using SSH client type: native
I0927 01:31:44.103862 64877 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.72.129 22 <nil> <nil>}
I0927 01:31:44.103873 64877 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0927 01:31:44.212041 64877 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727400704.188973892
I0927 01:31:44.212065 64877 fix.go:216] guest clock: 1727400704.188973892
I0927 01:31:44.212073 64877 fix.go:229] Guest: 2024-09-27 01:31:44.188973892 +0000 UTC Remote: 2024-09-27 01:31:44.100421117 +0000 UTC m=+40.352689217 (delta=88.552775ms)
I0927 01:31:44.212110 64877 fix.go:200] guest clock delta is within tolerance: 88.552775ms
I0927 01:31:44.212116 64877 start.go:83] releasing machines lock for "old-k8s-version-612261", held for 26.791748771s
I0927 01:31:44.212142 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:44.212393 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetIP
I0927 01:31:44.215108 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.215526 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:44.215554 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.215745 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:44.216210 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:44.216388 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .DriverName
I0927 01:31:44.216485 64877 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0927 01:31:44.216536 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:44.216592 64877 ssh_runner.go:195] Run: cat /version.json
I0927 01:31:44.216621 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHHostname
I0927 01:31:44.219281 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.219464 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.219644 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:44.219674 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.219905 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:44.219905 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:44.219990 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:44.220020 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHPort
I0927 01:31:44.220138 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:44.220220 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHKeyPath
I0927 01:31:44.220600 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:44.220619 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetSSHUsername
I0927 01:31:44.220944 64877 sshutil.go:53] new ssh client: &{IP:192.168.72.129 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa Username:docker}
I0927 01:31:44.221003 64877 sshutil.go:53] new ssh client: &{IP:192.168.72.129 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19711-14935/.minikube/machines/old-k8s-version-612261/id_rsa Username:docker}
I0927 01:31:44.326174 64877 ssh_runner.go:195] Run: systemctl --version
I0927 01:31:44.332762 64877 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0927 01:31:44.496967 64877 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0927 01:31:44.503606 64877 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0927 01:31:44.503660 64877 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 01:31:44.520768 64877 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0927 01:31:44.520796 64877 start.go:495] detecting cgroup driver to use...
I0927 01:31:44.520864 64877 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0927 01:31:44.538496 64877 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0927 01:31:44.551248 64877 docker.go:217] disabling cri-docker service (if available) ...
I0927 01:31:44.551297 64877 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0927 01:31:44.565400 64877 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0927 01:31:44.579697 64877 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0927 01:31:44.712797 64877 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0927 01:31:44.875702 64877 docker.go:233] disabling docker service ...
I0927 01:31:44.875768 64877 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0927 01:31:44.890381 64877 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0927 01:31:44.903802 64877 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0927 01:31:45.032077 64877 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0927 01:31:45.160934 64877 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0927 01:31:45.176525 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0927 01:31:45.195544 64877 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0927 01:31:45.195612 64877 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:31:45.206832 64877 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0927 01:31:45.206908 64877 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:31:45.218950 64877 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:31:45.229355 64877 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:31:45.239706 64877 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0927 01:31:45.250444 64877 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0927 01:31:45.260435 64877 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0927 01:31:45.260506 64877 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0927 01:31:45.274522 64877 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0927 01:31:45.284807 64877 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:31:45.417282 64877 ssh_runner.go:195] Run: sudo systemctl restart crio
I0927 01:31:45.510344 64877 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0927 01:31:45.510411 64877 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0927 01:31:45.515055 64877 start.go:563] Will wait 60s for crictl version
I0927 01:31:45.515105 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:45.518939 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0927 01:31:45.560046 64877 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0927 01:31:45.560164 64877 ssh_runner.go:195] Run: crio --version
I0927 01:31:45.590270 64877 ssh_runner.go:195] Run: crio --version
I0927 01:31:45.621483 64877 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0927 01:31:45.622771 64877 main.go:141] libmachine: (old-k8s-version-612261) Calling .GetIP
I0927 01:31:45.625674 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:45.625993 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f1:a6:2e", ip: ""} in network mk-old-k8s-version-612261: {Iface:virbr1 ExpiryTime:2024-09-27 02:31:33 +0000 UTC Type:0 Mac:52:54:00:f1:a6:2e Iaid: IPaddr:192.168.72.129 Prefix:24 Hostname:old-k8s-version-612261 Clientid:01:52:54:00:f1:a6:2e}
I0927 01:31:45.626028 64877 main.go:141] libmachine: (old-k8s-version-612261) DBG | domain old-k8s-version-612261 has defined IP address 192.168.72.129 and MAC address 52:54:00:f1:a6:2e in network mk-old-k8s-version-612261
I0927 01:31:45.626191 64877 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0927 01:31:45.630262 64877 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 01:31:45.643394 64877 kubeadm.go:883] updating cluster {Name:old-k8s-version-612261 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-612261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.129 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0927 01:31:45.643529 64877 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0927 01:31:45.643589 64877 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 01:31:45.677310 64877 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0927 01:31:45.677378 64877 ssh_runner.go:195] Run: which lz4
I0927 01:31:45.681420 64877 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0927 01:31:45.685475 64877 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0927 01:31:45.685504 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0927 01:31:47.309254 64877 crio.go:462] duration metric: took 1.627858421s to copy over tarball
I0927 01:31:47.309330 64877 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0927 01:31:49.812668 64877 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.503309149s)
I0927 01:31:49.812699 64877 crio.go:469] duration metric: took 2.503414086s to extract the tarball
I0927 01:31:49.812710 64877 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0927 01:31:49.855869 64877 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 01:31:49.901602 64877 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0927 01:31:49.901626 64877 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0927 01:31:49.901692 64877 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0927 01:31:49.901700 64877 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:49.901747 64877 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:49.901843 64877 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0927 01:31:49.901745 64877 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:49.901771 64877 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0927 01:31:49.901779 64877 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0927 01:31:49.901780 64877 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:49.902862 64877 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:49.902973 64877 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:49.903029 64877 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:49.903045 64877 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0927 01:31:49.903065 64877 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0927 01:31:49.903139 64877 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:49.903200 64877 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0927 01:31:49.903350 64877 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0927 01:31:50.067957 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0927 01:31:50.069389 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0927 01:31:50.079532 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:50.086147 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:50.092993 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:50.101212 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0927 01:31:50.109982 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:50.178928 64877 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0927 01:31:50.178963 64877 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0927 01:31:50.179007 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.179192 64877 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0927 01:31:50.179222 64877 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0927 01:31:50.179255 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.222120 64877 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0927 01:31:50.222154 64877 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:50.222191 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.248671 64877 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0927 01:31:50.248779 64877 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:50.248832 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.248722 64877 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0927 01:31:50.248875 64877 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:50.248927 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.256018 64877 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0927 01:31:50.256054 64877 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0927 01:31:50.256096 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.276388 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0927 01:31:50.276416 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0927 01:31:50.276491 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:50.276495 64877 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0927 01:31:50.276527 64877 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:50.276541 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:50.276554 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:50.276565 64877 ssh_runner.go:195] Run: which crictl
I0927 01:31:50.276573 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0927 01:31:50.419572 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:50.419705 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0927 01:31:50.420094 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:50.495631 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:50.495631 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0927 01:31:50.495713 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:50.495724 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0927 01:31:50.495836 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0927 01:31:50.495857 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:50.495917 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0927 01:31:50.648010 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0927 01:31:50.648061 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0927 01:31:50.648121 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0927 01:31:50.648167 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0927 01:31:50.648200 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0927 01:31:50.648252 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0927 01:31:50.648288 64877 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0927 01:31:50.765770 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0927 01:31:50.772260 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0927 01:31:50.772288 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0927 01:31:50.772365 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0927 01:31:50.772405 64877 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0927 01:31:51.107128 64877 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0927 01:31:51.252795 64877 cache_images.go:92] duration metric: took 1.351151665s to LoadCachedImages
W0927 01:31:51.252883 64877 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19711-14935/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0927 01:31:51.252900 64877 kubeadm.go:934] updating node { 192.168.72.129 8443 v1.20.0 crio true true} ...
I0927 01:31:51.253039 64877 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-612261 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.129
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-612261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0927 01:31:51.253120 64877 ssh_runner.go:195] Run: crio config
I0927 01:31:51.304933 64877 cni.go:84] Creating CNI manager for ""
I0927 01:31:51.304956 64877 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0927 01:31:51.304966 64877 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0927 01:31:51.304983 64877 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.129 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-612261 NodeName:old-k8s-version-612261 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.129"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.129 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0927 01:31:51.305101 64877 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.129
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-612261"
kubeletExtraArgs:
node-ip: 192.168.72.129
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.129"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0927 01:31:51.305165 64877 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0927 01:31:51.315039 64877 binaries.go:44] Found k8s binaries, skipping transfer
I0927 01:31:51.315108 64877 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0927 01:31:51.324915 64877 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0927 01:31:51.342095 64877 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0927 01:31:51.359144 64877 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0927 01:31:51.377267 64877 ssh_runner.go:195] Run: grep 192.168.72.129 control-plane.minikube.internal$ /etc/hosts
I0927 01:31:51.381542 64877 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.129 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 01:31:51.394722 64877 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:31:51.524849 64877 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 01:31:51.542550 64877 certs.go:68] Setting up /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261 for IP: 192.168.72.129
I0927 01:31:51.542578 64877 certs.go:194] generating shared ca certs ...
I0927 01:31:51.542600 64877 certs.go:226] acquiring lock for ca certs: {Name:mkdfc5b7e93f77f5ae72cc653545624244421aa5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.542785 64877 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19711-14935/.minikube/ca.key
I0927 01:31:51.542841 64877 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19711-14935/.minikube/proxy-client-ca.key
I0927 01:31:51.542854 64877 certs.go:256] generating profile certs ...
I0927 01:31:51.542928 64877 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/client.key
I0927 01:31:51.542946 64877 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/client.crt with IP's: []
I0927 01:31:51.624811 64877 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/client.crt ...
I0927 01:31:51.624853 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/client.crt: {Name:mk0e4166155e6a8bdfca20d3242a42c8d4bd7130 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.625057 64877 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/client.key ...
I0927 01:31:51.625073 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/client.key: {Name:mk01a5590aef45deeab94585f1f47ca3e3b0da88 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.625183 64877 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.key.a362196e
I0927 01:31:51.625204 64877 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.crt.a362196e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.129]
I0927 01:31:51.706028 64877 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.crt.a362196e ...
I0927 01:31:51.706056 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.crt.a362196e: {Name:mkd51549172547db5289d41377e963dac7c3b497 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.706238 64877 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.key.a362196e ...
I0927 01:31:51.706255 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.key.a362196e: {Name:mk9a0c748b181ab4657f15d70e36c30fac997205 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.706344 64877 certs.go:381] copying /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.crt.a362196e -> /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.crt
I0927 01:31:51.706460 64877 certs.go:385] copying /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.key.a362196e -> /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.key
I0927 01:31:51.706538 64877 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.key
I0927 01:31:51.706559 64877 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.crt with IP's: []
I0927 01:31:51.773581 64877 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.crt ...
I0927 01:31:51.773611 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.crt: {Name:mk0183ef62bfecb368453d9c6f49e6f10190b44f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.794173 64877 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.key ...
I0927 01:31:51.794220 64877 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.key: {Name:mk0d5a5600c34377e022e50a98290e38d9b02e53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:31:51.794493 64877 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/22138.pem (1338 bytes)
W0927 01:31:51.794546 64877 certs.go:480] ignoring /home/jenkins/minikube-integration/19711-14935/.minikube/certs/22138_empty.pem, impossibly tiny 0 bytes
I0927 01:31:51.794565 64877 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca-key.pem (1671 bytes)
I0927 01:31:51.794595 64877 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/ca.pem (1078 bytes)
I0927 01:31:51.794621 64877 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/cert.pem (1123 bytes)
I0927 01:31:51.794656 64877 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-14935/.minikube/certs/key.pem (1675 bytes)
I0927 01:31:51.794707 64877 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-14935/.minikube/files/etc/ssl/certs/221382.pem (1708 bytes)
I0927 01:31:51.795400 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0927 01:31:51.822353 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0927 01:31:51.846511 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0927 01:31:51.872207 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0927 01:31:51.897059 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0927 01:31:51.932087 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0927 01:31:51.959698 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0927 01:31:51.984974 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/profiles/old-k8s-version-612261/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0927 01:31:52.011989 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0927 01:31:52.036604 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/certs/22138.pem --> /usr/share/ca-certificates/22138.pem (1338 bytes)
I0927 01:31:52.062923 64877 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-14935/.minikube/files/etc/ssl/certs/221382.pem --> /usr/share/ca-certificates/221382.pem (1708 bytes)
I0927 01:31:52.089536 64877 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0927 01:31:52.106962 64877 ssh_runner.go:195] Run: openssl version
I0927 01:31:52.113135 64877 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/221382.pem && ln -fs /usr/share/ca-certificates/221382.pem /etc/ssl/certs/221382.pem"
I0927 01:31:52.124825 64877 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/221382.pem
I0927 01:31:52.129798 64877 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 27 00:32 /usr/share/ca-certificates/221382.pem
I0927 01:31:52.129856 64877 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/221382.pem
I0927 01:31:52.136032 64877 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/221382.pem /etc/ssl/certs/3ec20f2e.0"
I0927 01:31:52.148099 64877 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0927 01:31:52.160547 64877 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0927 01:31:52.165804 64877 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 27 00:16 /usr/share/ca-certificates/minikubeCA.pem
I0927 01:31:52.165860 64877 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0927 01:31:52.172143 64877 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0927 01:31:52.184594 64877 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/22138.pem && ln -fs /usr/share/ca-certificates/22138.pem /etc/ssl/certs/22138.pem"
I0927 01:31:52.196329 64877 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/22138.pem
I0927 01:31:52.201077 64877 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 27 00:32 /usr/share/ca-certificates/22138.pem
I0927 01:31:52.201145 64877 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/22138.pem
I0927 01:31:52.206960 64877 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/22138.pem /etc/ssl/certs/51391683.0"
I0927 01:31:52.219385 64877 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0927 01:31:52.223960 64877 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0927 01:31:52.224021 64877 kubeadm.go:392] StartCluster: {Name:old-k8s-version-612261 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-612261 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.129 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:31:52.224098 64877 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0927 01:31:52.224162 64877 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0927 01:31:52.266672 64877 cri.go:89] found id: ""
I0927 01:31:52.266750 64877 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0927 01:31:52.277761 64877 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0927 01:31:52.288015 64877 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0927 01:31:52.298570 64877 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0927 01:31:52.298591 64877 kubeadm.go:157] found existing configuration files:
I0927 01:31:52.298642 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0927 01:31:52.308579 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0927 01:31:52.308633 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0927 01:31:52.319062 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0927 01:31:52.329388 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0927 01:31:52.329456 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0927 01:31:52.340024 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0927 01:31:52.350224 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0927 01:31:52.350277 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0927 01:31:52.364718 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0927 01:31:52.375380 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0927 01:31:52.375443 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0927 01:31:52.386374 64877 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0927 01:31:52.532726 64877 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0927 01:31:52.532808 64877 kubeadm.go:310] [preflight] Running pre-flight checks
I0927 01:31:52.725985 64877 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0927 01:31:52.726112 64877 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0927 01:31:52.726242 64877 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0927 01:31:52.926629 64877 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0927 01:31:52.963780 64877 out.go:235] - Generating certificates and keys ...
I0927 01:31:52.963895 64877 kubeadm.go:310] [certs] Using existing ca certificate authority
I0927 01:31:52.963967 64877 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0927 01:31:53.006940 64877 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0927 01:31:53.184655 64877 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0927 01:31:53.302103 64877 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0927 01:31:53.577995 64877 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0927 01:31:53.957719 64877 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0927 01:31:53.957919 64877 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-612261] and IPs [192.168.72.129 127.0.0.1 ::1]
I0927 01:31:54.116971 64877 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0927 01:31:54.117217 64877 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-612261] and IPs [192.168.72.129 127.0.0.1 ::1]
I0927 01:31:54.167766 64877 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0927 01:31:54.275865 64877 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0927 01:31:54.349952 64877 kubeadm.go:310] [certs] Generating "sa" key and public key
I0927 01:31:54.350381 64877 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0927 01:31:54.515208 64877 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0927 01:31:54.734962 64877 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0927 01:31:54.834012 64877 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0927 01:31:54.971481 64877 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0927 01:31:54.989694 64877 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0927 01:31:54.992989 64877 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0927 01:31:54.993069 64877 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0927 01:31:55.128641 64877 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0927 01:31:55.130541 64877 out.go:235] - Booting up control plane ...
I0927 01:31:55.130659 64877 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0927 01:31:55.135571 64877 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0927 01:31:55.136665 64877 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0927 01:31:55.138370 64877 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0927 01:31:55.143163 64877 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0927 01:32:35.138565 64877 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0927 01:32:35.138684 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:32:35.138961 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:32:40.138719 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:32:40.138952 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:32:50.138160 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:32:50.138377 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:33:10.137681 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:33:10.137861 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:33:50.138876 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:33:50.139214 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:33:50.139242 64877 kubeadm.go:310]
I0927 01:33:50.139297 64877 kubeadm.go:310] Unfortunately, an error has occurred:
I0927 01:33:50.139375 64877 kubeadm.go:310] timed out waiting for the condition
I0927 01:33:50.139391 64877 kubeadm.go:310]
I0927 01:33:50.139443 64877 kubeadm.go:310] This error is likely caused by:
I0927 01:33:50.139488 64877 kubeadm.go:310] - The kubelet is not running
I0927 01:33:50.139640 64877 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0927 01:33:50.139669 64877 kubeadm.go:310]
I0927 01:33:50.139847 64877 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0927 01:33:50.139903 64877 kubeadm.go:310] - 'systemctl status kubelet'
I0927 01:33:50.139949 64877 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0927 01:33:50.139959 64877 kubeadm.go:310]
I0927 01:33:50.140086 64877 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0927 01:33:50.140192 64877 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0927 01:33:50.140201 64877 kubeadm.go:310]
I0927 01:33:50.140348 64877 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0927 01:33:50.140497 64877 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0927 01:33:50.140595 64877 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0927 01:33:50.140687 64877 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0927 01:33:50.140698 64877 kubeadm.go:310]
I0927 01:33:50.141305 64877 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0927 01:33:50.141425 64877 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0927 01:33:50.141524 64877 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0927 01:33:50.141655 64877 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-612261] and IPs [192.168.72.129 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-612261] and IPs [192.168.72.129 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-612261] and IPs [192.168.72.129 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-612261] and IPs [192.168.72.129 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0927 01:33:50.141703 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0927 01:33:51.513386 64877 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.371658213s)
I0927 01:33:51.513488 64877 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0927 01:33:51.528087 64877 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0927 01:33:51.542064 64877 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0927 01:33:51.542086 64877 kubeadm.go:157] found existing configuration files:
I0927 01:33:51.542137 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0927 01:33:51.552101 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0927 01:33:51.552172 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0927 01:33:51.563075 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0927 01:33:51.573112 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0927 01:33:51.573177 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0927 01:33:51.584265 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0927 01:33:51.594319 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0927 01:33:51.594397 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0927 01:33:51.605022 64877 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0927 01:33:51.614711 64877 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0927 01:33:51.614776 64877 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0927 01:33:51.624575 64877 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0927 01:33:51.843787 64877 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0927 01:35:48.049028 64877 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0927 01:35:48.049273 64877 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0927 01:35:48.050546 64877 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0927 01:35:48.050597 64877 kubeadm.go:310] [preflight] Running pre-flight checks
I0927 01:35:48.050665 64877 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0927 01:35:48.050776 64877 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0927 01:35:48.050869 64877 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0927 01:35:48.050930 64877 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0927 01:35:48.053474 64877 out.go:235] - Generating certificates and keys ...
I0927 01:35:48.053555 64877 kubeadm.go:310] [certs] Using existing ca certificate authority
I0927 01:35:48.053613 64877 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0927 01:35:48.053703 64877 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0927 01:35:48.053790 64877 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0927 01:35:48.053895 64877 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0927 01:35:48.053988 64877 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0927 01:35:48.054074 64877 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0927 01:35:48.054155 64877 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0927 01:35:48.054262 64877 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0927 01:35:48.054358 64877 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0927 01:35:48.054410 64877 kubeadm.go:310] [certs] Using the existing "sa" key
I0927 01:35:48.054462 64877 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0927 01:35:48.054508 64877 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0927 01:35:48.054557 64877 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0927 01:35:48.054610 64877 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0927 01:35:48.054660 64877 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0927 01:35:48.054793 64877 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0927 01:35:48.054874 64877 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0927 01:35:48.054910 64877 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0927 01:35:48.055006 64877 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0927 01:35:48.056594 64877 out.go:235] - Booting up control plane ...
I0927 01:35:48.056702 64877 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0927 01:35:48.056806 64877 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0927 01:35:48.056896 64877 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0927 01:35:48.056974 64877 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0927 01:35:48.057103 64877 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0927 01:35:48.057147 64877 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0927 01:35:48.057213 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:35:48.057412 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:35:48.057505 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:35:48.057691 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:35:48.057785 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:35:48.057980 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:35:48.058050 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:35:48.058221 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:35:48.058318 64877 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0927 01:35:48.058511 64877 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0927 01:35:48.058521 64877 kubeadm.go:310]
I0927 01:35:48.058587 64877 kubeadm.go:310] Unfortunately, an error has occurred:
I0927 01:35:48.058650 64877 kubeadm.go:310] timed out waiting for the condition
I0927 01:35:48.058659 64877 kubeadm.go:310]
I0927 01:35:48.058714 64877 kubeadm.go:310] This error is likely caused by:
I0927 01:35:48.058768 64877 kubeadm.go:310] - The kubelet is not running
I0927 01:35:48.058904 64877 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0927 01:35:48.058915 64877 kubeadm.go:310]
I0927 01:35:48.059023 64877 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0927 01:35:48.059058 64877 kubeadm.go:310] - 'systemctl status kubelet'
I0927 01:35:48.059086 64877 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0927 01:35:48.059092 64877 kubeadm.go:310]
I0927 01:35:48.059239 64877 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0927 01:35:48.059334 64877 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0927 01:35:48.059345 64877 kubeadm.go:310]
I0927 01:35:48.059476 64877 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0927 01:35:48.059559 64877 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0927 01:35:48.059652 64877 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0927 01:35:48.059749 64877 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0927 01:35:48.059795 64877 kubeadm.go:310]
I0927 01:35:48.059807 64877 kubeadm.go:394] duration metric: took 3m55.835788752s to StartCluster
I0927 01:35:48.059863 64877 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:35:48.059916 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:35:48.104181 64877 cri.go:89] found id: ""
I0927 01:35:48.104204 64877 logs.go:276] 0 containers: []
W0927 01:35:48.104212 64877 logs.go:278] No container was found matching "kube-apiserver"
I0927 01:35:48.104218 64877 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:35:48.104272 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:35:48.139007 64877 cri.go:89] found id: ""
I0927 01:35:48.139036 64877 logs.go:276] 0 containers: []
W0927 01:35:48.139054 64877 logs.go:278] No container was found matching "etcd"
I0927 01:35:48.139062 64877 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:35:48.139145 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:35:48.173904 64877 cri.go:89] found id: ""
I0927 01:35:48.173936 64877 logs.go:276] 0 containers: []
W0927 01:35:48.173947 64877 logs.go:278] No container was found matching "coredns"
I0927 01:35:48.173955 64877 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:35:48.174009 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:35:48.209136 64877 cri.go:89] found id: ""
I0927 01:35:48.209162 64877 logs.go:276] 0 containers: []
W0927 01:35:48.209174 64877 logs.go:278] No container was found matching "kube-scheduler"
I0927 01:35:48.209182 64877 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:35:48.209248 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:35:48.240858 64877 cri.go:89] found id: ""
I0927 01:35:48.240881 64877 logs.go:276] 0 containers: []
W0927 01:35:48.240889 64877 logs.go:278] No container was found matching "kube-proxy"
I0927 01:35:48.240896 64877 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:35:48.240953 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:35:48.276854 64877 cri.go:89] found id: ""
I0927 01:35:48.276885 64877 logs.go:276] 0 containers: []
W0927 01:35:48.276896 64877 logs.go:278] No container was found matching "kube-controller-manager"
I0927 01:35:48.276904 64877 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:35:48.276962 64877 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:35:48.313943 64877 cri.go:89] found id: ""
I0927 01:35:48.313963 64877 logs.go:276] 0 containers: []
W0927 01:35:48.313971 64877 logs.go:278] No container was found matching "kindnet"
I0927 01:35:48.313986 64877 logs.go:123] Gathering logs for dmesg ...
I0927 01:35:48.314003 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:35:48.327641 64877 logs.go:123] Gathering logs for describe nodes ...
I0927 01:35:48.327667 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0927 01:35:48.440264 64877 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0927 01:35:48.440287 64877 logs.go:123] Gathering logs for CRI-O ...
I0927 01:35:48.440302 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:35:48.546384 64877 logs.go:123] Gathering logs for container status ...
I0927 01:35:48.546419 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:35:48.587812 64877 logs.go:123] Gathering logs for kubelet ...
I0927 01:35:48.587844 64877 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:35:48.657267 64877 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0927 01:35:48.657354 64877 out.go:270] *
*
W0927 01:35:48.657422 64877 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0927 01:35:48.657440 64877 out.go:270] *
*
W0927 01:35:48.658237 64877 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0927 01:35:48.661857 64877 out.go:201]
W0927 01:35:48.663390 64877 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0927 01:35:48.663436 64877 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0927 01:35:48.663464 64877 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0927 01:35:48.665091 64877 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-612261 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-612261 -n old-k8s-version-612261
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-612261 -n old-k8s-version-612261: exit status 6 (216.743044ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0927 01:35:48.922681 68500 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-612261" does not appear in /home/jenkins/minikube-integration/19711-14935/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-612261" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (285.19s)