=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-882237 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0816 13:33:56.822752 11149 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/addons-966941/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-882237 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m18.724424637s)
-- stdout --
* [old-k8s-version-882237] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19423
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19423-3966/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-3966/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-882237" primary control-plane node in "old-k8s-version-882237" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0816 13:33:44.407892 53711 out.go:345] Setting OutFile to fd 1 ...
I0816 13:33:44.407990 53711 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 13:33:44.407997 53711 out.go:358] Setting ErrFile to fd 2...
I0816 13:33:44.408001 53711 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 13:33:44.408176 53711 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19423-3966/.minikube/bin
I0816 13:33:44.408753 53711 out.go:352] Setting JSON to false
I0816 13:33:44.409664 53711 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4569,"bootTime":1723810655,"procs":196,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0816 13:33:44.409725 53711 start.go:139] virtualization: kvm guest
I0816 13:33:44.412042 53711 out.go:177] * [old-k8s-version-882237] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0816 13:33:44.413394 53711 out.go:177] - MINIKUBE_LOCATION=19423
I0816 13:33:44.413442 53711 notify.go:220] Checking for updates...
I0816 13:33:44.415798 53711 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0816 13:33:44.417062 53711 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19423-3966/kubeconfig
I0816 13:33:44.418453 53711 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-3966/.minikube
I0816 13:33:44.419910 53711 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0816 13:33:44.421387 53711 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0816 13:33:44.423213 53711 config.go:182] Loaded profile config "cert-expiration-050553": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 13:33:44.423336 53711 config.go:182] Loaded profile config "cert-options-779306": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 13:33:44.423440 53711 config.go:182] Loaded profile config "kubernetes-upgrade-759623": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 13:33:44.423540 53711 driver.go:394] Setting default libvirt URI to qemu:///system
I0816 13:33:44.466805 53711 out.go:177] * Using the kvm2 driver based on user configuration
I0816 13:33:44.468339 53711 start.go:297] selected driver: kvm2
I0816 13:33:44.468359 53711 start.go:901] validating driver "kvm2" against <nil>
I0816 13:33:44.468371 53711 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0816 13:33:44.469167 53711 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 13:33:44.469249 53711 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19423-3966/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0816 13:33:44.484971 53711 install.go:137] /home/jenkins/minikube-integration/19423-3966/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0816 13:33:44.485040 53711 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0816 13:33:44.485285 53711 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0816 13:33:44.485332 53711 cni.go:84] Creating CNI manager for ""
I0816 13:33:44.485355 53711 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0816 13:33:44.485373 53711 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0816 13:33:44.485432 53711 start.go:340] cluster config:
{Name:old-k8s-version-882237 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-882237 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 13:33:44.485537 53711 iso.go:125] acquiring lock: {Name:mk00139b359c6fe4c84d80e843a2099303fb7c5b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 13:33:44.488730 53711 out.go:177] * Starting "old-k8s-version-882237" primary control-plane node in "old-k8s-version-882237" cluster
I0816 13:33:44.490183 53711 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0816 13:33:44.490246 53711 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0816 13:33:44.490258 53711 cache.go:56] Caching tarball of preloaded images
I0816 13:33:44.490339 53711 preload.go:172] Found /home/jenkins/minikube-integration/19423-3966/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0816 13:33:44.490351 53711 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0816 13:33:44.490448 53711 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/config.json ...
I0816 13:33:44.490472 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/config.json: {Name:mk3af00a1f07964ba25654c40fbab5e5ad86df61 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:33:44.490632 53711 start.go:360] acquireMachinesLock for old-k8s-version-882237: {Name:mk0b4b88ee8893cefe753073bc08069ac50e5641 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0816 13:34:34.218290 53711 start.go:364] duration metric: took 49.727592736s to acquireMachinesLock for "old-k8s-version-882237"
I0816 13:34:34.218400 53711 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-882237 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-882237 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0816 13:34:34.218526 53711 start.go:125] createHost starting for "" (driver="kvm2")
I0816 13:34:34.220753 53711 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0816 13:34:34.220995 53711 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19423-3966/.minikube/bin/docker-machine-driver-kvm2
I0816 13:34:34.221038 53711 main.go:141] libmachine: Launching plugin server for driver kvm2
I0816 13:34:34.237180 53711 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45243
I0816 13:34:34.237652 53711 main.go:141] libmachine: () Calling .GetVersion
I0816 13:34:34.238284 53711 main.go:141] libmachine: Using API Version 1
I0816 13:34:34.238307 53711 main.go:141] libmachine: () Calling .SetConfigRaw
I0816 13:34:34.238630 53711 main.go:141] libmachine: () Calling .GetMachineName
I0816 13:34:34.238864 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetMachineName
I0816 13:34:34.239070 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:34.239236 53711 start.go:159] libmachine.API.Create for "old-k8s-version-882237" (driver="kvm2")
I0816 13:34:34.239275 53711 client.go:168] LocalClient.Create starting
I0816 13:34:34.239308 53711 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca.pem
I0816 13:34:34.239344 53711 main.go:141] libmachine: Decoding PEM data...
I0816 13:34:34.239364 53711 main.go:141] libmachine: Parsing certificate...
I0816 13:34:34.239433 53711 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19423-3966/.minikube/certs/cert.pem
I0816 13:34:34.239458 53711 main.go:141] libmachine: Decoding PEM data...
I0816 13:34:34.239475 53711 main.go:141] libmachine: Parsing certificate...
I0816 13:34:34.239498 53711 main.go:141] libmachine: Running pre-create checks...
I0816 13:34:34.239510 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .PreCreateCheck
I0816 13:34:34.239839 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetConfigRaw
I0816 13:34:34.240199 53711 main.go:141] libmachine: Creating machine...
I0816 13:34:34.240212 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .Create
I0816 13:34:34.240320 53711 main.go:141] libmachine: (old-k8s-version-882237) Creating KVM machine...
I0816 13:34:34.241488 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found existing default KVM network
I0816 13:34:34.242677 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.242529 54366 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:5d:d7:42} reservation:<nil>}
I0816 13:34:34.243523 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.243458 54366 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:cc:5c:97} reservation:<nil>}
I0816 13:34:34.244656 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.244595 54366 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:be:96:5e} reservation:<nil>}
I0816 13:34:34.245824 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.245742 54366 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003091b0}
I0816 13:34:34.245856 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | created network xml:
I0816 13:34:34.245873 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | <network>
I0816 13:34:34.245884 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | <name>mk-old-k8s-version-882237</name>
I0816 13:34:34.245897 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | <dns enable='no'/>
I0816 13:34:34.245907 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG |
I0816 13:34:34.245917 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0816 13:34:34.245932 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | <dhcp>
I0816 13:34:34.245946 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0816 13:34:34.245955 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | </dhcp>
I0816 13:34:34.245963 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | </ip>
I0816 13:34:34.245972 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG |
I0816 13:34:34.245982 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | </network>
I0816 13:34:34.245998 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG |
I0816 13:34:34.251486 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | trying to create private KVM network mk-old-k8s-version-882237 192.168.72.0/24...
I0816 13:34:34.320574 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | private KVM network mk-old-k8s-version-882237 192.168.72.0/24 created
I0816 13:34:34.320629 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.320541 54366 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19423-3966/.minikube
I0816 13:34:34.320650 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting up store path in /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237 ...
I0816 13:34:34.320680 53711 main.go:141] libmachine: (old-k8s-version-882237) Building disk image from file:///home/jenkins/minikube-integration/19423-3966/.minikube/cache/iso/amd64/minikube-v1.33.1-1723650137-19443-amd64.iso
I0816 13:34:34.320703 53711 main.go:141] libmachine: (old-k8s-version-882237) Downloading /home/jenkins/minikube-integration/19423-3966/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19423-3966/.minikube/cache/iso/amd64/minikube-v1.33.1-1723650137-19443-amd64.iso...
I0816 13:34:34.560675 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.560552 54366 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa...
I0816 13:34:34.704560 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.704434 54366 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/old-k8s-version-882237.rawdisk...
I0816 13:34:34.704595 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Writing magic tar header
I0816 13:34:34.704613 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Writing SSH key tar header
I0816 13:34:34.704631 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:34.704578 54366 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237 ...
I0816 13:34:34.704763 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237
I0816 13:34:34.704797 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting executable bit set on /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237 (perms=drwx------)
I0816 13:34:34.704811 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-3966/.minikube/machines
I0816 13:34:34.704840 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting executable bit set on /home/jenkins/minikube-integration/19423-3966/.minikube/machines (perms=drwxr-xr-x)
I0816 13:34:34.704862 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting executable bit set on /home/jenkins/minikube-integration/19423-3966/.minikube (perms=drwxr-xr-x)
I0816 13:34:34.704876 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-3966/.minikube
I0816 13:34:34.704931 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19423-3966
I0816 13:34:34.704953 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting executable bit set on /home/jenkins/minikube-integration/19423-3966 (perms=drwxrwxr-x)
I0816 13:34:34.704963 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0816 13:34:34.704975 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home/jenkins
I0816 13:34:34.704989 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Checking permissions on dir: /home
I0816 13:34:34.705002 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Skipping /home - not owner
I0816 13:34:34.705017 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0816 13:34:34.705035 53711 main.go:141] libmachine: (old-k8s-version-882237) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0816 13:34:34.705048 53711 main.go:141] libmachine: (old-k8s-version-882237) Creating domain...
I0816 13:34:34.706018 53711 main.go:141] libmachine: (old-k8s-version-882237) define libvirt domain using xml:
I0816 13:34:34.706039 53711 main.go:141] libmachine: (old-k8s-version-882237) <domain type='kvm'>
I0816 13:34:34.706065 53711 main.go:141] libmachine: (old-k8s-version-882237) <name>old-k8s-version-882237</name>
I0816 13:34:34.706087 53711 main.go:141] libmachine: (old-k8s-version-882237) <memory unit='MiB'>2200</memory>
I0816 13:34:34.706108 53711 main.go:141] libmachine: (old-k8s-version-882237) <vcpu>2</vcpu>
I0816 13:34:34.706124 53711 main.go:141] libmachine: (old-k8s-version-882237) <features>
I0816 13:34:34.706144 53711 main.go:141] libmachine: (old-k8s-version-882237) <acpi/>
I0816 13:34:34.706155 53711 main.go:141] libmachine: (old-k8s-version-882237) <apic/>
I0816 13:34:34.706170 53711 main.go:141] libmachine: (old-k8s-version-882237) <pae/>
I0816 13:34:34.706186 53711 main.go:141] libmachine: (old-k8s-version-882237)
I0816 13:34:34.706201 53711 main.go:141] libmachine: (old-k8s-version-882237) </features>
I0816 13:34:34.706214 53711 main.go:141] libmachine: (old-k8s-version-882237) <cpu mode='host-passthrough'>
I0816 13:34:34.706223 53711 main.go:141] libmachine: (old-k8s-version-882237)
I0816 13:34:34.706234 53711 main.go:141] libmachine: (old-k8s-version-882237) </cpu>
I0816 13:34:34.706246 53711 main.go:141] libmachine: (old-k8s-version-882237) <os>
I0816 13:34:34.706257 53711 main.go:141] libmachine: (old-k8s-version-882237) <type>hvm</type>
I0816 13:34:34.706266 53711 main.go:141] libmachine: (old-k8s-version-882237) <boot dev='cdrom'/>
I0816 13:34:34.706276 53711 main.go:141] libmachine: (old-k8s-version-882237) <boot dev='hd'/>
I0816 13:34:34.706285 53711 main.go:141] libmachine: (old-k8s-version-882237) <bootmenu enable='no'/>
I0816 13:34:34.706295 53711 main.go:141] libmachine: (old-k8s-version-882237) </os>
I0816 13:34:34.706303 53711 main.go:141] libmachine: (old-k8s-version-882237) <devices>
I0816 13:34:34.706319 53711 main.go:141] libmachine: (old-k8s-version-882237) <disk type='file' device='cdrom'>
I0816 13:34:34.706337 53711 main.go:141] libmachine: (old-k8s-version-882237) <source file='/home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/boot2docker.iso'/>
I0816 13:34:34.706348 53711 main.go:141] libmachine: (old-k8s-version-882237) <target dev='hdc' bus='scsi'/>
I0816 13:34:34.706362 53711 main.go:141] libmachine: (old-k8s-version-882237) <readonly/>
I0816 13:34:34.706368 53711 main.go:141] libmachine: (old-k8s-version-882237) </disk>
I0816 13:34:34.706377 53711 main.go:141] libmachine: (old-k8s-version-882237) <disk type='file' device='disk'>
I0816 13:34:34.706393 53711 main.go:141] libmachine: (old-k8s-version-882237) <driver name='qemu' type='raw' cache='default' io='threads' />
I0816 13:34:34.706419 53711 main.go:141] libmachine: (old-k8s-version-882237) <source file='/home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/old-k8s-version-882237.rawdisk'/>
I0816 13:34:34.706436 53711 main.go:141] libmachine: (old-k8s-version-882237) <target dev='hda' bus='virtio'/>
I0816 13:34:34.706459 53711 main.go:141] libmachine: (old-k8s-version-882237) </disk>
I0816 13:34:34.706473 53711 main.go:141] libmachine: (old-k8s-version-882237) <interface type='network'>
I0816 13:34:34.706484 53711 main.go:141] libmachine: (old-k8s-version-882237) <source network='mk-old-k8s-version-882237'/>
I0816 13:34:34.706491 53711 main.go:141] libmachine: (old-k8s-version-882237) <model type='virtio'/>
I0816 13:34:34.706501 53711 main.go:141] libmachine: (old-k8s-version-882237) </interface>
I0816 13:34:34.706513 53711 main.go:141] libmachine: (old-k8s-version-882237) <interface type='network'>
I0816 13:34:34.706525 53711 main.go:141] libmachine: (old-k8s-version-882237) <source network='default'/>
I0816 13:34:34.706536 53711 main.go:141] libmachine: (old-k8s-version-882237) <model type='virtio'/>
I0816 13:34:34.706548 53711 main.go:141] libmachine: (old-k8s-version-882237) </interface>
I0816 13:34:34.706564 53711 main.go:141] libmachine: (old-k8s-version-882237) <serial type='pty'>
I0816 13:34:34.706576 53711 main.go:141] libmachine: (old-k8s-version-882237) <target port='0'/>
I0816 13:34:34.706598 53711 main.go:141] libmachine: (old-k8s-version-882237) </serial>
I0816 13:34:34.706611 53711 main.go:141] libmachine: (old-k8s-version-882237) <console type='pty'>
I0816 13:34:34.706622 53711 main.go:141] libmachine: (old-k8s-version-882237) <target type='serial' port='0'/>
I0816 13:34:34.706639 53711 main.go:141] libmachine: (old-k8s-version-882237) </console>
I0816 13:34:34.706648 53711 main.go:141] libmachine: (old-k8s-version-882237) <rng model='virtio'>
I0816 13:34:34.706658 53711 main.go:141] libmachine: (old-k8s-version-882237) <backend model='random'>/dev/random</backend>
I0816 13:34:34.706668 53711 main.go:141] libmachine: (old-k8s-version-882237) </rng>
I0816 13:34:34.706679 53711 main.go:141] libmachine: (old-k8s-version-882237)
I0816 13:34:34.706689 53711 main.go:141] libmachine: (old-k8s-version-882237)
I0816 13:34:34.706701 53711 main.go:141] libmachine: (old-k8s-version-882237) </devices>
I0816 13:34:34.706711 53711 main.go:141] libmachine: (old-k8s-version-882237) </domain>
I0816 13:34:34.706725 53711 main.go:141] libmachine: (old-k8s-version-882237)
I0816 13:34:34.714022 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:82:06:99 in network default
I0816 13:34:34.714671 53711 main.go:141] libmachine: (old-k8s-version-882237) Ensuring networks are active...
I0816 13:34:34.714693 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:34.715523 53711 main.go:141] libmachine: (old-k8s-version-882237) Ensuring network default is active
I0816 13:34:34.715905 53711 main.go:141] libmachine: (old-k8s-version-882237) Ensuring network mk-old-k8s-version-882237 is active
I0816 13:34:34.716459 53711 main.go:141] libmachine: (old-k8s-version-882237) Getting domain xml...
I0816 13:34:34.717224 53711 main.go:141] libmachine: (old-k8s-version-882237) Creating domain...
I0816 13:34:36.031875 53711 main.go:141] libmachine: (old-k8s-version-882237) Waiting to get IP...
I0816 13:34:36.033014 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:36.033539 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:36.033569 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:36.033523 54366 retry.go:31] will retry after 212.711529ms: waiting for machine to come up
I0816 13:34:36.248010 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:36.248581 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:36.248619 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:36.248544 54366 retry.go:31] will retry after 293.195468ms: waiting for machine to come up
I0816 13:34:36.543033 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:36.543735 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:36.543757 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:36.543698 54366 retry.go:31] will retry after 438.589641ms: waiting for machine to come up
I0816 13:34:36.984358 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:36.985255 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:36.985283 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:36.985171 54366 retry.go:31] will retry after 512.847303ms: waiting for machine to come up
I0816 13:34:37.500115 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:37.500658 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:37.500686 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:37.500617 54366 retry.go:31] will retry after 642.752348ms: waiting for machine to come up
I0816 13:34:38.145281 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:38.145725 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:38.145779 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:38.145679 54366 retry.go:31] will retry after 780.21508ms: waiting for machine to come up
I0816 13:34:38.927793 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:38.928326 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:38.928353 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:38.928271 54366 retry.go:31] will retry after 839.130274ms: waiting for machine to come up
I0816 13:34:39.768568 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:39.769088 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:39.769118 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:39.769027 54366 retry.go:31] will retry after 1.199891989s: waiting for machine to come up
I0816 13:34:40.970186 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:40.970656 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:40.970693 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:40.970624 54366 retry.go:31] will retry after 1.210384761s: waiting for machine to come up
I0816 13:34:42.183124 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:42.183703 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:42.183732 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:42.183654 54366 retry.go:31] will retry after 1.947114674s: waiting for machine to come up
I0816 13:34:44.133062 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:44.133542 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:44.133572 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:44.133497 54366 retry.go:31] will retry after 2.610717042s: waiting for machine to come up
I0816 13:34:46.746341 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:46.746725 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:46.746746 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:46.746696 54366 retry.go:31] will retry after 2.285613509s: waiting for machine to come up
I0816 13:34:49.033450 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:49.033880 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:49.033912 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:49.033842 54366 retry.go:31] will retry after 4.372749182s: waiting for machine to come up
I0816 13:34:53.410300 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:53.410713 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find current IP address of domain old-k8s-version-882237 in network mk-old-k8s-version-882237
I0816 13:34:53.410735 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | I0816 13:34:53.410666 54366 retry.go:31] will retry after 3.706660755s: waiting for machine to come up
I0816 13:34:57.121176 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.121748 53711 main.go:141] libmachine: (old-k8s-version-882237) Found IP for machine: 192.168.72.105
I0816 13:34:57.121779 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has current primary IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.121789 53711 main.go:141] libmachine: (old-k8s-version-882237) Reserving static IP address...
I0816 13:34:57.122155 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-882237", mac: "52:54:00:ce:02:bd", ip: "192.168.72.105"} in network mk-old-k8s-version-882237
I0816 13:34:57.195448 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Getting to WaitForSSH function...
I0816 13:34:57.195476 53711 main.go:141] libmachine: (old-k8s-version-882237) Reserved static IP address: 192.168.72.105
I0816 13:34:57.195488 53711 main.go:141] libmachine: (old-k8s-version-882237) Waiting for SSH to be available...
I0816 13:34:57.198202 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.198734 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:minikube Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.198764 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.198892 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Using SSH client type: external
I0816 13:34:57.198921 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Using SSH private key: /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa (-rw-------)
I0816 13:34:57.198962 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.105 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa -p 22] /usr/bin/ssh <nil>}
I0816 13:34:57.198976 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | About to run SSH command:
I0816 13:34:57.198991 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | exit 0
I0816 13:34:57.329005 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | SSH cmd err, output: <nil>:
I0816 13:34:57.329301 53711 main.go:141] libmachine: (old-k8s-version-882237) KVM machine creation complete!
I0816 13:34:57.329565 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetConfigRaw
I0816 13:34:57.330207 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:57.330419 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:57.330592 53711 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0816 13:34:57.330604 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetState
I0816 13:34:57.331893 53711 main.go:141] libmachine: Detecting operating system of created instance...
I0816 13:34:57.331906 53711 main.go:141] libmachine: Waiting for SSH to be available...
I0816 13:34:57.331913 53711 main.go:141] libmachine: Getting to WaitForSSH function...
I0816 13:34:57.331922 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:57.334652 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.335087 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.335125 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.335299 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:57.335457 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.335598 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.335723 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:57.335909 53711 main.go:141] libmachine: Using SSH client type: native
I0816 13:34:57.336157 53711 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.105 22 <nil> <nil>}
I0816 13:34:57.336173 53711 main.go:141] libmachine: About to run SSH command:
exit 0
I0816 13:34:57.448252 53711 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 13:34:57.448272 53711 main.go:141] libmachine: Detecting the provisioner...
I0816 13:34:57.448280 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:57.451473 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.451908 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.451935 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.452107 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:57.452439 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.452591 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.452775 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:57.452960 53711 main.go:141] libmachine: Using SSH client type: native
I0816 13:34:57.453153 53711 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.105 22 <nil> <nil>}
I0816 13:34:57.453172 53711 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0816 13:34:57.569932 53711 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0816 13:34:57.570001 53711 main.go:141] libmachine: found compatible host: buildroot
I0816 13:34:57.570014 53711 main.go:141] libmachine: Provisioning with buildroot...
I0816 13:34:57.570025 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetMachineName
I0816 13:34:57.570297 53711 buildroot.go:166] provisioning hostname "old-k8s-version-882237"
I0816 13:34:57.570326 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetMachineName
I0816 13:34:57.570564 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:57.573141 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.573547 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.573576 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.573743 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:57.573917 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.574087 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.574246 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:57.574406 53711 main.go:141] libmachine: Using SSH client type: native
I0816 13:34:57.574561 53711 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.105 22 <nil> <nil>}
I0816 13:34:57.574573 53711 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-882237 && echo "old-k8s-version-882237" | sudo tee /etc/hostname
I0816 13:34:57.705485 53711 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-882237
I0816 13:34:57.705532 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:57.708686 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.709090 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.709150 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.709329 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:57.709536 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.709699 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:57.709857 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:57.710038 53711 main.go:141] libmachine: Using SSH client type: native
I0816 13:34:57.710273 53711 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.105 22 <nil> <nil>}
I0816 13:34:57.710299 53711 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-882237' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-882237/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-882237' | sudo tee -a /etc/hosts;
fi
fi
I0816 13:34:57.838160 53711 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 13:34:57.838185 53711 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19423-3966/.minikube CaCertPath:/home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19423-3966/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19423-3966/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19423-3966/.minikube}
I0816 13:34:57.838229 53711 buildroot.go:174] setting up certificates
I0816 13:34:57.838241 53711 provision.go:84] configureAuth start
I0816 13:34:57.838254 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetMachineName
I0816 13:34:57.838563 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetIP
I0816 13:34:57.841000 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.841392 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.841421 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.841548 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:57.843913 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.844296 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:57.844331 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:57.844433 53711 provision.go:143] copyHostCerts
I0816 13:34:57.844493 53711 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-3966/.minikube/ca.pem, removing ...
I0816 13:34:57.844514 53711 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-3966/.minikube/ca.pem
I0816 13:34:57.844585 53711 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19423-3966/.minikube/ca.pem (1082 bytes)
I0816 13:34:57.844693 53711 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-3966/.minikube/cert.pem, removing ...
I0816 13:34:57.844703 53711 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-3966/.minikube/cert.pem
I0816 13:34:57.844734 53711 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19423-3966/.minikube/cert.pem (1123 bytes)
I0816 13:34:57.844811 53711 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-3966/.minikube/key.pem, removing ...
I0816 13:34:57.844822 53711 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-3966/.minikube/key.pem
I0816 13:34:57.844850 53711 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19423-3966/.minikube/key.pem (1675 bytes)
I0816 13:34:57.844937 53711 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19423-3966/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-882237 san=[127.0.0.1 192.168.72.105 localhost minikube old-k8s-version-882237]
I0816 13:34:58.064405 53711 provision.go:177] copyRemoteCerts
I0816 13:34:58.064456 53711 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0816 13:34:58.064485 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:58.067554 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.067899 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.067927 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.068052 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:58.068270 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.068399 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:58.068550 53711 sshutil.go:53] new ssh client: &{IP:192.168.72.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa Username:docker}
I0816 13:34:58.155575 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0816 13:34:58.179075 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0816 13:34:58.201147 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0816 13:34:58.224748 53711 provision.go:87] duration metric: took 386.493505ms to configureAuth
I0816 13:34:58.224776 53711 buildroot.go:189] setting minikube options for container-runtime
I0816 13:34:58.224959 53711 config.go:182] Loaded profile config "old-k8s-version-882237": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0816 13:34:58.225028 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:58.227780 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.228089 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.228114 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.228260 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:58.228477 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.228659 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.228815 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:58.229002 53711 main.go:141] libmachine: Using SSH client type: native
I0816 13:34:58.229166 53711 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.105 22 <nil> <nil>}
I0816 13:34:58.229186 53711 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0816 13:34:58.506517 53711 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0816 13:34:58.506541 53711 main.go:141] libmachine: Checking connection to Docker...
I0816 13:34:58.506561 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetURL
I0816 13:34:58.507727 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | Using libvirt version 6000000
I0816 13:34:58.510310 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.510682 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.510713 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.510840 53711 main.go:141] libmachine: Docker is up and running!
I0816 13:34:58.510853 53711 main.go:141] libmachine: Reticulating splines...
I0816 13:34:58.510861 53711 client.go:171] duration metric: took 24.271575481s to LocalClient.Create
I0816 13:34:58.510889 53711 start.go:167] duration metric: took 24.271653175s to libmachine.API.Create "old-k8s-version-882237"
I0816 13:34:58.510918 53711 start.go:293] postStartSetup for "old-k8s-version-882237" (driver="kvm2")
I0816 13:34:58.510935 53711 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0816 13:34:58.510958 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:58.511199 53711 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0816 13:34:58.511225 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:58.513287 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.513545 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.513563 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.513660 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:58.513828 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.513982 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:58.514110 53711 sshutil.go:53] new ssh client: &{IP:192.168.72.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa Username:docker}
I0816 13:34:58.598806 53711 ssh_runner.go:195] Run: cat /etc/os-release
I0816 13:34:58.603081 53711 info.go:137] Remote host: Buildroot 2023.02.9
I0816 13:34:58.603107 53711 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-3966/.minikube/addons for local assets ...
I0816 13:34:58.603179 53711 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-3966/.minikube/files for local assets ...
I0816 13:34:58.603247 53711 filesync.go:149] local asset: /home/jenkins/minikube-integration/19423-3966/.minikube/files/etc/ssl/certs/111492.pem -> 111492.pem in /etc/ssl/certs
I0816 13:34:58.603332 53711 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0816 13:34:58.612634 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/files/etc/ssl/certs/111492.pem --> /etc/ssl/certs/111492.pem (1708 bytes)
I0816 13:34:58.637919 53711 start.go:296] duration metric: took 126.985371ms for postStartSetup
I0816 13:34:58.637970 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetConfigRaw
I0816 13:34:58.638518 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetIP
I0816 13:34:58.641270 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.641589 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.641624 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.641843 53711 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/config.json ...
I0816 13:34:58.642092 53711 start.go:128] duration metric: took 24.42354905s to createHost
I0816 13:34:58.642170 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:58.644268 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.644603 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.644630 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.644750 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:58.644936 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.645078 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.645251 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:58.645425 53711 main.go:141] libmachine: Using SSH client type: native
I0816 13:34:58.645571 53711 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.105 22 <nil> <nil>}
I0816 13:34:58.645587 53711 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0816 13:34:58.757829 53711 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723815298.729789702
I0816 13:34:58.757851 53711 fix.go:216] guest clock: 1723815298.729789702
I0816 13:34:58.757861 53711 fix.go:229] Guest: 2024-08-16 13:34:58.729789702 +0000 UTC Remote: 2024-08-16 13:34:58.642108832 +0000 UTC m=+74.269001423 (delta=87.68087ms)
I0816 13:34:58.757907 53711 fix.go:200] guest clock delta is within tolerance: 87.68087ms
I0816 13:34:58.757915 53711 start.go:83] releasing machines lock for "old-k8s-version-882237", held for 24.53957757s
I0816 13:34:58.757946 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:58.758281 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetIP
I0816 13:34:58.762379 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.762858 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.762884 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.763027 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:58.763540 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:58.763710 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .DriverName
I0816 13:34:58.763782 53711 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0816 13:34:58.763834 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:58.763918 53711 ssh_runner.go:195] Run: cat /version.json
I0816 13:34:58.763932 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHHostname
I0816 13:34:58.766698 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.766833 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.767054 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.767114 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:34:58.767159 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.767189 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:34:58.767324 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:58.767417 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHPort
I0816 13:34:58.767525 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.767633 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHKeyPath
I0816 13:34:58.767723 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:58.767755 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetSSHUsername
I0816 13:34:58.767904 53711 sshutil.go:53] new ssh client: &{IP:192.168.72.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa Username:docker}
I0816 13:34:58.767918 53711 sshutil.go:53] new ssh client: &{IP:192.168.72.105 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19423-3966/.minikube/machines/old-k8s-version-882237/id_rsa Username:docker}
I0816 13:34:58.850216 53711 ssh_runner.go:195] Run: systemctl --version
I0816 13:34:58.872443 53711 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0816 13:34:59.035631 53711 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0816 13:34:59.042839 53711 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0816 13:34:59.042892 53711 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0816 13:34:59.060582 53711 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0816 13:34:59.060606 53711 start.go:495] detecting cgroup driver to use...
I0816 13:34:59.060663 53711 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0816 13:34:59.078211 53711 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0816 13:34:59.092212 53711 docker.go:217] disabling cri-docker service (if available) ...
I0816 13:34:59.092267 53711 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0816 13:34:59.106310 53711 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0816 13:34:59.120574 53711 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0816 13:34:59.250306 53711 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0816 13:34:59.442694 53711 docker.go:233] disabling docker service ...
I0816 13:34:59.442758 53711 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0816 13:34:59.458241 53711 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0816 13:34:59.471761 53711 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0816 13:34:59.626497 53711 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0816 13:34:59.750518 53711 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0816 13:34:59.764995 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0816 13:34:59.783327 53711 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0816 13:34:59.783417 53711 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0816 13:34:59.793730 53711 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0816 13:34:59.793793 53711 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0816 13:34:59.804302 53711 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0816 13:34:59.814819 53711 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0816 13:34:59.825277 53711 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0816 13:34:59.836486 53711 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0816 13:34:59.846152 53711 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0816 13:34:59.846210 53711 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0816 13:34:59.859922 53711 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0816 13:34:59.869090 53711 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 13:34:59.981748 53711 ssh_runner.go:195] Run: sudo systemctl restart crio
I0816 13:35:00.122606 53711 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0816 13:35:00.122689 53711 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0816 13:35:00.128485 53711 start.go:563] Will wait 60s for crictl version
I0816 13:35:00.128555 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:00.132597 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0816 13:35:00.175998 53711 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0816 13:35:00.176074 53711 ssh_runner.go:195] Run: crio --version
I0816 13:35:00.205444 53711 ssh_runner.go:195] Run: crio --version
I0816 13:35:00.234496 53711 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0816 13:35:00.235753 53711 main.go:141] libmachine: (old-k8s-version-882237) Calling .GetIP
I0816 13:35:00.239045 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:35:00.239400 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ce:02:bd", ip: ""} in network mk-old-k8s-version-882237: {Iface:virbr4 ExpiryTime:2024-08-16 14:34:49 +0000 UTC Type:0 Mac:52:54:00:ce:02:bd Iaid: IPaddr:192.168.72.105 Prefix:24 Hostname:old-k8s-version-882237 Clientid:01:52:54:00:ce:02:bd}
I0816 13:35:00.239422 53711 main.go:141] libmachine: (old-k8s-version-882237) DBG | domain old-k8s-version-882237 has defined IP address 192.168.72.105 and MAC address 52:54:00:ce:02:bd in network mk-old-k8s-version-882237
I0816 13:35:00.239612 53711 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0816 13:35:00.243917 53711 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 13:35:00.257355 53711 kubeadm.go:883] updating cluster {Name:old-k8s-version-882237 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-882237 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.105 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0816 13:35:00.257470 53711 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0816 13:35:00.257530 53711 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 13:35:00.290346 53711 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0816 13:35:00.290419 53711 ssh_runner.go:195] Run: which lz4
I0816 13:35:00.294620 53711 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0816 13:35:00.298953 53711 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0816 13:35:00.298991 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0816 13:35:01.935214 53711 crio.go:462] duration metric: took 1.640622471s to copy over tarball
I0816 13:35:01.935291 53711 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0816 13:35:04.384829 53711 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.449514781s)
I0816 13:35:04.384857 53711 crio.go:469] duration metric: took 2.449613683s to extract the tarball
I0816 13:35:04.384864 53711 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0816 13:35:04.427565 53711 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 13:35:04.473700 53711 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0816 13:35:04.473722 53711 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0816 13:35:04.473791 53711 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:04.473837 53711 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:04.473855 53711 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0816 13:35:04.473861 53711 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0816 13:35:04.473819 53711 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:04.473926 53711 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0816 13:35:04.473923 53711 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:04.473799 53711 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0816 13:35:04.475025 53711 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:04.475178 53711 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:04.475206 53711 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:04.475234 53711 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0816 13:35:04.475268 53711 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0816 13:35:04.475271 53711 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0816 13:35:04.475280 53711 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0816 13:35:04.475268 53711 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:04.634782 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0816 13:35:04.658625 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0816 13:35:04.661891 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:04.668677 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:04.672009 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:04.682629 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:04.692347 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0816 13:35:04.710938 53711 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0816 13:35:04.710988 53711 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0816 13:35:04.711037 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.799542 53711 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0816 13:35:04.799585 53711 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0816 13:35:04.799593 53711 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:04.799616 53711 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0816 13:35:04.799644 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.799657 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.799724 53711 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0816 13:35:04.799765 53711 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:04.799798 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.833801 53711 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0816 13:35:04.833838 53711 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0816 13:35:04.833845 53711 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:04.833855 53711 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:04.833895 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.833895 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.846807 53711 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0816 13:35:04.846856 53711 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0816 13:35:04.846895 53711 ssh_runner.go:195] Run: which crictl
I0816 13:35:04.846897 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 13:35:04.846917 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:04.846951 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 13:35:04.846973 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:04.847041 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:04.847041 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:04.997860 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:04.997860 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:04.997937 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 13:35:04.997973 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 13:35:04.998019 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:04.998047 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 13:35:04.998093 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:05.152528 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 13:35:05.152609 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 13:35:05.166733 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 13:35:05.166803 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 13:35:05.166852 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 13:35:05.166954 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 13:35:05.166968 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 13:35:05.305180 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0816 13:35:05.305407 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0816 13:35:05.321669 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0816 13:35:05.332541 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0816 13:35:05.333945 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0816 13:35:05.333978 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0816 13:35:05.334083 53711 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 13:35:05.341815 53711 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0816 13:35:05.380730 53711 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0816 13:35:05.498648 53711 cache_images.go:92] duration metric: took 1.024910728s to LoadCachedImages
W0816 13:35:05.498780 53711 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19423-3966/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0816 13:35:05.498810 53711 kubeadm.go:934] updating node { 192.168.72.105 8443 v1.20.0 crio true true} ...
I0816 13:35:05.498935 53711 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-882237 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.105
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-882237 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0816 13:35:05.499016 53711 ssh_runner.go:195] Run: crio config
I0816 13:35:05.570096 53711 cni.go:84] Creating CNI manager for ""
I0816 13:35:05.570118 53711 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0816 13:35:05.570130 53711 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0816 13:35:05.570152 53711 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.105 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-882237 NodeName:old-k8s-version-882237 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.105"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.105 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0816 13:35:05.570311 53711 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.105
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-882237"
kubeletExtraArgs:
node-ip: 192.168.72.105
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.105"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0816 13:35:05.570374 53711 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0816 13:35:05.582463 53711 binaries.go:44] Found k8s binaries, skipping transfer
I0816 13:35:05.582536 53711 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0816 13:35:05.594526 53711 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0816 13:35:05.614392 53711 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0816 13:35:05.632339 53711 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0816 13:35:05.650063 53711 ssh_runner.go:195] Run: grep 192.168.72.105 control-plane.minikube.internal$ /etc/hosts
I0816 13:35:05.654505 53711 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.105 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 13:35:05.667261 53711 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 13:35:05.794746 53711 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0816 13:35:05.812919 53711 certs.go:68] Setting up /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237 for IP: 192.168.72.105
I0816 13:35:05.812938 53711 certs.go:194] generating shared ca certs ...
I0816 13:35:05.812951 53711 certs.go:226] acquiring lock for ca certs: {Name:mkdb46755373c135acf8239d2d4352f4b0b3d1d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:05.813111 53711 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19423-3966/.minikube/ca.key
I0816 13:35:05.813192 53711 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19423-3966/.minikube/proxy-client-ca.key
I0816 13:35:05.813204 53711 certs.go:256] generating profile certs ...
I0816 13:35:05.813266 53711 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/client.key
I0816 13:35:05.813283 53711 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/client.crt with IP's: []
I0816 13:35:05.899586 53711 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/client.crt ...
I0816 13:35:05.899616 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/client.crt: {Name:mkb8ad7deb29a0014c885f5dd3b2339661a5f1ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:05.899770 53711 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/client.key ...
I0816 13:35:05.899783 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/client.key: {Name:mk770a549b659846f110d19a24ba4442cf7bc258 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:05.899855 53711 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.key.e63f19d8
I0816 13:35:05.899878 53711 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.crt.e63f19d8 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.105]
I0816 13:35:06.086072 53711 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.crt.e63f19d8 ...
I0816 13:35:06.086098 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.crt.e63f19d8: {Name:mkacec3a3ad6fe417dd5c97ef6e2a1bdb6b021bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:06.086231 53711 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.key.e63f19d8 ...
I0816 13:35:06.086250 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.key.e63f19d8: {Name:mkb38dabae87f5f624dad03f3ba3ce14d833fa38 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:06.086314 53711 certs.go:381] copying /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.crt.e63f19d8 -> /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.crt
I0816 13:35:06.086384 53711 certs.go:385] copying /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.key.e63f19d8 -> /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.key
I0816 13:35:06.086440 53711 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.key
I0816 13:35:06.086455 53711 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.crt with IP's: []
I0816 13:35:06.145219 53711 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.crt ...
I0816 13:35:06.145241 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.crt: {Name:mk9bf8840b3de3673b5ab193a6173b7c35470d3e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:06.145387 53711 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.key ...
I0816 13:35:06.145403 53711 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.key: {Name:mk7153ded6f2def9061b6e4db01262050549c214 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 13:35:06.145591 53711 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/11149.pem (1338 bytes)
W0816 13:35:06.145625 53711 certs.go:480] ignoring /home/jenkins/minikube-integration/19423-3966/.minikube/certs/11149_empty.pem, impossibly tiny 0 bytes
I0816 13:35:06.145639 53711 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca-key.pem (1679 bytes)
I0816 13:35:06.145662 53711 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/ca.pem (1082 bytes)
I0816 13:35:06.145687 53711 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/cert.pem (1123 bytes)
I0816 13:35:06.145711 53711 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-3966/.minikube/certs/key.pem (1675 bytes)
I0816 13:35:06.145756 53711 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-3966/.minikube/files/etc/ssl/certs/111492.pem (1708 bytes)
I0816 13:35:06.146398 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0816 13:35:06.178670 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0816 13:35:06.208175 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0816 13:35:06.238389 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0816 13:35:06.281924 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0816 13:35:06.309605 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0816 13:35:06.336991 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0816 13:35:06.364518 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/profiles/old-k8s-version-882237/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0816 13:35:06.391596 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/certs/11149.pem --> /usr/share/ca-certificates/11149.pem (1338 bytes)
I0816 13:35:06.427798 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/files/etc/ssl/certs/111492.pem --> /usr/share/ca-certificates/111492.pem (1708 bytes)
I0816 13:35:06.457117 53711 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-3966/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0816 13:35:06.492950 53711 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0816 13:35:06.512623 53711 ssh_runner.go:195] Run: openssl version
I0816 13:35:06.519471 53711 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11149.pem && ln -fs /usr/share/ca-certificates/11149.pem /etc/ssl/certs/11149.pem"
I0816 13:35:06.536102 53711 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11149.pem
I0816 13:35:06.541621 53711 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 16 12:33 /usr/share/ca-certificates/11149.pem
I0816 13:35:06.541685 53711 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11149.pem
I0816 13:35:06.548197 53711 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11149.pem /etc/ssl/certs/51391683.0"
I0816 13:35:06.561299 53711 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/111492.pem && ln -fs /usr/share/ca-certificates/111492.pem /etc/ssl/certs/111492.pem"
I0816 13:35:06.573610 53711 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/111492.pem
I0816 13:35:06.578287 53711 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 16 12:33 /usr/share/ca-certificates/111492.pem
I0816 13:35:06.578343 53711 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/111492.pem
I0816 13:35:06.586521 53711 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/111492.pem /etc/ssl/certs/3ec20f2e.0"
I0816 13:35:06.599697 53711 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0816 13:35:06.612616 53711 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0816 13:35:06.620194 53711 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 16 12:22 /usr/share/ca-certificates/minikubeCA.pem
I0816 13:35:06.620266 53711 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0816 13:35:06.627787 53711 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0816 13:35:06.642597 53711 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0816 13:35:06.647944 53711 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0816 13:35:06.648000 53711 kubeadm.go:392] StartCluster: {Name:old-k8s-version-882237 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-882237 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.105 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 13:35:06.648067 53711 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0816 13:35:06.648118 53711 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0816 13:35:06.715446 53711 cri.go:89] found id: ""
I0816 13:35:06.715523 53711 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0816 13:35:06.731071 53711 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0816 13:35:06.750235 53711 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 13:35:06.768053 53711 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 13:35:06.768068 53711 kubeadm.go:157] found existing configuration files:
I0816 13:35:06.768113 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 13:35:06.778751 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 13:35:06.778815 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 13:35:06.791285 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 13:35:06.801308 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 13:35:06.801378 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 13:35:06.811475 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 13:35:06.820924 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 13:35:06.820981 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 13:35:06.831409 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 13:35:06.841061 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 13:35:06.841132 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 13:35:06.851070 53711 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0816 13:35:06.971768 53711 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0816 13:35:06.971889 53711 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 13:35:07.122602 53711 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 13:35:07.122793 53711 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 13:35:07.122959 53711 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0816 13:35:07.321792 53711 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 13:35:07.408811 53711 out.go:235] - Generating certificates and keys ...
I0816 13:35:07.408963 53711 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 13:35:07.409065 53711 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 13:35:07.583136 53711 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0816 13:35:07.659833 53711 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0816 13:35:07.873225 53711 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0816 13:35:08.185445 53711 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0816 13:35:08.304854 53711 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0816 13:35:08.305142 53711 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-882237] and IPs [192.168.72.105 127.0.0.1 ::1]
I0816 13:35:08.455565 53711 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0816 13:35:08.455867 53711 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-882237] and IPs [192.168.72.105 127.0.0.1 ::1]
I0816 13:35:08.830735 53711 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0816 13:35:09.528588 53711 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0816 13:35:09.636503 53711 kubeadm.go:310] [certs] Generating "sa" key and public key
I0816 13:35:09.636821 53711 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 13:35:09.817796 53711 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 13:35:10.095902 53711 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 13:35:10.355911 53711 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 13:35:10.474564 53711 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 13:35:10.495265 53711 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 13:35:10.495443 53711 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 13:35:10.495521 53711 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 13:35:10.629692 53711 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 13:35:10.631500 53711 out.go:235] - Booting up control plane ...
I0816 13:35:10.631632 53711 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 13:35:10.635885 53711 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 13:35:10.637781 53711 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 13:35:10.638679 53711 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 13:35:10.655477 53711 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0816 13:35:50.648056 53711 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0816 13:35:50.648815 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:35:50.649102 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:35:55.649500 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:35:55.649768 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:36:05.648829 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:36:05.649094 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:36:25.648519 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:36:25.648812 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:37:05.649952 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:37:05.650183 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:37:05.650201 53711 kubeadm.go:310]
I0816 13:37:05.650244 53711 kubeadm.go:310] Unfortunately, an error has occurred:
I0816 13:37:05.650287 53711 kubeadm.go:310] timed out waiting for the condition
I0816 13:37:05.650310 53711 kubeadm.go:310]
I0816 13:37:05.650368 53711 kubeadm.go:310] This error is likely caused by:
I0816 13:37:05.650417 53711 kubeadm.go:310] - The kubelet is not running
I0816 13:37:05.650561 53711 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0816 13:37:05.650589 53711 kubeadm.go:310]
I0816 13:37:05.650748 53711 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0816 13:37:05.650789 53711 kubeadm.go:310] - 'systemctl status kubelet'
I0816 13:37:05.650820 53711 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0816 13:37:05.650826 53711 kubeadm.go:310]
I0816 13:37:05.650919 53711 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0816 13:37:05.651003 53711 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0816 13:37:05.651012 53711 kubeadm.go:310]
I0816 13:37:05.651116 53711 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0816 13:37:05.651226 53711 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0816 13:37:05.651335 53711 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0816 13:37:05.651397 53711 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0816 13:37:05.651404 53711 kubeadm.go:310]
I0816 13:37:05.651935 53711 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 13:37:05.652054 53711 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0816 13:37:05.652219 53711 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0816 13:37:05.652319 53711 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-882237] and IPs [192.168.72.105 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-882237] and IPs [192.168.72.105 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-882237] and IPs [192.168.72.105 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-882237] and IPs [192.168.72.105 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0816 13:37:05.652366 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0816 13:37:06.145040 53711 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0816 13:37:06.158983 53711 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 13:37:06.168476 53711 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 13:37:06.168493 53711 kubeadm.go:157] found existing configuration files:
I0816 13:37:06.168536 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 13:37:06.177364 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 13:37:06.177411 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 13:37:06.186527 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 13:37:06.195240 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 13:37:06.195303 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 13:37:06.204509 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 13:37:06.213812 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 13:37:06.213860 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 13:37:06.223206 53711 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 13:37:06.232254 53711 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 13:37:06.232296 53711 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 13:37:06.241763 53711 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0816 13:37:06.325403 53711 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0816 13:37:06.325459 53711 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 13:37:06.461033 53711 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 13:37:06.461133 53711 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 13:37:06.461228 53711 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0816 13:37:06.648333 53711 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 13:37:06.650181 53711 out.go:235] - Generating certificates and keys ...
I0816 13:37:06.650333 53711 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 13:37:06.650506 53711 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 13:37:06.650693 53711 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0816 13:37:06.650861 53711 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0816 13:37:06.651019 53711 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0816 13:37:06.651169 53711 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0816 13:37:06.651438 53711 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0816 13:37:06.651705 53711 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0816 13:37:06.651825 53711 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0816 13:37:06.651951 53711 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0816 13:37:06.652011 53711 kubeadm.go:310] [certs] Using the existing "sa" key
I0816 13:37:06.652128 53711 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 13:37:06.783952 53711 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 13:37:06.925764 53711 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 13:37:07.066990 53711 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 13:37:07.256989 53711 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 13:37:07.272730 53711 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 13:37:07.273946 53711 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 13:37:07.274012 53711 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 13:37:07.420183 53711 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 13:37:07.422242 53711 out.go:235] - Booting up control plane ...
I0816 13:37:07.422375 53711 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 13:37:07.425396 53711 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 13:37:07.430977 53711 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 13:37:07.432029 53711 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 13:37:07.434797 53711 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0816 13:37:47.437635 53711 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0816 13:37:47.437723 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:37:47.437935 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:37:52.438481 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:37:52.438718 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:38:02.439340 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:38:02.439586 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:38:22.438791 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:38:22.438993 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:39:02.438919 53711 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 13:39:02.439142 53711 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 13:39:02.439267 53711 kubeadm.go:310]
I0816 13:39:02.439336 53711 kubeadm.go:310] Unfortunately, an error has occurred:
I0816 13:39:02.439414 53711 kubeadm.go:310] timed out waiting for the condition
I0816 13:39:02.439431 53711 kubeadm.go:310]
I0816 13:39:02.439504 53711 kubeadm.go:310] This error is likely caused by:
I0816 13:39:02.439554 53711 kubeadm.go:310] - The kubelet is not running
I0816 13:39:02.439700 53711 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0816 13:39:02.439720 53711 kubeadm.go:310]
I0816 13:39:02.439862 53711 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0816 13:39:02.439924 53711 kubeadm.go:310] - 'systemctl status kubelet'
I0816 13:39:02.439973 53711 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0816 13:39:02.439983 53711 kubeadm.go:310]
I0816 13:39:02.440096 53711 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0816 13:39:02.440213 53711 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0816 13:39:02.440222 53711 kubeadm.go:310]
I0816 13:39:02.440364 53711 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0816 13:39:02.440502 53711 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0816 13:39:02.440607 53711 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0816 13:39:02.440687 53711 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0816 13:39:02.440710 53711 kubeadm.go:310]
I0816 13:39:02.440851 53711 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 13:39:02.440988 53711 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0816 13:39:02.441141 53711 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0816 13:39:02.441170 53711 kubeadm.go:394] duration metric: took 3m55.79317321s to StartCluster
I0816 13:39:02.441245 53711 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0816 13:39:02.441314 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0816 13:39:02.481446 53711 cri.go:89] found id: ""
I0816 13:39:02.481479 53711 logs.go:276] 0 containers: []
W0816 13:39:02.481488 53711 logs.go:278] No container was found matching "kube-apiserver"
I0816 13:39:02.481494 53711 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0816 13:39:02.481552 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0816 13:39:02.517661 53711 cri.go:89] found id: ""
I0816 13:39:02.517693 53711 logs.go:276] 0 containers: []
W0816 13:39:02.517705 53711 logs.go:278] No container was found matching "etcd"
I0816 13:39:02.517712 53711 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0816 13:39:02.517765 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0816 13:39:02.551238 53711 cri.go:89] found id: ""
I0816 13:39:02.551268 53711 logs.go:276] 0 containers: []
W0816 13:39:02.551288 53711 logs.go:278] No container was found matching "coredns"
I0816 13:39:02.551296 53711 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0816 13:39:02.551357 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0816 13:39:02.584960 53711 cri.go:89] found id: ""
I0816 13:39:02.584987 53711 logs.go:276] 0 containers: []
W0816 13:39:02.584996 53711 logs.go:278] No container was found matching "kube-scheduler"
I0816 13:39:02.585001 53711 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0816 13:39:02.585067 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0816 13:39:02.621463 53711 cri.go:89] found id: ""
I0816 13:39:02.621493 53711 logs.go:276] 0 containers: []
W0816 13:39:02.621505 53711 logs.go:278] No container was found matching "kube-proxy"
I0816 13:39:02.621513 53711 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0816 13:39:02.621575 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0816 13:39:02.660769 53711 cri.go:89] found id: ""
I0816 13:39:02.660790 53711 logs.go:276] 0 containers: []
W0816 13:39:02.660797 53711 logs.go:278] No container was found matching "kube-controller-manager"
I0816 13:39:02.660803 53711 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0816 13:39:02.660847 53711 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0816 13:39:02.705491 53711 cri.go:89] found id: ""
I0816 13:39:02.705524 53711 logs.go:276] 0 containers: []
W0816 13:39:02.705532 53711 logs.go:278] No container was found matching "kindnet"
I0816 13:39:02.705541 53711 logs.go:123] Gathering logs for dmesg ...
I0816 13:39:02.705555 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0816 13:39:02.725498 53711 logs.go:123] Gathering logs for describe nodes ...
I0816 13:39:02.725526 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0816 13:39:02.876744 53711 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0816 13:39:02.876766 53711 logs.go:123] Gathering logs for CRI-O ...
I0816 13:39:02.876782 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0816 13:39:02.985309 53711 logs.go:123] Gathering logs for container status ...
I0816 13:39:02.985348 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0816 13:39:03.026198 53711 logs.go:123] Gathering logs for kubelet ...
I0816 13:39:03.026226 53711 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0816 13:39:03.082718 53711 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 13:39:03.082776 53711 out.go:270] *
*
W0816 13:39:03.082836 53711 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 13:39:03.082849 53711 out.go:270] *
*
W0816 13:39:03.083688 53711 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0816 13:39:03.086308 53711 out.go:201]
W0816 13:39:03.087583 53711 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 13:39:03.087630 53711 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0816 13:39:03.087646 53711 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0816 13:39:03.089132 53711 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-882237 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-882237 -n old-k8s-version-882237
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-882237 -n old-k8s-version-882237: exit status 6 (228.876782ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0816 13:39:03.354597 57110 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-882237" does not appear in /home/jenkins/minikube-integration/19423-3966/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-882237" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (319.00s)