=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-488586 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-488586 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.919606444s)
-- stdout --
* [old-k8s-version-488586] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20318
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20318-1724227/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20318-1724227/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-488586" primary control-plane node in "old-k8s-version-488586" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 12:27:05.438076 1770976 out.go:345] Setting OutFile to fd 1 ...
I0127 12:27:05.438425 1770976 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 12:27:05.438535 1770976 out.go:358] Setting ErrFile to fd 2...
I0127 12:27:05.438557 1770976 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 12:27:05.438973 1770976 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20318-1724227/.minikube/bin
I0127 12:27:05.439870 1770976 out.go:352] Setting JSON to false
I0127 12:27:05.440906 1770976 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":32966,"bootTime":1737947859,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0127 12:27:05.441012 1770976 start.go:139] virtualization: kvm guest
I0127 12:27:05.442928 1770976 out.go:177] * [old-k8s-version-488586] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0127 12:27:05.444610 1770976 notify.go:220] Checking for updates...
I0127 12:27:05.444629 1770976 out.go:177] - MINIKUBE_LOCATION=20318
I0127 12:27:05.446153 1770976 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 12:27:05.447629 1770976 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20318-1724227/kubeconfig
I0127 12:27:05.448863 1770976 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20318-1724227/.minikube
I0127 12:27:05.450122 1770976 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0127 12:27:05.451562 1770976 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 12:27:05.453257 1770976 config.go:182] Loaded profile config "cert-expiration-103712": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 12:27:05.453369 1770976 config.go:182] Loaded profile config "kubernetes-upgrade-029294": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 12:27:05.453486 1770976 config.go:182] Loaded profile config "pause-502641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 12:27:05.453589 1770976 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 12:27:05.489602 1770976 out.go:177] * Using the kvm2 driver based on user configuration
I0127 12:27:05.490879 1770976 start.go:297] selected driver: kvm2
I0127 12:27:05.490896 1770976 start.go:901] validating driver "kvm2" against <nil>
I0127 12:27:05.490911 1770976 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 12:27:05.491836 1770976 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 12:27:05.491920 1770976 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20318-1724227/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0127 12:27:05.507227 1770976 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0127 12:27:05.507283 1770976 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 12:27:05.507518 1770976 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 12:27:05.507553 1770976 cni.go:84] Creating CNI manager for ""
I0127 12:27:05.507593 1770976 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 12:27:05.507605 1770976 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0127 12:27:05.507652 1770976 start.go:340] cluster config:
{Name:old-k8s-version-488586 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-488586 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0127 12:27:05.507754 1770976 iso.go:125] acquiring lock: {Name:mkadfcca31fda677c8c62cad1d325dd2bd0a2473 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 12:27:05.509536 1770976 out.go:177] * Starting "old-k8s-version-488586" primary control-plane node in "old-k8s-version-488586" cluster
I0127 12:27:05.510874 1770976 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 12:27:05.510912 1770976 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0127 12:27:05.510920 1770976 cache.go:56] Caching tarball of preloaded images
I0127 12:27:05.511000 1770976 preload.go:172] Found /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0127 12:27:05.511011 1770976 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0127 12:27:05.511101 1770976 profile.go:143] Saving config to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/config.json ...
I0127 12:27:05.511124 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/config.json: {Name:mkf6d7a65a132b3ccc4a827f52a92dd78be36442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:05.511249 1770976 start.go:360] acquireMachinesLock for old-k8s-version-488586: {Name:mk206ddd5e564ea6986d65bef76be5837a8b5360 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0127 12:27:10.634757 1770976 start.go:364] duration metric: took 5.123452777s to acquireMachinesLock for "old-k8s-version-488586"
I0127 12:27:10.634834 1770976 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-488586 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-488586 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0127 12:27:10.634964 1770976 start.go:125] createHost starting for "" (driver="kvm2")
I0127 12:27:10.637085 1770976 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0127 12:27:10.637264 1770976 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0127 12:27:10.637330 1770976 main.go:141] libmachine: Launching plugin server for driver kvm2
I0127 12:27:10.653811 1770976 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38795
I0127 12:27:10.654221 1770976 main.go:141] libmachine: () Calling .GetVersion
I0127 12:27:10.654762 1770976 main.go:141] libmachine: Using API Version 1
I0127 12:27:10.654788 1770976 main.go:141] libmachine: () Calling .SetConfigRaw
I0127 12:27:10.655105 1770976 main.go:141] libmachine: () Calling .GetMachineName
I0127 12:27:10.655318 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetMachineName
I0127 12:27:10.655466 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:10.655611 1770976 start.go:159] libmachine.API.Create for "old-k8s-version-488586" (driver="kvm2")
I0127 12:27:10.655654 1770976 client.go:168] LocalClient.Create starting
I0127 12:27:10.655683 1770976 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca.pem
I0127 12:27:10.655723 1770976 main.go:141] libmachine: Decoding PEM data...
I0127 12:27:10.655739 1770976 main.go:141] libmachine: Parsing certificate...
I0127 12:27:10.655798 1770976 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/cert.pem
I0127 12:27:10.655817 1770976 main.go:141] libmachine: Decoding PEM data...
I0127 12:27:10.655831 1770976 main.go:141] libmachine: Parsing certificate...
I0127 12:27:10.655852 1770976 main.go:141] libmachine: Running pre-create checks...
I0127 12:27:10.655861 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .PreCreateCheck
I0127 12:27:10.656191 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetConfigRaw
I0127 12:27:10.656610 1770976 main.go:141] libmachine: Creating machine...
I0127 12:27:10.656627 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .Create
I0127 12:27:10.656784 1770976 main.go:141] libmachine: (old-k8s-version-488586) creating KVM machine...
I0127 12:27:10.656800 1770976 main.go:141] libmachine: (old-k8s-version-488586) creating network...
I0127 12:27:10.658137 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found existing default KVM network
I0127 12:27:10.660098 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:10.659912 1771043 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000266180}
I0127 12:27:10.660129 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | created network xml:
I0127 12:27:10.660144 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | <network>
I0127 12:27:10.660158 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | <name>mk-old-k8s-version-488586</name>
I0127 12:27:10.660167 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | <dns enable='no'/>
I0127 12:27:10.660174 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG |
I0127 12:27:10.660183 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0127 12:27:10.660190 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | <dhcp>
I0127 12:27:10.660226 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0127 12:27:10.660253 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | </dhcp>
I0127 12:27:10.660270 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | </ip>
I0127 12:27:10.660288 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG |
I0127 12:27:10.660299 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | </network>
I0127 12:27:10.660307 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG |
I0127 12:27:10.665482 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | trying to create private KVM network mk-old-k8s-version-488586 192.168.39.0/24...
I0127 12:27:10.738813 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting up store path in /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586 ...
I0127 12:27:10.738874 1770976 main.go:141] libmachine: (old-k8s-version-488586) building disk image from file:///home/jenkins/minikube-integration/20318-1724227/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0127 12:27:10.738885 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | private KVM network mk-old-k8s-version-488586 192.168.39.0/24 created
I0127 12:27:10.738903 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:10.738724 1771043 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20318-1724227/.minikube
I0127 12:27:10.738966 1770976 main.go:141] libmachine: (old-k8s-version-488586) Downloading /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20318-1724227/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0127 12:27:11.010083 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:11.009912 1771043 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa...
I0127 12:27:11.112707 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:11.112556 1771043 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/old-k8s-version-488586.rawdisk...
I0127 12:27:11.112758 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | Writing magic tar header
I0127 12:27:11.112802 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | Writing SSH key tar header
I0127 12:27:11.112855 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:11.112720 1771043 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586 ...
I0127 12:27:11.112889 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting executable bit set on /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586 (perms=drwx------)
I0127 12:27:11.112913 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting executable bit set on /home/jenkins/minikube-integration/20318-1724227/.minikube/machines (perms=drwxr-xr-x)
I0127 12:27:11.112927 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586
I0127 12:27:11.112945 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20318-1724227/.minikube/machines
I0127 12:27:11.112958 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20318-1724227/.minikube
I0127 12:27:11.112976 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20318-1724227
I0127 12:27:11.112989 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0127 12:27:11.113000 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home/jenkins
I0127 12:27:11.113013 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting executable bit set on /home/jenkins/minikube-integration/20318-1724227/.minikube (perms=drwxr-xr-x)
I0127 12:27:11.113027 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | checking permissions on dir: /home
I0127 12:27:11.113041 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | skipping /home - not owner
I0127 12:27:11.113056 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting executable bit set on /home/jenkins/minikube-integration/20318-1724227 (perms=drwxrwxr-x)
I0127 12:27:11.113067 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0127 12:27:11.113078 1770976 main.go:141] libmachine: (old-k8s-version-488586) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0127 12:27:11.113087 1770976 main.go:141] libmachine: (old-k8s-version-488586) creating domain...
I0127 12:27:11.114300 1770976 main.go:141] libmachine: (old-k8s-version-488586) define libvirt domain using xml:
I0127 12:27:11.114326 1770976 main.go:141] libmachine: (old-k8s-version-488586) <domain type='kvm'>
I0127 12:27:11.114347 1770976 main.go:141] libmachine: (old-k8s-version-488586) <name>old-k8s-version-488586</name>
I0127 12:27:11.114367 1770976 main.go:141] libmachine: (old-k8s-version-488586) <memory unit='MiB'>2200</memory>
I0127 12:27:11.114380 1770976 main.go:141] libmachine: (old-k8s-version-488586) <vcpu>2</vcpu>
I0127 12:27:11.114387 1770976 main.go:141] libmachine: (old-k8s-version-488586) <features>
I0127 12:27:11.114402 1770976 main.go:141] libmachine: (old-k8s-version-488586) <acpi/>
I0127 12:27:11.114411 1770976 main.go:141] libmachine: (old-k8s-version-488586) <apic/>
I0127 12:27:11.114422 1770976 main.go:141] libmachine: (old-k8s-version-488586) <pae/>
I0127 12:27:11.114430 1770976 main.go:141] libmachine: (old-k8s-version-488586)
I0127 12:27:11.114441 1770976 main.go:141] libmachine: (old-k8s-version-488586) </features>
I0127 12:27:11.114451 1770976 main.go:141] libmachine: (old-k8s-version-488586) <cpu mode='host-passthrough'>
I0127 12:27:11.114457 1770976 main.go:141] libmachine: (old-k8s-version-488586)
I0127 12:27:11.114465 1770976 main.go:141] libmachine: (old-k8s-version-488586) </cpu>
I0127 12:27:11.114480 1770976 main.go:141] libmachine: (old-k8s-version-488586) <os>
I0127 12:27:11.114509 1770976 main.go:141] libmachine: (old-k8s-version-488586) <type>hvm</type>
I0127 12:27:11.114550 1770976 main.go:141] libmachine: (old-k8s-version-488586) <boot dev='cdrom'/>
I0127 12:27:11.114564 1770976 main.go:141] libmachine: (old-k8s-version-488586) <boot dev='hd'/>
I0127 12:27:11.114572 1770976 main.go:141] libmachine: (old-k8s-version-488586) <bootmenu enable='no'/>
I0127 12:27:11.114583 1770976 main.go:141] libmachine: (old-k8s-version-488586) </os>
I0127 12:27:11.114589 1770976 main.go:141] libmachine: (old-k8s-version-488586) <devices>
I0127 12:27:11.114601 1770976 main.go:141] libmachine: (old-k8s-version-488586) <disk type='file' device='cdrom'>
I0127 12:27:11.114615 1770976 main.go:141] libmachine: (old-k8s-version-488586) <source file='/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/boot2docker.iso'/>
I0127 12:27:11.114631 1770976 main.go:141] libmachine: (old-k8s-version-488586) <target dev='hdc' bus='scsi'/>
I0127 12:27:11.114643 1770976 main.go:141] libmachine: (old-k8s-version-488586) <readonly/>
I0127 12:27:11.114656 1770976 main.go:141] libmachine: (old-k8s-version-488586) </disk>
I0127 12:27:11.114668 1770976 main.go:141] libmachine: (old-k8s-version-488586) <disk type='file' device='disk'>
I0127 12:27:11.114681 1770976 main.go:141] libmachine: (old-k8s-version-488586) <driver name='qemu' type='raw' cache='default' io='threads' />
I0127 12:27:11.114699 1770976 main.go:141] libmachine: (old-k8s-version-488586) <source file='/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/old-k8s-version-488586.rawdisk'/>
I0127 12:27:11.114710 1770976 main.go:141] libmachine: (old-k8s-version-488586) <target dev='hda' bus='virtio'/>
I0127 12:27:11.114766 1770976 main.go:141] libmachine: (old-k8s-version-488586) </disk>
I0127 12:27:11.114786 1770976 main.go:141] libmachine: (old-k8s-version-488586) <interface type='network'>
I0127 12:27:11.114796 1770976 main.go:141] libmachine: (old-k8s-version-488586) <source network='mk-old-k8s-version-488586'/>
I0127 12:27:11.114802 1770976 main.go:141] libmachine: (old-k8s-version-488586) <model type='virtio'/>
I0127 12:27:11.114809 1770976 main.go:141] libmachine: (old-k8s-version-488586) </interface>
I0127 12:27:11.114824 1770976 main.go:141] libmachine: (old-k8s-version-488586) <interface type='network'>
I0127 12:27:11.114833 1770976 main.go:141] libmachine: (old-k8s-version-488586) <source network='default'/>
I0127 12:27:11.114839 1770976 main.go:141] libmachine: (old-k8s-version-488586) <model type='virtio'/>
I0127 12:27:11.114847 1770976 main.go:141] libmachine: (old-k8s-version-488586) </interface>
I0127 12:27:11.114853 1770976 main.go:141] libmachine: (old-k8s-version-488586) <serial type='pty'>
I0127 12:27:11.114862 1770976 main.go:141] libmachine: (old-k8s-version-488586) <target port='0'/>
I0127 12:27:11.114868 1770976 main.go:141] libmachine: (old-k8s-version-488586) </serial>
I0127 12:27:11.114875 1770976 main.go:141] libmachine: (old-k8s-version-488586) <console type='pty'>
I0127 12:27:11.114882 1770976 main.go:141] libmachine: (old-k8s-version-488586) <target type='serial' port='0'/>
I0127 12:27:11.114890 1770976 main.go:141] libmachine: (old-k8s-version-488586) </console>
I0127 12:27:11.114896 1770976 main.go:141] libmachine: (old-k8s-version-488586) <rng model='virtio'>
I0127 12:27:11.114905 1770976 main.go:141] libmachine: (old-k8s-version-488586) <backend model='random'>/dev/random</backend>
I0127 12:27:11.114916 1770976 main.go:141] libmachine: (old-k8s-version-488586) </rng>
I0127 12:27:11.114926 1770976 main.go:141] libmachine: (old-k8s-version-488586)
I0127 12:27:11.114932 1770976 main.go:141] libmachine: (old-k8s-version-488586)
I0127 12:27:11.114939 1770976 main.go:141] libmachine: (old-k8s-version-488586) </devices>
I0127 12:27:11.114945 1770976 main.go:141] libmachine: (old-k8s-version-488586) </domain>
I0127 12:27:11.114956 1770976 main.go:141] libmachine: (old-k8s-version-488586)
I0127 12:27:11.119875 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:24:a1:6a in network default
I0127 12:27:11.120433 1770976 main.go:141] libmachine: (old-k8s-version-488586) starting domain...
I0127 12:27:11.120459 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:11.120468 1770976 main.go:141] libmachine: (old-k8s-version-488586) ensuring networks are active...
I0127 12:27:11.121080 1770976 main.go:141] libmachine: (old-k8s-version-488586) Ensuring network default is active
I0127 12:27:11.121415 1770976 main.go:141] libmachine: (old-k8s-version-488586) Ensuring network mk-old-k8s-version-488586 is active
I0127 12:27:11.121877 1770976 main.go:141] libmachine: (old-k8s-version-488586) getting domain XML...
I0127 12:27:11.122576 1770976 main.go:141] libmachine: (old-k8s-version-488586) creating domain...
I0127 12:27:12.463149 1770976 main.go:141] libmachine: (old-k8s-version-488586) waiting for IP...
I0127 12:27:12.464293 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:12.465212 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:12.465280 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:12.465234 1771043 retry.go:31] will retry after 303.632691ms: waiting for domain to come up
I0127 12:27:12.771288 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:12.772020 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:12.772050 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:12.771969 1771043 retry.go:31] will retry after 338.688507ms: waiting for domain to come up
I0127 12:27:13.112682 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:13.113409 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:13.113443 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:13.113360 1771043 retry.go:31] will retry after 451.376811ms: waiting for domain to come up
I0127 12:27:13.566217 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:13.566773 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:13.566826 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:13.566774 1771043 retry.go:31] will retry after 457.1462ms: waiting for domain to come up
I0127 12:27:14.025409 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:14.025949 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:14.026020 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:14.025904 1771043 retry.go:31] will retry after 531.632809ms: waiting for domain to come up
I0127 12:27:14.559820 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:14.560410 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:14.560442 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:14.560375 1771043 retry.go:31] will retry after 640.465313ms: waiting for domain to come up
I0127 12:27:15.202287 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:15.202954 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:15.203016 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:15.202915 1771043 retry.go:31] will retry after 1.076628926s: waiting for domain to come up
I0127 12:27:16.280896 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:16.281388 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:16.281418 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:16.281368 1771043 retry.go:31] will retry after 1.472339447s: waiting for domain to come up
I0127 12:27:17.755889 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:17.756389 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:17.756419 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:17.756323 1771043 retry.go:31] will retry after 1.231311101s: waiting for domain to come up
I0127 12:27:18.990183 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:18.990894 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:18.990957 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:18.990871 1771043 retry.go:31] will retry after 2.279706723s: waiting for domain to come up
I0127 12:27:21.271968 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:21.272596 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:21.272635 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:21.272551 1771043 retry.go:31] will retry after 2.797483584s: waiting for domain to come up
I0127 12:27:24.072093 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:24.072552 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:24.072582 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:24.072508 1771043 retry.go:31] will retry after 2.779322033s: waiting for domain to come up
I0127 12:27:26.853728 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:26.854193 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:26.854222 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:26.854165 1771043 retry.go:31] will retry after 2.868198629s: waiting for domain to come up
I0127 12:27:29.724050 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:29.724493 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find current IP address of domain old-k8s-version-488586 in network mk-old-k8s-version-488586
I0127 12:27:29.724517 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | I0127 12:27:29.724441 1771043 retry.go:31] will retry after 4.832812017s: waiting for domain to come up
I0127 12:27:34.562050 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.562573 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has current primary IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.562596 1770976 main.go:141] libmachine: (old-k8s-version-488586) found domain IP: 192.168.39.109
I0127 12:27:34.562649 1770976 main.go:141] libmachine: (old-k8s-version-488586) reserving static IP address...
I0127 12:27:34.563047 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-488586", mac: "52:54:00:ec:6f:18", ip: "192.168.39.109"} in network mk-old-k8s-version-488586
I0127 12:27:34.636185 1770976 main.go:141] libmachine: (old-k8s-version-488586) reserved static IP address 192.168.39.109 for domain old-k8s-version-488586
I0127 12:27:34.636223 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | Getting to WaitForSSH function...
I0127 12:27:34.636248 1770976 main.go:141] libmachine: (old-k8s-version-488586) waiting for SSH...
I0127 12:27:34.639000 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.639390 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:minikube Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:34.639424 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.639570 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | Using SSH client type: external
I0127 12:27:34.639615 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | Using SSH private key: /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa (-rw-------)
I0127 12:27:34.639657 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.109 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa -p 22] /usr/bin/ssh <nil>}
I0127 12:27:34.639677 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | About to run SSH command:
I0127 12:27:34.639697 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | exit 0
I0127 12:27:34.767123 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | SSH cmd err, output: <nil>:
I0127 12:27:34.767387 1770976 main.go:141] libmachine: (old-k8s-version-488586) KVM machine creation complete
I0127 12:27:34.767709 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetConfigRaw
I0127 12:27:34.768307 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:34.768541 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:34.768768 1770976 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0127 12:27:34.768787 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetState
I0127 12:27:34.770500 1770976 main.go:141] libmachine: Detecting operating system of created instance...
I0127 12:27:34.770519 1770976 main.go:141] libmachine: Waiting for SSH to be available...
I0127 12:27:34.770526 1770976 main.go:141] libmachine: Getting to WaitForSSH function...
I0127 12:27:34.770534 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:34.773257 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.773677 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:34.773716 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.773797 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:34.773968 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:34.774122 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:34.774289 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:34.774468 1770976 main.go:141] libmachine: Using SSH client type: native
I0127 12:27:34.774757 1770976 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.109 22 <nil> <nil>}
I0127 12:27:34.774775 1770976 main.go:141] libmachine: About to run SSH command:
exit 0
I0127 12:27:34.877622 1770976 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 12:27:34.877651 1770976 main.go:141] libmachine: Detecting the provisioner...
I0127 12:27:34.877662 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:34.880359 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.880721 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:34.880742 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.880927 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:34.881171 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:34.881381 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:34.881532 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:34.881715 1770976 main.go:141] libmachine: Using SSH client type: native
I0127 12:27:34.881884 1770976 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.109 22 <nil> <nil>}
I0127 12:27:34.881895 1770976 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0127 12:27:34.986998 1770976 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0127 12:27:34.987118 1770976 main.go:141] libmachine: found compatible host: buildroot
I0127 12:27:34.987135 1770976 main.go:141] libmachine: Provisioning with buildroot...
I0127 12:27:34.987152 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetMachineName
I0127 12:27:34.987391 1770976 buildroot.go:166] provisioning hostname "old-k8s-version-488586"
I0127 12:27:34.987427 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetMachineName
I0127 12:27:34.987593 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:34.990121 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.990454 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:34.990492 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:34.990601 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:34.990807 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:34.990990 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:34.991126 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:34.991288 1770976 main.go:141] libmachine: Using SSH client type: native
I0127 12:27:34.991477 1770976 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.109 22 <nil> <nil>}
I0127 12:27:34.991489 1770976 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-488586 && echo "old-k8s-version-488586" | sudo tee /etc/hostname
I0127 12:27:35.111174 1770976 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-488586
I0127 12:27:35.111208 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:35.113926 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.114307 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.114340 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.114498 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:35.114692 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.114892 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.115044 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:35.115222 1770976 main.go:141] libmachine: Using SSH client type: native
I0127 12:27:35.115446 1770976 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.109 22 <nil> <nil>}
I0127 12:27:35.115479 1770976 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-488586' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-488586/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-488586' | sudo tee -a /etc/hosts;
fi
fi
I0127 12:27:35.227272 1770976 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 12:27:35.227306 1770976 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20318-1724227/.minikube CaCertPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20318-1724227/.minikube}
I0127 12:27:35.227328 1770976 buildroot.go:174] setting up certificates
I0127 12:27:35.227342 1770976 provision.go:84] configureAuth start
I0127 12:27:35.227356 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetMachineName
I0127 12:27:35.227661 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetIP
I0127 12:27:35.230564 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.230961 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.230987 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.231140 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:35.233468 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.233829 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.233854 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.233980 1770976 provision.go:143] copyHostCerts
I0127 12:27:35.234047 1770976 exec_runner.go:144] found /home/jenkins/minikube-integration/20318-1724227/.minikube/cert.pem, removing ...
I0127 12:27:35.234066 1770976 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20318-1724227/.minikube/cert.pem
I0127 12:27:35.234123 1770976 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20318-1724227/.minikube/cert.pem (1123 bytes)
I0127 12:27:35.234291 1770976 exec_runner.go:144] found /home/jenkins/minikube-integration/20318-1724227/.minikube/key.pem, removing ...
I0127 12:27:35.234304 1770976 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20318-1724227/.minikube/key.pem
I0127 12:27:35.234332 1770976 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20318-1724227/.minikube/key.pem (1675 bytes)
I0127 12:27:35.234407 1770976 exec_runner.go:144] found /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.pem, removing ...
I0127 12:27:35.234419 1770976 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.pem
I0127 12:27:35.234448 1770976 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.pem (1078 bytes)
I0127 12:27:35.234519 1770976 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-488586 san=[127.0.0.1 192.168.39.109 localhost minikube old-k8s-version-488586]
I0127 12:27:35.448756 1770976 provision.go:177] copyRemoteCerts
I0127 12:27:35.448816 1770976 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 12:27:35.448848 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:35.451401 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.451768 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.451800 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.451932 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:35.452134 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.452320 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:35.452454 1770976 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa Username:docker}
I0127 12:27:35.536609 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 12:27:35.561217 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0127 12:27:35.584506 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 12:27:35.607448 1770976 provision.go:87] duration metric: took 380.092009ms to configureAuth
I0127 12:27:35.607473 1770976 buildroot.go:189] setting minikube options for container-runtime
I0127 12:27:35.607635 1770976 config.go:182] Loaded profile config "old-k8s-version-488586": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 12:27:35.607714 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:35.610559 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.610884 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.610915 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.611059 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:35.611262 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.611406 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.611526 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:35.611667 1770976 main.go:141] libmachine: Using SSH client type: native
I0127 12:27:35.611835 1770976 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.109 22 <nil> <nil>}
I0127 12:27:35.611852 1770976 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0127 12:27:35.833662 1770976 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0127 12:27:35.833696 1770976 main.go:141] libmachine: Checking connection to Docker...
I0127 12:27:35.833708 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetURL
I0127 12:27:35.835069 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | using libvirt version 6000000
I0127 12:27:35.837220 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.837538 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.837579 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.837719 1770976 main.go:141] libmachine: Docker is up and running!
I0127 12:27:35.837735 1770976 main.go:141] libmachine: Reticulating splines...
I0127 12:27:35.837745 1770976 client.go:171] duration metric: took 25.182078423s to LocalClient.Create
I0127 12:27:35.837778 1770976 start.go:167] duration metric: took 25.182168531s to libmachine.API.Create "old-k8s-version-488586"
I0127 12:27:35.837791 1770976 start.go:293] postStartSetup for "old-k8s-version-488586" (driver="kvm2")
I0127 12:27:35.837821 1770976 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 12:27:35.837863 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:35.838081 1770976 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 12:27:35.838108 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:35.840382 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.840677 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.840705 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.840866 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:35.841038 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.841184 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:35.841304 1770976 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa Username:docker}
I0127 12:27:35.920722 1770976 ssh_runner.go:195] Run: cat /etc/os-release
I0127 12:27:35.924568 1770976 info.go:137] Remote host: Buildroot 2023.02.9
I0127 12:27:35.924594 1770976 filesync.go:126] Scanning /home/jenkins/minikube-integration/20318-1724227/.minikube/addons for local assets ...
I0127 12:27:35.924663 1770976 filesync.go:126] Scanning /home/jenkins/minikube-integration/20318-1724227/.minikube/files for local assets ...
I0127 12:27:35.924779 1770976 filesync.go:149] local asset: /home/jenkins/minikube-integration/20318-1724227/.minikube/files/etc/ssl/certs/17313962.pem -> 17313962.pem in /etc/ssl/certs
I0127 12:27:35.924901 1770976 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 12:27:35.933607 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/files/etc/ssl/certs/17313962.pem --> /etc/ssl/certs/17313962.pem (1708 bytes)
I0127 12:27:35.957295 1770976 start.go:296] duration metric: took 119.488812ms for postStartSetup
I0127 12:27:35.957341 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetConfigRaw
I0127 12:27:35.957947 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetIP
I0127 12:27:35.960341 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.960703 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.960729 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.961018 1770976 profile.go:143] Saving config to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/config.json ...
I0127 12:27:35.961234 1770976 start.go:128] duration metric: took 25.326254936s to createHost
I0127 12:27:35.961283 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:35.963475 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.963769 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:35.963809 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:35.963904 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:35.964083 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.964263 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:35.964412 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:35.964576 1770976 main.go:141] libmachine: Using SSH client type: native
I0127 12:27:35.964779 1770976 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.109 22 <nil> <nil>}
I0127 12:27:35.964794 1770976 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0127 12:27:36.066994 1770976 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737980856.044669232
I0127 12:27:36.067020 1770976 fix.go:216] guest clock: 1737980856.044669232
I0127 12:27:36.067026 1770976 fix.go:229] Guest: 2025-01-27 12:27:36.044669232 +0000 UTC Remote: 2025-01-27 12:27:35.961267685 +0000 UTC m=+30.561336550 (delta=83.401547ms)
I0127 12:27:36.067064 1770976 fix.go:200] guest clock delta is within tolerance: 83.401547ms
I0127 12:27:36.067069 1770976 start.go:83] releasing machines lock for "old-k8s-version-488586", held for 25.432272605s
I0127 12:27:36.067091 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:36.067348 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetIP
I0127 12:27:36.070197 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:36.070575 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:36.070608 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:36.070791 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:36.071284 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:36.071463 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .DriverName
I0127 12:27:36.071560 1770976 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 12:27:36.071616 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:36.071664 1770976 ssh_runner.go:195] Run: cat /version.json
I0127 12:27:36.071687 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHHostname
I0127 12:27:36.074131 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:36.074261 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:36.074458 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:36.074489 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:36.074666 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:36.074771 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:36.074803 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:36.074962 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHPort
I0127 12:27:36.074966 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:36.075128 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:36.075135 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHKeyPath
I0127 12:27:36.075320 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetSSHUsername
I0127 12:27:36.075314 1770976 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa Username:docker}
I0127 12:27:36.075447 1770976 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20318-1724227/.minikube/machines/old-k8s-version-488586/id_rsa Username:docker}
I0127 12:27:36.151384 1770976 ssh_runner.go:195] Run: systemctl --version
I0127 12:27:36.178041 1770976 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0127 12:27:36.333167 1770976 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0127 12:27:36.339206 1770976 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0127 12:27:36.339296 1770976 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 12:27:36.354538 1770976 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0127 12:27:36.354563 1770976 start.go:495] detecting cgroup driver to use...
I0127 12:27:36.354630 1770976 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0127 12:27:36.373549 1770976 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0127 12:27:36.387110 1770976 docker.go:217] disabling cri-docker service (if available) ...
I0127 12:27:36.387171 1770976 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 12:27:36.399258 1770976 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 12:27:36.411349 1770976 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 12:27:36.524610 1770976 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 12:27:36.681563 1770976 docker.go:233] disabling docker service ...
I0127 12:27:36.681643 1770976 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 12:27:36.695319 1770976 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 12:27:36.708063 1770976 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 12:27:36.836287 1770976 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 12:27:36.967333 1770976 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 12:27:36.980890 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0127 12:27:36.998932 1770976 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0127 12:27:36.998993 1770976 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 12:27:37.010244 1770976 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0127 12:27:37.010299 1770976 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 12:27:37.019276 1770976 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0127 12:27:37.028749 1770976 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0127 12:27:37.038606 1770976 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 12:27:37.048713 1770976 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 12:27:37.057150 1770976 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0127 12:27:37.057198 1770976 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0127 12:27:37.069769 1770976 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 12:27:37.078107 1770976 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 12:27:37.205401 1770976 ssh_runner.go:195] Run: sudo systemctl restart crio
I0127 12:27:37.292357 1770976 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0127 12:27:37.292455 1770976 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0127 12:27:37.297203 1770976 start.go:563] Will wait 60s for crictl version
I0127 12:27:37.297356 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:37.300828 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 12:27:37.341365 1770976 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0127 12:27:37.341458 1770976 ssh_runner.go:195] Run: crio --version
I0127 12:27:37.370007 1770976 ssh_runner.go:195] Run: crio --version
I0127 12:27:37.395899 1770976 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0127 12:27:37.396935 1770976 main.go:141] libmachine: (old-k8s-version-488586) Calling .GetIP
I0127 12:27:37.399576 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:37.399903 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:6f:18", ip: ""} in network mk-old-k8s-version-488586: {Iface:virbr4 ExpiryTime:2025-01-27 13:27:25 +0000 UTC Type:0 Mac:52:54:00:ec:6f:18 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:old-k8s-version-488586 Clientid:01:52:54:00:ec:6f:18}
I0127 12:27:37.399934 1770976 main.go:141] libmachine: (old-k8s-version-488586) DBG | domain old-k8s-version-488586 has defined IP address 192.168.39.109 and MAC address 52:54:00:ec:6f:18 in network mk-old-k8s-version-488586
I0127 12:27:37.400102 1770976 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0127 12:27:37.403711 1770976 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 12:27:37.415078 1770976 kubeadm.go:883] updating cluster {Name:old-k8s-version-488586 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-488586 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.109 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 12:27:37.415183 1770976 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 12:27:37.415230 1770976 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 12:27:37.445483 1770976 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 12:27:37.445539 1770976 ssh_runner.go:195] Run: which lz4
I0127 12:27:37.449139 1770976 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0127 12:27:37.453277 1770976 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0127 12:27:37.453306 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0127 12:27:38.871500 1770976 crio.go:462] duration metric: took 1.422389925s to copy over tarball
I0127 12:27:38.871596 1770976 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0127 12:27:41.333437 1770976 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.461774708s)
I0127 12:27:41.333492 1770976 crio.go:469] duration metric: took 2.461953944s to extract the tarball
I0127 12:27:41.333503 1770976 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0127 12:27:41.375223 1770976 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 12:27:41.415208 1770976 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 12:27:41.415236 1770976 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0127 12:27:41.415317 1770976 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 12:27:41.415372 1770976 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0127 12:27:41.415404 1770976 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0127 12:27:41.415411 1770976 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:41.415323 1770976 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0127 12:27:41.415323 1770976 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:41.415568 1770976 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:41.416310 1770976 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:41.417943 1770976 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:41.417963 1770976 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0127 12:27:41.418218 1770976 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 12:27:41.418228 1770976 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:41.418368 1770976 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:41.418403 1770976 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0127 12:27:41.418453 1770976 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:41.418711 1770976 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0127 12:27:41.615162 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0127 12:27:41.640702 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0127 12:27:41.640904 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:41.646012 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:41.656508 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:41.659609 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:41.671175 1770976 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0127 12:27:41.671243 1770976 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0127 12:27:41.671291 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.679524 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0127 12:27:41.748048 1770976 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0127 12:27:41.748107 1770976 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:41.748125 1770976 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0127 12:27:41.748161 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.748165 1770976 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0127 12:27:41.748212 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.772186 1770976 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0127 12:27:41.772239 1770976 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:41.772296 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.788040 1770976 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0127 12:27:41.788078 1770976 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:41.788122 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.790852 1770976 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0127 12:27:41.790893 1770976 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:41.790905 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 12:27:41.790928 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.805624 1770976 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0127 12:27:41.805651 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:41.805674 1770976 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0127 12:27:41.805684 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:41.805714 1770976 ssh_runner.go:195] Run: which crictl
I0127 12:27:41.805651 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 12:27:41.805729 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:41.844549 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 12:27:41.844638 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:41.844639 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 12:27:41.961296 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 12:27:41.961350 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:41.961350 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:41.961478 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:42.008527 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 12:27:42.008532 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 12:27:42.008703 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:42.088686 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 12:27:42.088743 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 12:27:42.088766 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 12:27:42.088742 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 12:27:42.092742 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0127 12:27:42.139130 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 12:27:42.139136 1770976 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 12:27:42.217193 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0127 12:27:42.217232 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0127 12:27:42.217301 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0127 12:27:42.217316 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0127 12:27:42.233926 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0127 12:27:42.234156 1770976 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0127 12:27:42.677053 1770976 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0127 12:27:42.817586 1770976 cache_images.go:92] duration metric: took 1.402321008s to LoadCachedImages
W0127 12:27:42.817719 1770976 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20318-1724227/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0127 12:27:42.817743 1770976 kubeadm.go:934] updating node { 192.168.39.109 8443 v1.20.0 crio true true} ...
I0127 12:27:42.817883 1770976 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-488586 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.109
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-488586 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 12:27:42.817970 1770976 ssh_runner.go:195] Run: crio config
I0127 12:27:42.865911 1770976 cni.go:84] Creating CNI manager for ""
I0127 12:27:42.865937 1770976 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 12:27:42.865947 1770976 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 12:27:42.865972 1770976 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.109 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-488586 NodeName:old-k8s-version-488586 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.109"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.109 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 12:27:42.866142 1770976 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.109
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-488586"
kubeletExtraArgs:
node-ip: 192.168.39.109
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.109"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 12:27:42.866222 1770976 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 12:27:42.875602 1770976 binaries.go:44] Found k8s binaries, skipping transfer
I0127 12:27:42.875677 1770976 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 12:27:42.884233 1770976 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0127 12:27:42.899627 1770976 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 12:27:42.914373 1770976 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0127 12:27:42.930410 1770976 ssh_runner.go:195] Run: grep 192.168.39.109 control-plane.minikube.internal$ /etc/hosts
I0127 12:27:42.933783 1770976 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.109 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 12:27:42.944883 1770976 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 12:27:43.075250 1770976 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 12:27:43.092364 1770976 certs.go:68] Setting up /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586 for IP: 192.168.39.109
I0127 12:27:43.092391 1770976 certs.go:194] generating shared ca certs ...
I0127 12:27:43.092417 1770976 certs.go:226] acquiring lock for ca certs: {Name:mk9e5c59e9dbe250ccc1601895509e2d4f3690e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.092627 1770976 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.key
I0127 12:27:43.092683 1770976 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/proxy-client-ca.key
I0127 12:27:43.092699 1770976 certs.go:256] generating profile certs ...
I0127 12:27:43.092792 1770976 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/client.key
I0127 12:27:43.092818 1770976 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/client.crt with IP's: []
I0127 12:27:43.274465 1770976 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/client.crt ...
I0127 12:27:43.274510 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/client.crt: {Name:mk2e8fd70c6bea0fb8bb2489f6227fbbcf40e034 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.274668 1770976 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/client.key ...
I0127 12:27:43.274681 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/client.key: {Name:mkc2ad028b57161b28f0421cc3568ce1827fd4e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.274811 1770976 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.key.1691d3b4
I0127 12:27:43.274847 1770976 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.crt.1691d3b4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.109]
I0127 12:27:43.430103 1770976 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.crt.1691d3b4 ...
I0127 12:27:43.430138 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.crt.1691d3b4: {Name:mka0e32ab76b0951439ac625eb06abf6313d0c06 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.430293 1770976 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.key.1691d3b4 ...
I0127 12:27:43.430309 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.key.1691d3b4: {Name:mka9ca55c6b3b6e177e540ba296783b264091cb8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.430378 1770976 certs.go:381] copying /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.crt.1691d3b4 -> /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.crt
I0127 12:27:43.430476 1770976 certs.go:385] copying /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.key.1691d3b4 -> /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.key
I0127 12:27:43.430536 1770976 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.key
I0127 12:27:43.430553 1770976 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.crt with IP's: []
I0127 12:27:43.508151 1770976 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.crt ...
I0127 12:27:43.508182 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.crt: {Name:mk305f9c2781d932f1ef79717da55fade9026c72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.508332 1770976 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.key ...
I0127 12:27:43.508346 1770976 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.key: {Name:mkd14196853b70c08530e03669b47e713df1a1b1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 12:27:43.508509 1770976 certs.go:484] found cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/1731396.pem (1338 bytes)
W0127 12:27:43.508544 1770976 certs.go:480] ignoring /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/1731396_empty.pem, impossibly tiny 0 bytes
I0127 12:27:43.508555 1770976 certs.go:484] found cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca-key.pem (1679 bytes)
I0127 12:27:43.508580 1770976 certs.go:484] found cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/ca.pem (1078 bytes)
I0127 12:27:43.508602 1770976 certs.go:484] found cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/cert.pem (1123 bytes)
I0127 12:27:43.508622 1770976 certs.go:484] found cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/key.pem (1675 bytes)
I0127 12:27:43.508661 1770976 certs.go:484] found cert: /home/jenkins/minikube-integration/20318-1724227/.minikube/files/etc/ssl/certs/17313962.pem (1708 bytes)
I0127 12:27:43.509364 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 12:27:43.535723 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0127 12:27:43.557026 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 12:27:43.580574 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0127 12:27:43.602437 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 12:27:43.625013 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0127 12:27:43.646583 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 12:27:43.668544 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/profiles/old-k8s-version-488586/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0127 12:27:43.690894 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/files/etc/ssl/certs/17313962.pem --> /usr/share/ca-certificates/17313962.pem (1708 bytes)
I0127 12:27:43.715517 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 12:27:43.738324 1770976 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20318-1724227/.minikube/certs/1731396.pem --> /usr/share/ca-certificates/1731396.pem (1338 bytes)
I0127 12:27:43.763298 1770976 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 12:27:43.778909 1770976 ssh_runner.go:195] Run: openssl version
I0127 12:27:43.784519 1770976 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17313962.pem && ln -fs /usr/share/ca-certificates/17313962.pem /etc/ssl/certs/17313962.pem"
I0127 12:27:43.794698 1770976 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17313962.pem
I0127 12:27:43.799216 1770976 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 11:32 /usr/share/ca-certificates/17313962.pem
I0127 12:27:43.799268 1770976 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17313962.pem
I0127 12:27:43.804930 1770976 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17313962.pem /etc/ssl/certs/3ec20f2e.0"
I0127 12:27:43.814950 1770976 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 12:27:43.825533 1770976 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 12:27:43.830123 1770976 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 11:24 /usr/share/ca-certificates/minikubeCA.pem
I0127 12:27:43.830180 1770976 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 12:27:43.835535 1770976 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 12:27:43.845830 1770976 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1731396.pem && ln -fs /usr/share/ca-certificates/1731396.pem /etc/ssl/certs/1731396.pem"
I0127 12:27:43.856200 1770976 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1731396.pem
I0127 12:27:43.860399 1770976 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 11:32 /usr/share/ca-certificates/1731396.pem
I0127 12:27:43.860458 1770976 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1731396.pem
I0127 12:27:43.865797 1770976 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1731396.pem /etc/ssl/certs/51391683.0"
I0127 12:27:43.876393 1770976 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 12:27:43.880274 1770976 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 12:27:43.880349 1770976 kubeadm.go:392] StartCluster: {Name:old-k8s-version-488586 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-488586 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.109 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 12:27:43.880467 1770976 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0127 12:27:43.880522 1770976 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 12:27:43.927654 1770976 cri.go:89] found id: ""
I0127 12:27:43.927747 1770976 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 12:27:43.939052 1770976 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 12:27:43.950134 1770976 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 12:27:43.963589 1770976 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 12:27:43.963609 1770976 kubeadm.go:157] found existing configuration files:
I0127 12:27:43.963661 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 12:27:43.974776 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 12:27:43.974846 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 12:27:43.984438 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 12:27:43.995278 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 12:27:43.995359 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 12:27:44.007773 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 12:27:44.016276 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 12:27:44.016346 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 12:27:44.025064 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 12:27:44.034167 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 12:27:44.034230 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 12:27:44.043441 1770976 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 12:27:44.160446 1770976 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 12:27:44.160527 1770976 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 12:27:44.301280 1770976 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 12:27:44.301375 1770976 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 12:27:44.301479 1770976 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 12:27:44.470506 1770976 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 12:27:44.561141 1770976 out.go:235] - Generating certificates and keys ...
I0127 12:27:44.561274 1770976 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 12:27:44.561395 1770976 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 12:27:44.571578 1770976 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 12:27:44.659849 1770976 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 12:27:44.887957 1770976 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 12:27:45.055226 1770976 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 12:27:45.354290 1770976 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 12:27:45.354586 1770976 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-488586] and IPs [192.168.39.109 127.0.0.1 ::1]
I0127 12:27:45.671706 1770976 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 12:27:45.672016 1770976 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-488586] and IPs [192.168.39.109 127.0.0.1 ::1]
I0127 12:27:45.966114 1770976 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 12:27:46.099035 1770976 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 12:27:46.263275 1770976 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 12:27:46.263363 1770976 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 12:27:46.522920 1770976 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 12:27:46.712497 1770976 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 12:27:46.906514 1770976 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 12:27:47.076611 1770976 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 12:27:47.092742 1770976 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 12:27:47.093276 1770976 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 12:27:47.093347 1770976 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 12:27:47.215653 1770976 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 12:27:47.217287 1770976 out.go:235] - Booting up control plane ...
I0127 12:27:47.217407 1770976 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 12:27:47.222733 1770976 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 12:27:47.231615 1770976 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 12:27:47.232900 1770976 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 12:27:47.239013 1770976 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 12:28:27.233065 1770976 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 12:28:27.233611 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:28:27.233824 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:28:32.234122 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:28:32.234405 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:28:42.233510 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:28:42.233816 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:29:02.232965 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:29:02.233193 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:29:42.234908 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:29:42.235523 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:29:42.235545 1770976 kubeadm.go:310]
I0127 12:29:42.235636 1770976 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 12:29:42.235762 1770976 kubeadm.go:310] timed out waiting for the condition
I0127 12:29:42.235785 1770976 kubeadm.go:310]
I0127 12:29:42.235883 1770976 kubeadm.go:310] This error is likely caused by:
I0127 12:29:42.235962 1770976 kubeadm.go:310] - The kubelet is not running
I0127 12:29:42.236218 1770976 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 12:29:42.236238 1770976 kubeadm.go:310]
I0127 12:29:42.236509 1770976 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 12:29:42.236600 1770976 kubeadm.go:310] - 'systemctl status kubelet'
I0127 12:29:42.236714 1770976 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 12:29:42.236745 1770976 kubeadm.go:310]
I0127 12:29:42.237025 1770976 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 12:29:42.237253 1770976 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 12:29:42.237277 1770976 kubeadm.go:310]
I0127 12:29:42.237514 1770976 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 12:29:42.237796 1770976 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 12:29:42.238287 1770976 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 12:29:42.238455 1770976 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 12:29:42.238490 1770976 kubeadm.go:310]
I0127 12:29:42.238724 1770976 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 12:29:42.239047 1770976 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 12:29:42.239605 1770976 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0127 12:29:42.239752 1770976 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-488586] and IPs [192.168.39.109 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-488586] and IPs [192.168.39.109 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-488586] and IPs [192.168.39.109 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-488586] and IPs [192.168.39.109 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 12:29:42.239807 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0127 12:29:42.718386 1770976 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 12:29:42.737559 1770976 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 12:29:42.751657 1770976 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 12:29:42.751683 1770976 kubeadm.go:157] found existing configuration files:
I0127 12:29:42.751734 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 12:29:42.763538 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 12:29:42.763620 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 12:29:42.776456 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 12:29:42.788680 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 12:29:42.788756 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 12:29:42.801677 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 12:29:42.815190 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 12:29:42.815250 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 12:29:42.827374 1770976 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 12:29:42.836173 1770976 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 12:29:42.836238 1770976 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 12:29:42.845509 1770976 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 12:29:42.928834 1770976 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 12:29:42.929031 1770976 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 12:29:43.118934 1770976 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 12:29:43.119097 1770976 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 12:29:43.119281 1770976 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 12:29:43.308383 1770976 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 12:29:43.310313 1770976 out.go:235] - Generating certificates and keys ...
I0127 12:29:43.310489 1770976 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 12:29:43.310635 1770976 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 12:29:43.310794 1770976 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 12:29:43.310905 1770976 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0127 12:29:43.311014 1770976 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0127 12:29:43.311089 1770976 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0127 12:29:43.311292 1770976 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0127 12:29:43.311783 1770976 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0127 12:29:43.312228 1770976 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 12:29:43.312629 1770976 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 12:29:43.312799 1770976 kubeadm.go:310] [certs] Using the existing "sa" key
I0127 12:29:43.312921 1770976 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 12:29:43.602725 1770976 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 12:29:43.857997 1770976 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 12:29:44.379554 1770976 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 12:29:44.494805 1770976 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 12:29:44.526062 1770976 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 12:29:44.528126 1770976 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 12:29:44.528223 1770976 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 12:29:44.719923 1770976 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 12:29:44.722034 1770976 out.go:235] - Booting up control plane ...
I0127 12:29:44.722151 1770976 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 12:29:44.738488 1770976 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 12:29:44.739892 1770976 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 12:29:44.740896 1770976 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 12:29:44.746347 1770976 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 12:30:24.748343 1770976 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 12:30:24.748878 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:30:24.749150 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:30:29.749719 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:30:29.749994 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:30:39.750623 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:30:39.750931 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:30:59.749897 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:30:59.750112 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:31:39.750380 1770976 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 12:31:39.750616 1770976 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 12:31:39.750630 1770976 kubeadm.go:310]
I0127 12:31:39.750663 1770976 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 12:31:39.750695 1770976 kubeadm.go:310] timed out waiting for the condition
I0127 12:31:39.750702 1770976 kubeadm.go:310]
I0127 12:31:39.750738 1770976 kubeadm.go:310] This error is likely caused by:
I0127 12:31:39.750813 1770976 kubeadm.go:310] - The kubelet is not running
I0127 12:31:39.750961 1770976 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 12:31:39.750972 1770976 kubeadm.go:310]
I0127 12:31:39.751059 1770976 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 12:31:39.751090 1770976 kubeadm.go:310] - 'systemctl status kubelet'
I0127 12:31:39.751122 1770976 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 12:31:39.751129 1770976 kubeadm.go:310]
I0127 12:31:39.751206 1770976 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 12:31:39.751271 1770976 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 12:31:39.751277 1770976 kubeadm.go:310]
I0127 12:31:39.751385 1770976 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 12:31:39.751454 1770976 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 12:31:39.751522 1770976 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 12:31:39.751583 1770976 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 12:31:39.751591 1770976 kubeadm.go:310]
I0127 12:31:39.752431 1770976 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 12:31:39.752532 1770976 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 12:31:39.752597 1770976 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 12:31:39.752675 1770976 kubeadm.go:394] duration metric: took 3m55.872330445s to StartCluster
I0127 12:31:39.752734 1770976 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0127 12:31:39.752805 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 12:31:39.794978 1770976 cri.go:89] found id: ""
I0127 12:31:39.795006 1770976 logs.go:282] 0 containers: []
W0127 12:31:39.795016 1770976 logs.go:284] No container was found matching "kube-apiserver"
I0127 12:31:39.795022 1770976 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0127 12:31:39.795089 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 12:31:39.830171 1770976 cri.go:89] found id: ""
I0127 12:31:39.830206 1770976 logs.go:282] 0 containers: []
W0127 12:31:39.830216 1770976 logs.go:284] No container was found matching "etcd"
I0127 12:31:39.830222 1770976 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0127 12:31:39.830276 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 12:31:39.861816 1770976 cri.go:89] found id: ""
I0127 12:31:39.861849 1770976 logs.go:282] 0 containers: []
W0127 12:31:39.861858 1770976 logs.go:284] No container was found matching "coredns"
I0127 12:31:39.861869 1770976 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0127 12:31:39.861924 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 12:31:39.894638 1770976 cri.go:89] found id: ""
I0127 12:31:39.894666 1770976 logs.go:282] 0 containers: []
W0127 12:31:39.894674 1770976 logs.go:284] No container was found matching "kube-scheduler"
I0127 12:31:39.894680 1770976 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0127 12:31:39.894752 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 12:31:39.939147 1770976 cri.go:89] found id: ""
I0127 12:31:39.939179 1770976 logs.go:282] 0 containers: []
W0127 12:31:39.939191 1770976 logs.go:284] No container was found matching "kube-proxy"
I0127 12:31:39.939200 1770976 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0127 12:31:39.939273 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 12:31:39.973139 1770976 cri.go:89] found id: ""
I0127 12:31:39.973162 1770976 logs.go:282] 0 containers: []
W0127 12:31:39.973179 1770976 logs.go:284] No container was found matching "kube-controller-manager"
I0127 12:31:39.973186 1770976 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0127 12:31:39.973232 1770976 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 12:31:40.004379 1770976 cri.go:89] found id: ""
I0127 12:31:40.004405 1770976 logs.go:282] 0 containers: []
W0127 12:31:40.004413 1770976 logs.go:284] No container was found matching "kindnet"
I0127 12:31:40.004424 1770976 logs.go:123] Gathering logs for container status ...
I0127 12:31:40.004437 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 12:31:40.038601 1770976 logs.go:123] Gathering logs for kubelet ...
I0127 12:31:40.038631 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 12:31:40.089297 1770976 logs.go:123] Gathering logs for dmesg ...
I0127 12:31:40.089325 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 12:31:40.101279 1770976 logs.go:123] Gathering logs for describe nodes ...
I0127 12:31:40.101304 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 12:31:40.201806 1770976 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0127 12:31:40.201833 1770976 logs.go:123] Gathering logs for CRI-O ...
I0127 12:31:40.201847 1770976 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0127 12:31:40.302713 1770976 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 12:31:40.302792 1770976 out.go:270] *
*
W0127 12:31:40.302875 1770976 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 12:31:40.302893 1770976 out.go:270] *
*
W0127 12:31:40.303788 1770976 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 12:31:40.306389 1770976 out.go:201]
W0127 12:31:40.307421 1770976 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 12:31:40.307466 1770976 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 12:31:40.307495 1770976 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 12:31:40.308654 1770976 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-488586 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-488586 -n old-k8s-version-488586
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-488586 -n old-k8s-version-488586: exit status 6 (234.885137ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 12:31:40.589064 1774217 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-488586" does not appear in /home/jenkins/minikube-integration/20318-1724227/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-488586" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (275.21s)