=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-405706 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-405706 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m49.78765698s)
-- stdout --
* [old-k8s-version-405706] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20321
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20321-1005652/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20321-1005652/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-405706" primary control-plane node in "old-k8s-version-405706" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 15:31:11.464681 1068488 out.go:345] Setting OutFile to fd 1 ...
I0127 15:31:11.464969 1068488 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 15:31:11.464986 1068488 out.go:358] Setting ErrFile to fd 2...
I0127 15:31:11.464992 1068488 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 15:31:11.465307 1068488 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20321-1005652/.minikube/bin
I0127 15:31:11.466219 1068488 out.go:352] Setting JSON to false
I0127 15:31:11.468319 1068488 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":22418,"bootTime":1737969453,"procs":289,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0127 15:31:11.468464 1068488 start.go:139] virtualization: kvm guest
I0127 15:31:11.471052 1068488 out.go:177] * [old-k8s-version-405706] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0127 15:31:11.472809 1068488 out.go:177] - MINIKUBE_LOCATION=20321
I0127 15:31:11.472986 1068488 notify.go:220] Checking for updates...
I0127 15:31:11.475866 1068488 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 15:31:11.477488 1068488 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20321-1005652/kubeconfig
I0127 15:31:11.478926 1068488 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20321-1005652/.minikube
I0127 15:31:11.480321 1068488 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0127 15:31:11.482025 1068488 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 15:31:11.484164 1068488 config.go:182] Loaded profile config "bridge-230388": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 15:31:11.484396 1068488 config.go:182] Loaded profile config "enable-default-cni-230388": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 15:31:11.484550 1068488 config.go:182] Loaded profile config "flannel-230388": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 15:31:11.484775 1068488 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 15:31:11.531141 1068488 out.go:177] * Using the kvm2 driver based on user configuration
I0127 15:31:11.532545 1068488 start.go:297] selected driver: kvm2
I0127 15:31:11.532568 1068488 start.go:901] validating driver "kvm2" against <nil>
I0127 15:31:11.532585 1068488 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 15:31:11.533688 1068488 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 15:31:11.533806 1068488 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20321-1005652/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0127 15:31:11.551680 1068488 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0127 15:31:11.551777 1068488 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 15:31:11.552156 1068488 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 15:31:11.552204 1068488 cni.go:84] Creating CNI manager for ""
I0127 15:31:11.552282 1068488 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 15:31:11.552297 1068488 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0127 15:31:11.552368 1068488 start.go:340] cluster config:
{Name:old-k8s-version-405706 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-405706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0127 15:31:11.552512 1068488 iso.go:125] acquiring lock: {Name:mk09983d13fb1a3582857ab934539ca4709ad90a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 15:31:11.555232 1068488 out.go:177] * Starting "old-k8s-version-405706" primary control-plane node in "old-k8s-version-405706" cluster
I0127 15:31:11.556799 1068488 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 15:31:11.556850 1068488 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0127 15:31:11.556865 1068488 cache.go:56] Caching tarball of preloaded images
I0127 15:31:11.556974 1068488 preload.go:172] Found /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0127 15:31:11.556988 1068488 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0127 15:31:11.557117 1068488 profile.go:143] Saving config to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/config.json ...
I0127 15:31:11.557146 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/config.json: {Name:mk02af48a296bed7dcfaaac24e9a5197e65ef07e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:31:11.557331 1068488 start.go:360] acquireMachinesLock for old-k8s-version-405706: {Name:mk884e36253ca066a698970989f20649e5f9cbef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0127 15:31:28.995441 1068488 start.go:364] duration metric: took 17.438050275s to acquireMachinesLock for "old-k8s-version-405706"
I0127 15:31:28.995501 1068488 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-405706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-405706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0127 15:31:28.995648 1068488 start.go:125] createHost starting for "" (driver="kvm2")
I0127 15:31:28.997678 1068488 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0127 15:31:28.997891 1068488 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0127 15:31:28.997944 1068488 main.go:141] libmachine: Launching plugin server for driver kvm2
I0127 15:31:29.016014 1068488 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34659
I0127 15:31:29.016882 1068488 main.go:141] libmachine: () Calling .GetVersion
I0127 15:31:29.017584 1068488 main.go:141] libmachine: Using API Version 1
I0127 15:31:29.017605 1068488 main.go:141] libmachine: () Calling .SetConfigRaw
I0127 15:31:29.018025 1068488 main.go:141] libmachine: () Calling .GetMachineName
I0127 15:31:29.018248 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetMachineName
I0127 15:31:29.018394 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:29.018526 1068488 start.go:159] libmachine.API.Create for "old-k8s-version-405706" (driver="kvm2")
I0127 15:31:29.018555 1068488 client.go:168] LocalClient.Create starting
I0127 15:31:29.018591 1068488 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca.pem
I0127 15:31:29.018628 1068488 main.go:141] libmachine: Decoding PEM data...
I0127 15:31:29.018645 1068488 main.go:141] libmachine: Parsing certificate...
I0127 15:31:29.018711 1068488 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/cert.pem
I0127 15:31:29.018739 1068488 main.go:141] libmachine: Decoding PEM data...
I0127 15:31:29.018753 1068488 main.go:141] libmachine: Parsing certificate...
I0127 15:31:29.018774 1068488 main.go:141] libmachine: Running pre-create checks...
I0127 15:31:29.018847 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .PreCreateCheck
I0127 15:31:29.019548 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetConfigRaw
I0127 15:31:29.020178 1068488 main.go:141] libmachine: Creating machine...
I0127 15:31:29.020197 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .Create
I0127 15:31:29.020400 1068488 main.go:141] libmachine: (old-k8s-version-405706) creating KVM machine...
I0127 15:31:29.020479 1068488 main.go:141] libmachine: (old-k8s-version-405706) creating network...
I0127 15:31:29.022165 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found existing default KVM network
I0127 15:31:29.024447 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.024271 1068991 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:95:67:a9} reservation:<nil>}
I0127 15:31:29.025589 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.025487 1068991 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:e2:fe:ba} reservation:<nil>}
I0127 15:31:29.026955 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.026875 1068991 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:97:6f:95} reservation:<nil>}
I0127 15:31:29.028512 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.028413 1068991 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003f0b30}
I0127 15:31:29.028706 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | created network xml:
I0127 15:31:29.028721 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | <network>
I0127 15:31:29.028733 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | <name>mk-old-k8s-version-405706</name>
I0127 15:31:29.028742 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | <dns enable='no'/>
I0127 15:31:29.028752 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG |
I0127 15:31:29.028773 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0127 15:31:29.028783 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | <dhcp>
I0127 15:31:29.028791 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0127 15:31:29.028800 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | </dhcp>
I0127 15:31:29.028808 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | </ip>
I0127 15:31:29.028816 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG |
I0127 15:31:29.028824 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | </network>
I0127 15:31:29.028834 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG |
I0127 15:31:29.035550 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | trying to create private KVM network mk-old-k8s-version-405706 192.168.72.0/24...
I0127 15:31:29.128159 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | private KVM network mk-old-k8s-version-405706 192.168.72.0/24 created
I0127 15:31:29.128193 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting up store path in /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706 ...
I0127 15:31:29.128207 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.128119 1068991 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20321-1005652/.minikube
I0127 15:31:29.128246 1068488 main.go:141] libmachine: (old-k8s-version-405706) building disk image from file:///home/jenkins/minikube-integration/20321-1005652/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0127 15:31:29.128263 1068488 main.go:141] libmachine: (old-k8s-version-405706) Downloading /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20321-1005652/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0127 15:31:29.452194 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.452089 1068991 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa...
I0127 15:31:29.760996 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.760841 1068991 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/old-k8s-version-405706.rawdisk...
I0127 15:31:29.761146 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | Writing magic tar header
I0127 15:31:29.761339 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | Writing SSH key tar header
I0127 15:31:29.761478 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:29.761389 1068991 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706 ...
I0127 15:31:29.761712 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706
I0127 15:31:29.761734 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting executable bit set on /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706 (perms=drwx------)
I0127 15:31:29.761745 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20321-1005652/.minikube/machines
I0127 15:31:29.761769 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting executable bit set on /home/jenkins/minikube-integration/20321-1005652/.minikube/machines (perms=drwxr-xr-x)
I0127 15:31:29.761800 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20321-1005652/.minikube
I0127 15:31:29.761883 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting executable bit set on /home/jenkins/minikube-integration/20321-1005652/.minikube (perms=drwxr-xr-x)
I0127 15:31:29.761952 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20321-1005652
I0127 15:31:29.761970 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting executable bit set on /home/jenkins/minikube-integration/20321-1005652 (perms=drwxrwxr-x)
I0127 15:31:29.762014 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0127 15:31:29.762071 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0127 15:31:29.762141 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home/jenkins
I0127 15:31:29.762191 1068488 main.go:141] libmachine: (old-k8s-version-405706) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0127 15:31:29.762246 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | checking permissions on dir: /home
I0127 15:31:29.762294 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | skipping /home - not owner
I0127 15:31:29.762341 1068488 main.go:141] libmachine: (old-k8s-version-405706) creating domain...
I0127 15:31:29.764498 1068488 main.go:141] libmachine: (old-k8s-version-405706) define libvirt domain using xml:
I0127 15:31:29.764517 1068488 main.go:141] libmachine: (old-k8s-version-405706) <domain type='kvm'>
I0127 15:31:29.764538 1068488 main.go:141] libmachine: (old-k8s-version-405706) <name>old-k8s-version-405706</name>
I0127 15:31:29.764549 1068488 main.go:141] libmachine: (old-k8s-version-405706) <memory unit='MiB'>2200</memory>
I0127 15:31:29.764560 1068488 main.go:141] libmachine: (old-k8s-version-405706) <vcpu>2</vcpu>
I0127 15:31:29.764572 1068488 main.go:141] libmachine: (old-k8s-version-405706) <features>
I0127 15:31:29.764585 1068488 main.go:141] libmachine: (old-k8s-version-405706) <acpi/>
I0127 15:31:29.764592 1068488 main.go:141] libmachine: (old-k8s-version-405706) <apic/>
I0127 15:31:29.764604 1068488 main.go:141] libmachine: (old-k8s-version-405706) <pae/>
I0127 15:31:29.764610 1068488 main.go:141] libmachine: (old-k8s-version-405706)
I0127 15:31:29.764618 1068488 main.go:141] libmachine: (old-k8s-version-405706) </features>
I0127 15:31:29.764630 1068488 main.go:141] libmachine: (old-k8s-version-405706) <cpu mode='host-passthrough'>
I0127 15:31:29.764638 1068488 main.go:141] libmachine: (old-k8s-version-405706)
I0127 15:31:29.764647 1068488 main.go:141] libmachine: (old-k8s-version-405706) </cpu>
I0127 15:31:29.764655 1068488 main.go:141] libmachine: (old-k8s-version-405706) <os>
I0127 15:31:29.764665 1068488 main.go:141] libmachine: (old-k8s-version-405706) <type>hvm</type>
I0127 15:31:29.764673 1068488 main.go:141] libmachine: (old-k8s-version-405706) <boot dev='cdrom'/>
I0127 15:31:29.764683 1068488 main.go:141] libmachine: (old-k8s-version-405706) <boot dev='hd'/>
I0127 15:31:29.764689 1068488 main.go:141] libmachine: (old-k8s-version-405706) <bootmenu enable='no'/>
I0127 15:31:29.764694 1068488 main.go:141] libmachine: (old-k8s-version-405706) </os>
I0127 15:31:29.764701 1068488 main.go:141] libmachine: (old-k8s-version-405706) <devices>
I0127 15:31:29.764711 1068488 main.go:141] libmachine: (old-k8s-version-405706) <disk type='file' device='cdrom'>
I0127 15:31:29.764726 1068488 main.go:141] libmachine: (old-k8s-version-405706) <source file='/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/boot2docker.iso'/>
I0127 15:31:29.764736 1068488 main.go:141] libmachine: (old-k8s-version-405706) <target dev='hdc' bus='scsi'/>
I0127 15:31:29.764746 1068488 main.go:141] libmachine: (old-k8s-version-405706) <readonly/>
I0127 15:31:29.764756 1068488 main.go:141] libmachine: (old-k8s-version-405706) </disk>
I0127 15:31:29.764766 1068488 main.go:141] libmachine: (old-k8s-version-405706) <disk type='file' device='disk'>
I0127 15:31:29.764778 1068488 main.go:141] libmachine: (old-k8s-version-405706) <driver name='qemu' type='raw' cache='default' io='threads' />
I0127 15:31:29.764794 1068488 main.go:141] libmachine: (old-k8s-version-405706) <source file='/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/old-k8s-version-405706.rawdisk'/>
I0127 15:31:29.764805 1068488 main.go:141] libmachine: (old-k8s-version-405706) <target dev='hda' bus='virtio'/>
I0127 15:31:29.764816 1068488 main.go:141] libmachine: (old-k8s-version-405706) </disk>
I0127 15:31:29.764823 1068488 main.go:141] libmachine: (old-k8s-version-405706) <interface type='network'>
I0127 15:31:29.764833 1068488 main.go:141] libmachine: (old-k8s-version-405706) <source network='mk-old-k8s-version-405706'/>
I0127 15:31:29.764844 1068488 main.go:141] libmachine: (old-k8s-version-405706) <model type='virtio'/>
I0127 15:31:29.764852 1068488 main.go:141] libmachine: (old-k8s-version-405706) </interface>
I0127 15:31:29.764866 1068488 main.go:141] libmachine: (old-k8s-version-405706) <interface type='network'>
I0127 15:31:29.764874 1068488 main.go:141] libmachine: (old-k8s-version-405706) <source network='default'/>
I0127 15:31:29.764878 1068488 main.go:141] libmachine: (old-k8s-version-405706) <model type='virtio'/>
I0127 15:31:29.764886 1068488 main.go:141] libmachine: (old-k8s-version-405706) </interface>
I0127 15:31:29.764890 1068488 main.go:141] libmachine: (old-k8s-version-405706) <serial type='pty'>
I0127 15:31:29.764897 1068488 main.go:141] libmachine: (old-k8s-version-405706) <target port='0'/>
I0127 15:31:29.764901 1068488 main.go:141] libmachine: (old-k8s-version-405706) </serial>
I0127 15:31:29.764908 1068488 main.go:141] libmachine: (old-k8s-version-405706) <console type='pty'>
I0127 15:31:29.764915 1068488 main.go:141] libmachine: (old-k8s-version-405706) <target type='serial' port='0'/>
I0127 15:31:29.764920 1068488 main.go:141] libmachine: (old-k8s-version-405706) </console>
I0127 15:31:29.764929 1068488 main.go:141] libmachine: (old-k8s-version-405706) <rng model='virtio'>
I0127 15:31:29.764935 1068488 main.go:141] libmachine: (old-k8s-version-405706) <backend model='random'>/dev/random</backend>
I0127 15:31:29.764938 1068488 main.go:141] libmachine: (old-k8s-version-405706) </rng>
I0127 15:31:29.764943 1068488 main.go:141] libmachine: (old-k8s-version-405706)
I0127 15:31:29.764949 1068488 main.go:141] libmachine: (old-k8s-version-405706)
I0127 15:31:29.764954 1068488 main.go:141] libmachine: (old-k8s-version-405706) </devices>
I0127 15:31:29.764960 1068488 main.go:141] libmachine: (old-k8s-version-405706) </domain>
I0127 15:31:29.764967 1068488 main.go:141] libmachine: (old-k8s-version-405706)
I0127 15:31:29.770050 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:1c:ed:b0 in network default
I0127 15:31:29.770839 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:29.770861 1068488 main.go:141] libmachine: (old-k8s-version-405706) starting domain...
I0127 15:31:29.770895 1068488 main.go:141] libmachine: (old-k8s-version-405706) ensuring networks are active...
I0127 15:31:29.771798 1068488 main.go:141] libmachine: (old-k8s-version-405706) Ensuring network default is active
I0127 15:31:29.772220 1068488 main.go:141] libmachine: (old-k8s-version-405706) Ensuring network mk-old-k8s-version-405706 is active
I0127 15:31:29.772856 1068488 main.go:141] libmachine: (old-k8s-version-405706) getting domain XML...
I0127 15:31:29.773868 1068488 main.go:141] libmachine: (old-k8s-version-405706) creating domain...
I0127 15:31:31.439322 1068488 main.go:141] libmachine: (old-k8s-version-405706) waiting for IP...
I0127 15:31:31.440290 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:31.440765 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:31.440816 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:31.440756 1068991 retry.go:31] will retry after 303.434567ms: waiting for domain to come up
I0127 15:31:31.748985 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:31.749957 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:31.749986 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:31.749942 1068991 retry.go:31] will retry after 369.936346ms: waiting for domain to come up
I0127 15:31:32.121823 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:32.122291 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:32.122370 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:32.122302 1068991 retry.go:31] will retry after 352.994659ms: waiting for domain to come up
I0127 15:31:32.478464 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:32.479743 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:32.479800 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:32.479716 1068991 retry.go:31] will retry after 380.044501ms: waiting for domain to come up
I0127 15:31:32.861290 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:32.861930 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:32.861963 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:32.861888 1068991 retry.go:31] will retry after 745.725276ms: waiting for domain to come up
I0127 15:31:33.609115 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:33.609487 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:33.609515 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:33.609487 1068991 retry.go:31] will retry after 744.641364ms: waiting for domain to come up
I0127 15:31:34.356328 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:34.356919 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:34.356952 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:34.356869 1068991 retry.go:31] will retry after 801.411861ms: waiting for domain to come up
I0127 15:31:35.159519 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:35.160194 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:35.160235 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:35.160151 1068991 retry.go:31] will retry after 1.416652771s: waiting for domain to come up
I0127 15:31:36.578340 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:36.578823 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:36.578894 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:36.578795 1068991 retry.go:31] will retry after 1.215712427s: waiting for domain to come up
I0127 15:31:37.796230 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:37.796755 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:37.796783 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:37.796723 1068991 retry.go:31] will retry after 2.104512717s: waiting for domain to come up
I0127 15:31:39.902740 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:39.903358 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:39.903392 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:39.903309 1068991 retry.go:31] will retry after 2.13337839s: waiting for domain to come up
I0127 15:31:42.038925 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:42.039517 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:42.039562 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:42.039521 1068991 retry.go:31] will retry after 3.075234373s: waiting for domain to come up
I0127 15:31:45.116236 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:45.116798 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:45.116890 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:45.116795 1068991 retry.go:31] will retry after 3.128667547s: waiting for domain to come up
I0127 15:31:48.249092 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:48.249653 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find current IP address of domain old-k8s-version-405706 in network mk-old-k8s-version-405706
I0127 15:31:48.249682 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | I0127 15:31:48.249620 1068991 retry.go:31] will retry after 4.415522736s: waiting for domain to come up
I0127 15:31:52.667111 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:52.667688 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has current primary IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:52.667710 1068488 main.go:141] libmachine: (old-k8s-version-405706) found domain IP: 192.168.72.49
I0127 15:31:52.667720 1068488 main.go:141] libmachine: (old-k8s-version-405706) reserving static IP address...
I0127 15:31:52.668060 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-405706", mac: "52:54:00:c3:d6:50", ip: "192.168.72.49"} in network mk-old-k8s-version-405706
I0127 15:31:52.769588 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | Getting to WaitForSSH function...
I0127 15:31:52.769619 1068488 main.go:141] libmachine: (old-k8s-version-405706) reserved static IP address 192.168.72.49 for domain old-k8s-version-405706
I0127 15:31:52.769633 1068488 main.go:141] libmachine: (old-k8s-version-405706) waiting for SSH...
I0127 15:31:52.773673 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:52.774187 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:52.774225 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:52.774407 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | Using SSH client type: external
I0127 15:31:52.774449 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | Using SSH private key: /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa (-rw-------)
I0127 15:31:52.774485 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.49 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa -p 22] /usr/bin/ssh <nil>}
I0127 15:31:52.774497 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | About to run SSH command:
I0127 15:31:52.774520 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | exit 0
I0127 15:31:52.906804 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | SSH cmd err, output: <nil>:
I0127 15:31:52.907171 1068488 main.go:141] libmachine: (old-k8s-version-405706) KVM machine creation complete
I0127 15:31:52.907509 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetConfigRaw
I0127 15:31:52.908167 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:52.908392 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:52.908639 1068488 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0127 15:31:52.908659 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetState
I0127 15:31:52.910100 1068488 main.go:141] libmachine: Detecting operating system of created instance...
I0127 15:31:52.910116 1068488 main.go:141] libmachine: Waiting for SSH to be available...
I0127 15:31:52.910121 1068488 main.go:141] libmachine: Getting to WaitForSSH function...
I0127 15:31:52.910127 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:52.912974 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:52.913403 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:52.913433 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:52.913562 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:52.913776 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:52.913968 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:52.914111 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:52.914310 1068488 main.go:141] libmachine: Using SSH client type: native
I0127 15:31:52.914578 1068488 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0127 15:31:52.914595 1068488 main.go:141] libmachine: About to run SSH command:
exit 0
I0127 15:31:53.027912 1068488 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 15:31:53.027939 1068488 main.go:141] libmachine: Detecting the provisioner...
I0127 15:31:53.027951 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:53.031687 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.032199 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:53.032246 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.032508 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:53.032817 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:53.033053 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:53.033253 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:53.033515 1068488 main.go:141] libmachine: Using SSH client type: native
I0127 15:31:53.033756 1068488 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0127 15:31:53.033776 1068488 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0127 15:31:53.155017 1068488 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0127 15:31:53.155141 1068488 main.go:141] libmachine: found compatible host: buildroot
I0127 15:31:53.155160 1068488 main.go:141] libmachine: Provisioning with buildroot...
I0127 15:31:53.155172 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetMachineName
I0127 15:31:53.155514 1068488 buildroot.go:166] provisioning hostname "old-k8s-version-405706"
I0127 15:31:53.155563 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetMachineName
I0127 15:31:53.155817 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:53.158626 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.158981 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:53.159010 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.159136 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:53.159342 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:53.159509 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:53.159673 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:53.159850 1068488 main.go:141] libmachine: Using SSH client type: native
I0127 15:31:53.160059 1068488 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0127 15:31:53.160077 1068488 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-405706 && echo "old-k8s-version-405706" | sudo tee /etc/hostname
I0127 15:31:53.282800 1068488 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-405706
I0127 15:31:53.282836 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:53.286120 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.286522 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:53.286561 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.286927 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:53.287164 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:53.287378 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:53.287560 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:53.287749 1068488 main.go:141] libmachine: Using SSH client type: native
I0127 15:31:53.288008 1068488 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0127 15:31:53.288035 1068488 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-405706' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-405706/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-405706' | sudo tee -a /etc/hosts;
fi
fi
I0127 15:31:53.404374 1068488 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 15:31:53.404435 1068488 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20321-1005652/.minikube CaCertPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20321-1005652/.minikube}
I0127 15:31:53.404497 1068488 buildroot.go:174] setting up certificates
I0127 15:31:53.404514 1068488 provision.go:84] configureAuth start
I0127 15:31:53.404529 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetMachineName
I0127 15:31:53.404846 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetIP
I0127 15:31:53.408112 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.408549 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:53.408579 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.408818 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:53.411327 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.411677 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:53.411708 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:53.411854 1068488 provision.go:143] copyHostCerts
I0127 15:31:53.411922 1068488 exec_runner.go:144] found /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.pem, removing ...
I0127 15:31:53.411944 1068488 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.pem
I0127 15:31:53.412003 1068488 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.pem (1078 bytes)
I0127 15:31:53.412091 1068488 exec_runner.go:144] found /home/jenkins/minikube-integration/20321-1005652/.minikube/cert.pem, removing ...
I0127 15:31:53.412100 1068488 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20321-1005652/.minikube/cert.pem
I0127 15:31:53.412118 1068488 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20321-1005652/.minikube/cert.pem (1123 bytes)
I0127 15:31:53.412173 1068488 exec_runner.go:144] found /home/jenkins/minikube-integration/20321-1005652/.minikube/key.pem, removing ...
I0127 15:31:53.412181 1068488 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20321-1005652/.minikube/key.pem
I0127 15:31:53.412203 1068488 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20321-1005652/.minikube/key.pem (1679 bytes)
I0127 15:31:53.412260 1068488 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-405706 san=[127.0.0.1 192.168.72.49 localhost minikube old-k8s-version-405706]
I0127 15:31:54.143917 1068488 provision.go:177] copyRemoteCerts
I0127 15:31:54.144005 1068488 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 15:31:54.144050 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:54.147354 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.147771 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.147799 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.148030 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:54.148261 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.148462 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:54.148628 1068488 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa Username:docker}
I0127 15:31:54.239315 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 15:31:54.266295 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 15:31:54.296904 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0127 15:31:54.324236 1068488 provision.go:87] duration metric: took 919.702673ms to configureAuth
I0127 15:31:54.324274 1068488 buildroot.go:189] setting minikube options for container-runtime
I0127 15:31:54.324478 1068488 config.go:182] Loaded profile config "old-k8s-version-405706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 15:31:54.324574 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:54.327544 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.327930 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.327966 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.328118 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:54.328287 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.328487 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.328729 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:54.328942 1068488 main.go:141] libmachine: Using SSH client type: native
I0127 15:31:54.329300 1068488 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0127 15:31:54.329329 1068488 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0127 15:31:54.595824 1068488 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0127 15:31:54.595857 1068488 main.go:141] libmachine: Checking connection to Docker...
I0127 15:31:54.595870 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetURL
I0127 15:31:54.597472 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | using libvirt version 6000000
I0127 15:31:54.600176 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.600579 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.600612 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.600800 1068488 main.go:141] libmachine: Docker is up and running!
I0127 15:31:54.600814 1068488 main.go:141] libmachine: Reticulating splines...
I0127 15:31:54.600823 1068488 client.go:171] duration metric: took 25.582259068s to LocalClient.Create
I0127 15:31:54.600848 1068488 start.go:167] duration metric: took 25.582323385s to libmachine.API.Create "old-k8s-version-405706"
I0127 15:31:54.600863 1068488 start.go:293] postStartSetup for "old-k8s-version-405706" (driver="kvm2")
I0127 15:31:54.600878 1068488 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 15:31:54.600902 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:54.601147 1068488 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 15:31:54.601176 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:54.603534 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.603875 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.603901 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.604060 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:54.604284 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.604450 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:54.604623 1068488 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa Username:docker}
I0127 15:31:54.696013 1068488 ssh_runner.go:195] Run: cat /etc/os-release
I0127 15:31:54.702224 1068488 info.go:137] Remote host: Buildroot 2023.02.9
I0127 15:31:54.702259 1068488 filesync.go:126] Scanning /home/jenkins/minikube-integration/20321-1005652/.minikube/addons for local assets ...
I0127 15:31:54.702351 1068488 filesync.go:126] Scanning /home/jenkins/minikube-integration/20321-1005652/.minikube/files for local assets ...
I0127 15:31:54.702472 1068488 filesync.go:149] local asset: /home/jenkins/minikube-integration/20321-1005652/.minikube/files/etc/ssl/certs/10128162.pem -> 10128162.pem in /etc/ssl/certs
I0127 15:31:54.702600 1068488 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 15:31:54.715152 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/files/etc/ssl/certs/10128162.pem --> /etc/ssl/certs/10128162.pem (1708 bytes)
I0127 15:31:54.740446 1068488 start.go:296] duration metric: took 139.562096ms for postStartSetup
I0127 15:31:54.740519 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetConfigRaw
I0127 15:31:54.741268 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetIP
I0127 15:31:54.744176 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.744561 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.744594 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.744876 1068488 profile.go:143] Saving config to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/config.json ...
I0127 15:31:54.745107 1068488 start.go:128] duration metric: took 25.749444412s to createHost
I0127 15:31:54.745136 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:54.747487 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.747825 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.747854 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.747975 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:54.748182 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.748308 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.748456 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:54.748602 1068488 main.go:141] libmachine: Using SSH client type: native
I0127 15:31:54.748780 1068488 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0127 15:31:54.748792 1068488 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0127 15:31:54.862602 1068488 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737991914.809674967
I0127 15:31:54.862631 1068488 fix.go:216] guest clock: 1737991914.809674967
I0127 15:31:54.862641 1068488 fix.go:229] Guest: 2025-01-27 15:31:54.809674967 +0000 UTC Remote: 2025-01-27 15:31:54.745122648 +0000 UTC m=+43.344900664 (delta=64.552319ms)
I0127 15:31:54.862694 1068488 fix.go:200] guest clock delta is within tolerance: 64.552319ms
I0127 15:31:54.862705 1068488 start.go:83] releasing machines lock for "old-k8s-version-405706", held for 25.86723713s
I0127 15:31:54.862748 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:54.863071 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetIP
I0127 15:31:54.866546 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.866987 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.867008 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.867333 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:54.867885 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:54.868096 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .DriverName
I0127 15:31:54.868207 1068488 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 15:31:54.868279 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:54.868621 1068488 ssh_runner.go:195] Run: cat /version.json
I0127 15:31:54.868683 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHHostname
I0127 15:31:54.880243 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.880450 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.880655 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.880700 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.880811 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:54.880846 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:54.880921 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:54.881095 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHPort
I0127 15:31:54.881172 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.881320 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:54.881322 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHKeyPath
I0127 15:31:54.881523 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetSSHUsername
I0127 15:31:54.881511 1068488 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa Username:docker}
I0127 15:31:54.881718 1068488 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20321-1005652/.minikube/machines/old-k8s-version-405706/id_rsa Username:docker}
I0127 15:31:54.997060 1068488 ssh_runner.go:195] Run: systemctl --version
I0127 15:31:55.005507 1068488 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0127 15:31:55.176817 1068488 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0127 15:31:55.185365 1068488 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0127 15:31:55.185443 1068488 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 15:31:55.204999 1068488 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0127 15:31:55.205054 1068488 start.go:495] detecting cgroup driver to use...
I0127 15:31:55.205147 1068488 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0127 15:31:55.226523 1068488 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0127 15:31:55.246165 1068488 docker.go:217] disabling cri-docker service (if available) ...
I0127 15:31:55.246237 1068488 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 15:31:55.265498 1068488 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 15:31:55.284594 1068488 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 15:31:55.448004 1068488 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 15:31:55.616996 1068488 docker.go:233] disabling docker service ...
I0127 15:31:55.617113 1068488 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 15:31:55.636529 1068488 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 15:31:55.660414 1068488 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 15:31:55.842747 1068488 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 15:31:55.995073 1068488 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 15:31:56.012871 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0127 15:31:56.037165 1068488 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0127 15:31:56.037245 1068488 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 15:31:56.048668 1068488 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0127 15:31:56.048751 1068488 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 15:31:56.060337 1068488 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0127 15:31:56.072085 1068488 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0127 15:31:56.085703 1068488 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 15:31:56.100998 1068488 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 15:31:56.116142 1068488 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0127 15:31:56.116220 1068488 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0127 15:31:56.154398 1068488 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 15:31:56.169666 1068488 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 15:31:56.312173 1068488 ssh_runner.go:195] Run: sudo systemctl restart crio
I0127 15:31:56.757160 1068488 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0127 15:31:56.757253 1068488 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0127 15:31:56.763286 1068488 start.go:563] Will wait 60s for crictl version
I0127 15:31:56.763360 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:31:56.768568 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 15:31:56.818562 1068488 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0127 15:31:56.818688 1068488 ssh_runner.go:195] Run: crio --version
I0127 15:31:56.854118 1068488 ssh_runner.go:195] Run: crio --version
I0127 15:31:56.890314 1068488 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0127 15:31:56.891572 1068488 main.go:141] libmachine: (old-k8s-version-405706) Calling .GetIP
I0127 15:31:56.895244 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:56.895766 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c3:d6:50", ip: ""} in network mk-old-k8s-version-405706: {Iface:virbr4 ExpiryTime:2025-01-27 16:31:46 +0000 UTC Type:0 Mac:52:54:00:c3:d6:50 Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-405706 Clientid:01:52:54:00:c3:d6:50}
I0127 15:31:56.895798 1068488 main.go:141] libmachine: (old-k8s-version-405706) DBG | domain old-k8s-version-405706 has defined IP address 192.168.72.49 and MAC address 52:54:00:c3:d6:50 in network mk-old-k8s-version-405706
I0127 15:31:56.896218 1068488 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0127 15:31:56.900921 1068488 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 15:31:56.916354 1068488 kubeadm.go:883] updating cluster {Name:old-k8s-version-405706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-405706 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.49 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 15:31:56.916520 1068488 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 15:31:56.916594 1068488 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 15:31:56.957570 1068488 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 15:31:56.957660 1068488 ssh_runner.go:195] Run: which lz4
I0127 15:31:56.962297 1068488 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0127 15:31:56.966986 1068488 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0127 15:31:56.967024 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0127 15:31:58.757895 1068488 crio.go:462] duration metric: took 1.795630336s to copy over tarball
I0127 15:31:58.758006 1068488 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0127 15:32:01.484600 1068488 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.726551001s)
I0127 15:32:01.484650 1068488 crio.go:469] duration metric: took 2.72671774s to extract the tarball
I0127 15:32:01.484662 1068488 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0127 15:32:01.528722 1068488 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 15:32:01.585532 1068488 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 15:32:01.585564 1068488 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0127 15:32:01.585637 1068488 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 15:32:01.585673 1068488 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:01.585692 1068488 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:01.585708 1068488 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0127 15:32:01.585715 1068488 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0127 15:32:01.585638 1068488 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:01.585729 1068488 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:01.585737 1068488 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0127 15:32:01.587215 1068488 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0127 15:32:01.587219 1068488 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0127 15:32:01.587232 1068488 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:01.587237 1068488 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 15:32:01.587252 1068488 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:01.587232 1068488 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:01.587277 1068488 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:01.587376 1068488 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0127 15:32:01.760578 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:01.777364 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0127 15:32:01.785880 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0127 15:32:01.797600 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:01.810711 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0127 15:32:01.811465 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:01.824292 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:01.829352 1068488 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0127 15:32:01.829432 1068488 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:01.829487 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.923910 1068488 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0127 15:32:01.923971 1068488 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0127 15:32:01.924025 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.939576 1068488 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0127 15:32:01.939633 1068488 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0127 15:32:01.939669 1068488 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:01.939723 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.939639 1068488 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0127 15:32:01.939792 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.984164 1068488 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0127 15:32:01.984222 1068488 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0127 15:32:01.984275 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.985398 1068488 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0127 15:32:01.985446 1068488 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:01.985452 1068488 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0127 15:32:01.985495 1068488 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:01.985500 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.985537 1068488 ssh_runner.go:195] Run: which crictl
I0127 15:32:01.985543 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:01.985592 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 15:32:01.985603 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 15:32:01.985654 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:01.989030 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 15:32:02.064404 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:02.110244 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:02.110311 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 15:32:02.110383 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:02.115255 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:02.115376 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 15:32:02.115394 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 15:32:02.178528 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:02.189199 1068488 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0127 15:32:02.304204 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 15:32:02.304270 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 15:32:02.304367 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:02.329433 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 15:32:02.329506 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 15:32:02.352263 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 15:32:02.352276 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 15:32:02.546782 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0127 15:32:02.546862 1068488 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 15:32:02.546869 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0127 15:32:02.546992 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0127 15:32:02.547029 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0127 15:32:02.547103 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0127 15:32:02.547134 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0127 15:32:02.583993 1068488 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0127 15:32:02.584064 1068488 cache_images.go:92] duration metric: took 998.482949ms to LoadCachedImages
W0127 15:32:02.584144 1068488 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20321-1005652/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0127 15:32:02.584163 1068488 kubeadm.go:934] updating node { 192.168.72.49 8443 v1.20.0 crio true true} ...
I0127 15:32:02.584285 1068488 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-405706 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.49
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-405706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 15:32:02.584377 1068488 ssh_runner.go:195] Run: crio config
I0127 15:32:02.633334 1068488 cni.go:84] Creating CNI manager for ""
I0127 15:32:02.633367 1068488 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 15:32:02.633382 1068488 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 15:32:02.633411 1068488 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.49 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-405706 NodeName:old-k8s-version-405706 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.49"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.49 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 15:32:02.633617 1068488 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.49
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-405706"
kubeletExtraArgs:
node-ip: 192.168.72.49
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.49"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 15:32:02.633690 1068488 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 15:32:02.645546 1068488 binaries.go:44] Found k8s binaries, skipping transfer
I0127 15:32:02.645623 1068488 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 15:32:02.655951 1068488 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0127 15:32:02.674720 1068488 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 15:32:02.696536 1068488 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0127 15:32:02.715482 1068488 ssh_runner.go:195] Run: grep 192.168.72.49 control-plane.minikube.internal$ /etc/hosts
I0127 15:32:02.719880 1068488 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.49 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 15:32:02.735739 1068488 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 15:32:02.874529 1068488 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 15:32:02.897491 1068488 certs.go:68] Setting up /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706 for IP: 192.168.72.49
I0127 15:32:02.897521 1068488 certs.go:194] generating shared ca certs ...
I0127 15:32:02.897545 1068488 certs.go:226] acquiring lock for ca certs: {Name:mk0f815247e4bef2bde3ddcae95639d1cd9cab24 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:02.897730 1068488 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.key
I0127 15:32:02.897783 1068488 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/proxy-client-ca.key
I0127 15:32:02.897796 1068488 certs.go:256] generating profile certs ...
I0127 15:32:02.897920 1068488 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/client.key
I0127 15:32:02.897963 1068488 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/client.crt with IP's: []
I0127 15:32:03.255184 1068488 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/client.crt ...
I0127 15:32:03.255230 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/client.crt: {Name:mk07e665948467da2f46a392d43845f87923c563 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:03.255451 1068488 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/client.key ...
I0127 15:32:03.255474 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/client.key: {Name:mk0713850b81ac9f559ebf443c5b9ebc55b0f869 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:03.255614 1068488 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.key.8816e362
I0127 15:32:03.255642 1068488 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.crt.8816e362 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.49]
I0127 15:32:03.473732 1068488 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.crt.8816e362 ...
I0127 15:32:03.473776 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.crt.8816e362: {Name:mk99ed8fed5f8937175b6daaddbfac3818f20b12 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:03.473980 1068488 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.key.8816e362 ...
I0127 15:32:03.474003 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.key.8816e362: {Name:mk337b87c724a5d0d87a9f60b861f955fe2277d7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:03.474121 1068488 certs.go:381] copying /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.crt.8816e362 -> /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.crt
I0127 15:32:03.474241 1068488 certs.go:385] copying /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.key.8816e362 -> /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.key
I0127 15:32:03.474330 1068488 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.key
I0127 15:32:03.474357 1068488 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.crt with IP's: []
I0127 15:32:03.676255 1068488 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.crt ...
I0127 15:32:03.676299 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.crt: {Name:mkf8c38ab1cfd17f046601a2a40e41029d6c7711 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:03.676501 1068488 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.key ...
I0127 15:32:03.676518 1068488 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.key: {Name:mk2e555f456da2a90be16b0f9b7a1a74242d1cf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 15:32:03.676747 1068488 certs.go:484] found cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/1012816.pem (1338 bytes)
W0127 15:32:03.676799 1068488 certs.go:480] ignoring /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/1012816_empty.pem, impossibly tiny 0 bytes
I0127 15:32:03.676810 1068488 certs.go:484] found cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca-key.pem (1679 bytes)
I0127 15:32:03.676844 1068488 certs.go:484] found cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/ca.pem (1078 bytes)
I0127 15:32:03.676878 1068488 certs.go:484] found cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/cert.pem (1123 bytes)
I0127 15:32:03.676908 1068488 certs.go:484] found cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/key.pem (1679 bytes)
I0127 15:32:03.676960 1068488 certs.go:484] found cert: /home/jenkins/minikube-integration/20321-1005652/.minikube/files/etc/ssl/certs/10128162.pem (1708 bytes)
I0127 15:32:03.677775 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 15:32:03.706988 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0127 15:32:03.733684 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 15:32:03.759485 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0127 15:32:03.787421 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 15:32:03.844528 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0127 15:32:03.885195 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 15:32:03.920652 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/profiles/old-k8s-version-405706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0127 15:32:03.981214 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/files/etc/ssl/certs/10128162.pem --> /usr/share/ca-certificates/10128162.pem (1708 bytes)
I0127 15:32:04.010415 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 15:32:04.048487 1068488 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20321-1005652/.minikube/certs/1012816.pem --> /usr/share/ca-certificates/1012816.pem (1338 bytes)
I0127 15:32:04.081807 1068488 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 15:32:04.107731 1068488 ssh_runner.go:195] Run: openssl version
I0127 15:32:04.115417 1068488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 15:32:04.131032 1068488 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 15:32:04.136340 1068488 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 14:06 /usr/share/ca-certificates/minikubeCA.pem
I0127 15:32:04.136413 1068488 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 15:32:04.143483 1068488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 15:32:04.157154 1068488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1012816.pem && ln -fs /usr/share/ca-certificates/1012816.pem /etc/ssl/certs/1012816.pem"
I0127 15:32:04.173559 1068488 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1012816.pem
I0127 15:32:04.180076 1068488 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 14:20 /usr/share/ca-certificates/1012816.pem
I0127 15:32:04.180156 1068488 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1012816.pem
I0127 15:32:04.188523 1068488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1012816.pem /etc/ssl/certs/51391683.0"
I0127 15:32:04.202178 1068488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10128162.pem && ln -fs /usr/share/ca-certificates/10128162.pem /etc/ssl/certs/10128162.pem"
I0127 15:32:04.214804 1068488 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10128162.pem
I0127 15:32:04.219831 1068488 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 14:20 /usr/share/ca-certificates/10128162.pem
I0127 15:32:04.219912 1068488 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10128162.pem
I0127 15:32:04.226704 1068488 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10128162.pem /etc/ssl/certs/3ec20f2e.0"
I0127 15:32:04.239594 1068488 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 15:32:04.244955 1068488 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 15:32:04.245078 1068488 kubeadm.go:392] StartCluster: {Name:old-k8s-version-405706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-405706 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.49 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 15:32:04.245187 1068488 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0127 15:32:04.245248 1068488 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 15:32:04.293496 1068488 cri.go:89] found id: ""
I0127 15:32:04.293575 1068488 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 15:32:04.305028 1068488 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 15:32:04.317584 1068488 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 15:32:04.329615 1068488 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 15:32:04.329641 1068488 kubeadm.go:157] found existing configuration files:
I0127 15:32:04.329701 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 15:32:04.340477 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 15:32:04.340557 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 15:32:04.351641 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 15:32:04.362325 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 15:32:04.362395 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 15:32:04.372949 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 15:32:04.385125 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 15:32:04.385207 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 15:32:04.397576 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 15:32:04.409863 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 15:32:04.409929 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 15:32:04.422342 1068488 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 15:32:04.752584 1068488 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 15:34:03.149330 1068488 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 15:34:03.149483 1068488 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 15:34:03.151081 1068488 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 15:34:03.151217 1068488 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 15:34:03.151551 1068488 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 15:34:03.151812 1068488 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 15:34:03.152194 1068488 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 15:34:03.152365 1068488 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 15:34:03.154118 1068488 out.go:235] - Generating certificates and keys ...
I0127 15:34:03.154238 1068488 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 15:34:03.154313 1068488 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 15:34:03.154370 1068488 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 15:34:03.154421 1068488 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 15:34:03.154469 1068488 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 15:34:03.154509 1068488 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 15:34:03.154552 1068488 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 15:34:03.154654 1068488 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-405706] and IPs [192.168.72.49 127.0.0.1 ::1]
I0127 15:34:03.154700 1068488 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 15:34:03.154809 1068488 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-405706] and IPs [192.168.72.49 127.0.0.1 ::1]
I0127 15:34:03.154864 1068488 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 15:34:03.154917 1068488 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 15:34:03.154955 1068488 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 15:34:03.155009 1068488 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 15:34:03.155051 1068488 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 15:34:03.155097 1068488 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 15:34:03.155150 1068488 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 15:34:03.155194 1068488 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 15:34:03.155309 1068488 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 15:34:03.155438 1068488 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 15:34:03.155505 1068488 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 15:34:03.155600 1068488 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 15:34:03.157159 1068488 out.go:235] - Booting up control plane ...
I0127 15:34:03.157232 1068488 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 15:34:03.157296 1068488 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 15:34:03.157351 1068488 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 15:34:03.157432 1068488 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 15:34:03.157599 1068488 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 15:34:03.157669 1068488 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 15:34:03.157755 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:03.157944 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:34:03.158042 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:03.158226 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:34:03.158315 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:03.158523 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:34:03.158592 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:03.158735 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:34:03.158790 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:03.158947 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:34:03.158963 1068488 kubeadm.go:310]
I0127 15:34:03.159023 1068488 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 15:34:03.159117 1068488 kubeadm.go:310] timed out waiting for the condition
I0127 15:34:03.159137 1068488 kubeadm.go:310]
I0127 15:34:03.159173 1068488 kubeadm.go:310] This error is likely caused by:
I0127 15:34:03.159202 1068488 kubeadm.go:310] - The kubelet is not running
I0127 15:34:03.159287 1068488 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 15:34:03.159295 1068488 kubeadm.go:310]
I0127 15:34:03.159378 1068488 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 15:34:03.159411 1068488 kubeadm.go:310] - 'systemctl status kubelet'
I0127 15:34:03.159437 1068488 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 15:34:03.159444 1068488 kubeadm.go:310]
I0127 15:34:03.159529 1068488 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 15:34:03.159602 1068488 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 15:34:03.159608 1068488 kubeadm.go:310]
I0127 15:34:03.159696 1068488 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 15:34:03.159764 1068488 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 15:34:03.159827 1068488 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 15:34:03.159887 1068488 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 15:34:03.159938 1068488 kubeadm.go:310]
W0127 15:34:03.160008 1068488 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-405706] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-405706] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-405706] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-405706] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 15:34:03.160044 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0127 15:34:04.021231 1068488 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 15:34:04.035964 1068488 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 15:34:04.046354 1068488 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 15:34:04.046381 1068488 kubeadm.go:157] found existing configuration files:
I0127 15:34:04.046427 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 15:34:04.056203 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 15:34:04.056277 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 15:34:04.066729 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 15:34:04.076382 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 15:34:04.076454 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 15:34:04.086304 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 15:34:04.095695 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 15:34:04.095752 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 15:34:04.105666 1068488 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 15:34:04.115031 1068488 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 15:34:04.115093 1068488 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 15:34:04.125207 1068488 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 15:34:04.198603 1068488 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 15:34:04.198681 1068488 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 15:34:04.362159 1068488 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 15:34:04.362300 1068488 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 15:34:04.362445 1068488 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 15:34:04.557069 1068488 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 15:34:04.559176 1068488 out.go:235] - Generating certificates and keys ...
I0127 15:34:04.560830 1068488 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 15:34:04.560958 1068488 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 15:34:04.561125 1068488 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 15:34:04.561229 1068488 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0127 15:34:04.561326 1068488 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0127 15:34:04.561403 1068488 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0127 15:34:04.561635 1068488 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0127 15:34:04.562270 1068488 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0127 15:34:04.562581 1068488 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 15:34:04.563601 1068488 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 15:34:04.563668 1068488 kubeadm.go:310] [certs] Using the existing "sa" key
I0127 15:34:04.563727 1068488 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 15:34:04.737282 1068488 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 15:34:04.807784 1068488 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 15:34:05.037219 1068488 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 15:34:05.247842 1068488 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 15:34:05.262840 1068488 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 15:34:05.265456 1068488 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 15:34:05.265668 1068488 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 15:34:05.412105 1068488 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 15:34:05.414296 1068488 out.go:235] - Booting up control plane ...
I0127 15:34:05.414409 1068488 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 15:34:05.420663 1068488 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 15:34:05.422892 1068488 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 15:34:05.423759 1068488 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 15:34:05.426018 1068488 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 15:34:45.426191 1068488 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 15:34:45.426586 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:45.426809 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:34:50.427296 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:34:50.427484 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:35:00.428186 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:35:00.428439 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:35:20.429624 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:35:20.429933 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:36:00.432284 1068488 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 15:36:00.432611 1068488 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 15:36:00.432645 1068488 kubeadm.go:310]
I0127 15:36:00.432705 1068488 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 15:36:00.432784 1068488 kubeadm.go:310] timed out waiting for the condition
I0127 15:36:00.432803 1068488 kubeadm.go:310]
I0127 15:36:00.432835 1068488 kubeadm.go:310] This error is likely caused by:
I0127 15:36:00.432881 1068488 kubeadm.go:310] - The kubelet is not running
I0127 15:36:00.432983 1068488 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 15:36:00.433026 1068488 kubeadm.go:310]
I0127 15:36:00.433205 1068488 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 15:36:00.433258 1068488 kubeadm.go:310] - 'systemctl status kubelet'
I0127 15:36:00.433290 1068488 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 15:36:00.433297 1068488 kubeadm.go:310]
I0127 15:36:00.433435 1068488 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 15:36:00.433561 1068488 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 15:36:00.433573 1068488 kubeadm.go:310]
I0127 15:36:00.433749 1068488 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 15:36:00.433881 1068488 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 15:36:00.434004 1068488 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 15:36:00.434135 1068488 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 15:36:00.434148 1068488 kubeadm.go:310]
I0127 15:36:00.435065 1068488 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 15:36:00.435196 1068488 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 15:36:00.435305 1068488 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 15:36:00.435388 1068488 kubeadm.go:394] duration metric: took 3m56.190314874s to StartCluster
I0127 15:36:00.435456 1068488 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0127 15:36:00.435524 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 15:36:00.493355 1068488 cri.go:89] found id: ""
I0127 15:36:00.493393 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.493405 1068488 logs.go:284] No container was found matching "kube-apiserver"
I0127 15:36:00.493414 1068488 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0127 15:36:00.493488 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 15:36:00.543647 1068488 cri.go:89] found id: ""
I0127 15:36:00.543677 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.543686 1068488 logs.go:284] No container was found matching "etcd"
I0127 15:36:00.543692 1068488 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0127 15:36:00.543749 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 15:36:00.582196 1068488 cri.go:89] found id: ""
I0127 15:36:00.582226 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.582239 1068488 logs.go:284] No container was found matching "coredns"
I0127 15:36:00.582247 1068488 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0127 15:36:00.582321 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 15:36:00.623063 1068488 cri.go:89] found id: ""
I0127 15:36:00.623106 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.623121 1068488 logs.go:284] No container was found matching "kube-scheduler"
I0127 15:36:00.623131 1068488 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0127 15:36:00.623207 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 15:36:00.681718 1068488 cri.go:89] found id: ""
I0127 15:36:00.681748 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.681757 1068488 logs.go:284] No container was found matching "kube-proxy"
I0127 15:36:00.681763 1068488 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0127 15:36:00.681827 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 15:36:00.723064 1068488 cri.go:89] found id: ""
I0127 15:36:00.723094 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.723103 1068488 logs.go:284] No container was found matching "kube-controller-manager"
I0127 15:36:00.723111 1068488 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0127 15:36:00.723178 1068488 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 15:36:00.766012 1068488 cri.go:89] found id: ""
I0127 15:36:00.766047 1068488 logs.go:282] 0 containers: []
W0127 15:36:00.766060 1068488 logs.go:284] No container was found matching "kindnet"
I0127 15:36:00.766074 1068488 logs.go:123] Gathering logs for kubelet ...
I0127 15:36:00.766092 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 15:36:00.820144 1068488 logs.go:123] Gathering logs for dmesg ...
I0127 15:36:00.820184 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 15:36:00.838217 1068488 logs.go:123] Gathering logs for describe nodes ...
I0127 15:36:00.838244 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 15:36:00.995013 1068488 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0127 15:36:00.995043 1068488 logs.go:123] Gathering logs for CRI-O ...
I0127 15:36:00.995059 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0127 15:36:01.119183 1068488 logs.go:123] Gathering logs for container status ...
I0127 15:36:01.119242 1068488 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0127 15:36:01.164311 1068488 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 15:36:01.164390 1068488 out.go:270] *
*
W0127 15:36:01.164465 1068488 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 15:36:01.164485 1068488 out.go:270] *
*
W0127 15:36:01.165733 1068488 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 15:36:01.169677 1068488 out.go:201]
W0127 15:36:01.171153 1068488 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 15:36:01.171222 1068488 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 15:36:01.171252 1068488 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 15:36:01.172961 1068488 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-405706 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-405706 -n old-k8s-version-405706
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-405706 -n old-k8s-version-405706: exit status 6 (276.010694ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 15:36:01.502482 1075387 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-405706" does not appear in /home/jenkins/minikube-integration/20321-1005652/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-405706" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (290.13s)