=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-529869 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0414 15:28:01.432851 1853270 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/functional-907700/client.crt: no such file or directory" logger="UnhandledError"
E0414 15:28:18.359240 1853270 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/functional-907700/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-529869 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.782397757s)
-- stdout --
* [old-k8s-version-529869] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20512
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20512-1845971/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20512-1845971/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-529869" primary control-plane node in "old-k8s-version-529869" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0414 15:27:57.594172 1894281 out.go:345] Setting OutFile to fd 1 ...
I0414 15:27:57.594453 1894281 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 15:27:57.594464 1894281 out.go:358] Setting ErrFile to fd 2...
I0414 15:27:57.594469 1894281 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 15:27:57.595117 1894281 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20512-1845971/.minikube/bin
I0414 15:27:57.596097 1894281 out.go:352] Setting JSON to false
I0414 15:27:57.597454 1894281 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":40222,"bootTime":1744604256,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0414 15:27:57.597581 1894281 start.go:139] virtualization: kvm guest
I0414 15:27:57.599475 1894281 out.go:177] * [old-k8s-version-529869] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0414 15:27:57.601177 1894281 out.go:177] - MINIKUBE_LOCATION=20512
I0414 15:27:57.601196 1894281 notify.go:220] Checking for updates...
I0414 15:27:57.603766 1894281 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0414 15:27:57.605253 1894281 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20512-1845971/kubeconfig
I0414 15:27:57.606402 1894281 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20512-1845971/.minikube
I0414 15:27:57.607564 1894281 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0414 15:27:57.608748 1894281 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0414 15:27:57.610340 1894281 config.go:182] Loaded profile config "cert-expiration-197648": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 15:27:57.610490 1894281 config.go:182] Loaded profile config "cert-options-722854": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 15:27:57.610566 1894281 config.go:182] Loaded profile config "kubernetes-upgrade-608146": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 15:27:57.610669 1894281 driver.go:394] Setting default libvirt URI to qemu:///system
I0414 15:27:57.649607 1894281 out.go:177] * Using the kvm2 driver based on user configuration
I0414 15:27:57.650844 1894281 start.go:297] selected driver: kvm2
I0414 15:27:57.650859 1894281 start.go:901] validating driver "kvm2" against <nil>
I0414 15:27:57.650871 1894281 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0414 15:27:57.651605 1894281 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 15:27:57.651691 1894281 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20512-1845971/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0414 15:27:57.668625 1894281 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0414 15:27:57.668699 1894281 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0414 15:27:57.668947 1894281 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0414 15:27:57.668983 1894281 cni.go:84] Creating CNI manager for ""
I0414 15:27:57.669021 1894281 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 15:27:57.669030 1894281 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0414 15:27:57.669087 1894281 start.go:340] cluster config:
{Name:old-k8s-version-529869 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-529869 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 15:27:57.669189 1894281 iso.go:125] acquiring lock: {Name:mk9159854686c19b2179fc7bffd50051c3c78481 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 15:27:57.671023 1894281 out.go:177] * Starting "old-k8s-version-529869" primary control-plane node in "old-k8s-version-529869" cluster
I0414 15:27:57.672186 1894281 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 15:27:57.672251 1894281 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0414 15:27:57.672265 1894281 cache.go:56] Caching tarball of preloaded images
I0414 15:27:57.672358 1894281 preload.go:172] Found /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0414 15:27:57.672373 1894281 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0414 15:27:57.672480 1894281 profile.go:143] Saving config to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/config.json ...
I0414 15:27:57.672506 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/config.json: {Name:mk47952f76e51c0b0a1564c9696d8b03612bd3f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:27:57.672695 1894281 start.go:360] acquireMachinesLock for old-k8s-version-529869: {Name:mkc86dc13bd021dec2438d67c38653da4675f04d Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0414 15:28:00.347953 1894281 start.go:364] duration metric: took 2.675212458s to acquireMachinesLock for "old-k8s-version-529869"
I0414 15:28:00.348023 1894281 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-529869 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-529869 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0414 15:28:00.348229 1894281 start.go:125] createHost starting for "" (driver="kvm2")
I0414 15:28:00.351537 1894281 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0414 15:28:00.351917 1894281 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0414 15:28:00.352000 1894281 main.go:141] libmachine: Launching plugin server for driver kvm2
I0414 15:28:00.369616 1894281 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40113
I0414 15:28:00.370143 1894281 main.go:141] libmachine: () Calling .GetVersion
I0414 15:28:00.370732 1894281 main.go:141] libmachine: Using API Version 1
I0414 15:28:00.370759 1894281 main.go:141] libmachine: () Calling .SetConfigRaw
I0414 15:28:00.371182 1894281 main.go:141] libmachine: () Calling .GetMachineName
I0414 15:28:00.371397 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetMachineName
I0414 15:28:00.371573 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:00.371745 1894281 start.go:159] libmachine.API.Create for "old-k8s-version-529869" (driver="kvm2")
I0414 15:28:00.371783 1894281 client.go:168] LocalClient.Create starting
I0414 15:28:00.371832 1894281 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca.pem
I0414 15:28:00.371880 1894281 main.go:141] libmachine: Decoding PEM data...
I0414 15:28:00.371907 1894281 main.go:141] libmachine: Parsing certificate...
I0414 15:28:00.372020 1894281 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/cert.pem
I0414 15:28:00.372059 1894281 main.go:141] libmachine: Decoding PEM data...
I0414 15:28:00.372078 1894281 main.go:141] libmachine: Parsing certificate...
I0414 15:28:00.372104 1894281 main.go:141] libmachine: Running pre-create checks...
I0414 15:28:00.372123 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .PreCreateCheck
I0414 15:28:00.372531 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetConfigRaw
I0414 15:28:00.373020 1894281 main.go:141] libmachine: Creating machine...
I0414 15:28:00.373037 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .Create
I0414 15:28:00.373207 1894281 main.go:141] libmachine: (old-k8s-version-529869) creating KVM machine...
I0414 15:28:00.373229 1894281 main.go:141] libmachine: (old-k8s-version-529869) creating network...
I0414 15:28:00.374843 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found existing default KVM network
I0414 15:28:00.376135 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:00.375935 1894321 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:00:21:1c} reservation:<nil>}
I0414 15:28:00.377642 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:00.377506 1894321 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00028a310}
I0414 15:28:00.377674 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | created network xml:
I0414 15:28:00.377686 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | <network>
I0414 15:28:00.377693 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | <name>mk-old-k8s-version-529869</name>
I0414 15:28:00.377703 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | <dns enable='no'/>
I0414 15:28:00.377709 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG |
I0414 15:28:00.377718 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0414 15:28:00.377730 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | <dhcp>
I0414 15:28:00.377741 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0414 15:28:00.377752 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | </dhcp>
I0414 15:28:00.377761 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | </ip>
I0414 15:28:00.377770 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG |
I0414 15:28:00.377778 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | </network>
I0414 15:28:00.377787 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG |
I0414 15:28:00.383756 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | trying to create private KVM network mk-old-k8s-version-529869 192.168.50.0/24...
I0414 15:28:00.465557 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | private KVM network mk-old-k8s-version-529869 192.168.50.0/24 created
I0414 15:28:00.465649 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:00.465517 1894321 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20512-1845971/.minikube
I0414 15:28:00.465664 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting up store path in /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869 ...
I0414 15:28:00.465696 1894281 main.go:141] libmachine: (old-k8s-version-529869) building disk image from file:///home/jenkins/minikube-integration/20512-1845971/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0414 15:28:00.465714 1894281 main.go:141] libmachine: (old-k8s-version-529869) Downloading /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20512-1845971/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0414 15:28:00.773102 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:00.772870 1894321 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa...
I0414 15:28:00.922516 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:00.922301 1894321 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/old-k8s-version-529869.rawdisk...
I0414 15:28:00.922565 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Writing magic tar header
I0414 15:28:00.922589 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Writing SSH key tar header
I0414 15:28:00.922614 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:00.922501 1894321 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869 ...
I0414 15:28:00.922651 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869
I0414 15:28:00.922678 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting executable bit set on /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869 (perms=drwx------)
I0414 15:28:00.922710 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting executable bit set on /home/jenkins/minikube-integration/20512-1845971/.minikube/machines (perms=drwxr-xr-x)
I0414 15:28:00.922730 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting executable bit set on /home/jenkins/minikube-integration/20512-1845971/.minikube (perms=drwxr-xr-x)
I0414 15:28:00.922749 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines
I0414 15:28:00.922766 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting executable bit set on /home/jenkins/minikube-integration/20512-1845971 (perms=drwxrwxr-x)
I0414 15:28:00.922787 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20512-1845971/.minikube
I0414 15:28:00.922799 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0414 15:28:00.922847 1894281 main.go:141] libmachine: (old-k8s-version-529869) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0414 15:28:00.922870 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20512-1845971
I0414 15:28:00.922883 1894281 main.go:141] libmachine: (old-k8s-version-529869) creating domain...
I0414 15:28:00.922902 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0414 15:28:00.922911 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home/jenkins
I0414 15:28:00.922922 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | checking permissions on dir: /home
I0414 15:28:00.922934 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | skipping /home - not owner
I0414 15:28:00.924087 1894281 main.go:141] libmachine: (old-k8s-version-529869) define libvirt domain using xml:
I0414 15:28:00.924117 1894281 main.go:141] libmachine: (old-k8s-version-529869) <domain type='kvm'>
I0414 15:28:00.924129 1894281 main.go:141] libmachine: (old-k8s-version-529869) <name>old-k8s-version-529869</name>
I0414 15:28:00.924136 1894281 main.go:141] libmachine: (old-k8s-version-529869) <memory unit='MiB'>2200</memory>
I0414 15:28:00.924144 1894281 main.go:141] libmachine: (old-k8s-version-529869) <vcpu>2</vcpu>
I0414 15:28:00.924150 1894281 main.go:141] libmachine: (old-k8s-version-529869) <features>
I0414 15:28:00.924158 1894281 main.go:141] libmachine: (old-k8s-version-529869) <acpi/>
I0414 15:28:00.924184 1894281 main.go:141] libmachine: (old-k8s-version-529869) <apic/>
I0414 15:28:00.924213 1894281 main.go:141] libmachine: (old-k8s-version-529869) <pae/>
I0414 15:28:00.924229 1894281 main.go:141] libmachine: (old-k8s-version-529869)
I0414 15:28:00.924236 1894281 main.go:141] libmachine: (old-k8s-version-529869) </features>
I0414 15:28:00.924249 1894281 main.go:141] libmachine: (old-k8s-version-529869) <cpu mode='host-passthrough'>
I0414 15:28:00.924262 1894281 main.go:141] libmachine: (old-k8s-version-529869)
I0414 15:28:00.924275 1894281 main.go:141] libmachine: (old-k8s-version-529869) </cpu>
I0414 15:28:00.924287 1894281 main.go:141] libmachine: (old-k8s-version-529869) <os>
I0414 15:28:00.924297 1894281 main.go:141] libmachine: (old-k8s-version-529869) <type>hvm</type>
I0414 15:28:00.924309 1894281 main.go:141] libmachine: (old-k8s-version-529869) <boot dev='cdrom'/>
I0414 15:28:00.924317 1894281 main.go:141] libmachine: (old-k8s-version-529869) <boot dev='hd'/>
I0414 15:28:00.924329 1894281 main.go:141] libmachine: (old-k8s-version-529869) <bootmenu enable='no'/>
I0414 15:28:00.924340 1894281 main.go:141] libmachine: (old-k8s-version-529869) </os>
I0414 15:28:00.924375 1894281 main.go:141] libmachine: (old-k8s-version-529869) <devices>
I0414 15:28:00.924398 1894281 main.go:141] libmachine: (old-k8s-version-529869) <disk type='file' device='cdrom'>
I0414 15:28:00.924414 1894281 main.go:141] libmachine: (old-k8s-version-529869) <source file='/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/boot2docker.iso'/>
I0414 15:28:00.924424 1894281 main.go:141] libmachine: (old-k8s-version-529869) <target dev='hdc' bus='scsi'/>
I0414 15:28:00.924433 1894281 main.go:141] libmachine: (old-k8s-version-529869) <readonly/>
I0414 15:28:00.924444 1894281 main.go:141] libmachine: (old-k8s-version-529869) </disk>
I0414 15:28:00.924457 1894281 main.go:141] libmachine: (old-k8s-version-529869) <disk type='file' device='disk'>
I0414 15:28:00.924468 1894281 main.go:141] libmachine: (old-k8s-version-529869) <driver name='qemu' type='raw' cache='default' io='threads' />
I0414 15:28:00.924493 1894281 main.go:141] libmachine: (old-k8s-version-529869) <source file='/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/old-k8s-version-529869.rawdisk'/>
I0414 15:28:00.924504 1894281 main.go:141] libmachine: (old-k8s-version-529869) <target dev='hda' bus='virtio'/>
I0414 15:28:00.924512 1894281 main.go:141] libmachine: (old-k8s-version-529869) </disk>
I0414 15:28:00.924529 1894281 main.go:141] libmachine: (old-k8s-version-529869) <interface type='network'>
I0414 15:28:00.924542 1894281 main.go:141] libmachine: (old-k8s-version-529869) <source network='mk-old-k8s-version-529869'/>
I0414 15:28:00.924557 1894281 main.go:141] libmachine: (old-k8s-version-529869) <model type='virtio'/>
I0414 15:28:00.924568 1894281 main.go:141] libmachine: (old-k8s-version-529869) </interface>
I0414 15:28:00.924575 1894281 main.go:141] libmachine: (old-k8s-version-529869) <interface type='network'>
I0414 15:28:00.924585 1894281 main.go:141] libmachine: (old-k8s-version-529869) <source network='default'/>
I0414 15:28:00.924597 1894281 main.go:141] libmachine: (old-k8s-version-529869) <model type='virtio'/>
I0414 15:28:00.924606 1894281 main.go:141] libmachine: (old-k8s-version-529869) </interface>
I0414 15:28:00.924616 1894281 main.go:141] libmachine: (old-k8s-version-529869) <serial type='pty'>
I0414 15:28:00.924624 1894281 main.go:141] libmachine: (old-k8s-version-529869) <target port='0'/>
I0414 15:28:00.924633 1894281 main.go:141] libmachine: (old-k8s-version-529869) </serial>
I0414 15:28:00.924667 1894281 main.go:141] libmachine: (old-k8s-version-529869) <console type='pty'>
I0414 15:28:00.924705 1894281 main.go:141] libmachine: (old-k8s-version-529869) <target type='serial' port='0'/>
I0414 15:28:00.924719 1894281 main.go:141] libmachine: (old-k8s-version-529869) </console>
I0414 15:28:00.924729 1894281 main.go:141] libmachine: (old-k8s-version-529869) <rng model='virtio'>
I0414 15:28:00.924739 1894281 main.go:141] libmachine: (old-k8s-version-529869) <backend model='random'>/dev/random</backend>
I0414 15:28:00.924749 1894281 main.go:141] libmachine: (old-k8s-version-529869) </rng>
I0414 15:28:00.924757 1894281 main.go:141] libmachine: (old-k8s-version-529869)
I0414 15:28:00.924765 1894281 main.go:141] libmachine: (old-k8s-version-529869)
I0414 15:28:00.924773 1894281 main.go:141] libmachine: (old-k8s-version-529869) </devices>
I0414 15:28:00.924782 1894281 main.go:141] libmachine: (old-k8s-version-529869) </domain>
I0414 15:28:00.924793 1894281 main.go:141] libmachine: (old-k8s-version-529869)
I0414 15:28:00.929437 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:30:67:9d in network default
I0414 15:28:00.930251 1894281 main.go:141] libmachine: (old-k8s-version-529869) starting domain...
I0414 15:28:00.930275 1894281 main.go:141] libmachine: (old-k8s-version-529869) ensuring networks are active...
I0414 15:28:00.930284 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:00.931189 1894281 main.go:141] libmachine: (old-k8s-version-529869) Ensuring network default is active
I0414 15:28:00.931551 1894281 main.go:141] libmachine: (old-k8s-version-529869) Ensuring network mk-old-k8s-version-529869 is active
I0414 15:28:00.932190 1894281 main.go:141] libmachine: (old-k8s-version-529869) getting domain XML...
I0414 15:28:00.933025 1894281 main.go:141] libmachine: (old-k8s-version-529869) creating domain...
I0414 15:28:01.326753 1894281 main.go:141] libmachine: (old-k8s-version-529869) waiting for IP...
I0414 15:28:01.327871 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:01.328341 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:01.328397 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:01.328344 1894321 retry.go:31] will retry after 253.337377ms: waiting for domain to come up
I0414 15:28:01.582943 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:01.583524 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:01.583555 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:01.583500 1894321 retry.go:31] will retry after 334.781636ms: waiting for domain to come up
I0414 15:28:01.920191 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:01.920827 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:01.920852 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:01.920796 1894321 retry.go:31] will retry after 313.16322ms: waiting for domain to come up
I0414 15:28:02.235351 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:02.235986 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:02.236017 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:02.235948 1894321 retry.go:31] will retry after 367.594918ms: waiting for domain to come up
I0414 15:28:02.605348 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:02.605964 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:02.606039 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:02.605949 1894321 retry.go:31] will retry after 612.424712ms: waiting for domain to come up
I0414 15:28:03.219890 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:03.220489 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:03.220553 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:03.220460 1894321 retry.go:31] will retry after 750.226652ms: waiting for domain to come up
I0414 15:28:03.972282 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:03.972967 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:03.973006 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:03.972898 1894321 retry.go:31] will retry after 1.135680292s: waiting for domain to come up
I0414 15:28:05.110002 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:05.110606 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:05.110631 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:05.110563 1894321 retry.go:31] will retry after 1.225347627s: waiting for domain to come up
I0414 15:28:06.337490 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:06.337975 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:06.338000 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:06.337944 1894321 retry.go:31] will retry after 1.570344958s: waiting for domain to come up
I0414 15:28:07.910179 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:07.910781 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:07.910827 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:07.910737 1894321 retry.go:31] will retry after 1.520237138s: waiting for domain to come up
I0414 15:28:09.432208 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:09.432687 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:09.432751 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:09.432676 1894321 retry.go:31] will retry after 2.340333413s: waiting for domain to come up
I0414 15:28:11.775772 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:11.776390 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:11.776420 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:11.776292 1894321 retry.go:31] will retry after 2.752470915s: waiting for domain to come up
I0414 15:28:14.532240 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:14.532751 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:14.532830 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:14.532760 1894321 retry.go:31] will retry after 3.234443762s: waiting for domain to come up
I0414 15:28:17.769421 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:17.770009 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find current IP address of domain old-k8s-version-529869 in network mk-old-k8s-version-529869
I0414 15:28:17.770053 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | I0414 15:28:17.770004 1894321 retry.go:31] will retry after 4.866321854s: waiting for domain to come up
I0414 15:28:22.639407 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:22.639848 1894281 main.go:141] libmachine: (old-k8s-version-529869) found domain IP: 192.168.50.117
I0414 15:28:22.639877 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has current primary IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:22.639884 1894281 main.go:141] libmachine: (old-k8s-version-529869) reserving static IP address...
I0414 15:28:22.640207 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-529869", mac: "52:54:00:20:2e:7f", ip: "192.168.50.117"} in network mk-old-k8s-version-529869
I0414 15:28:22.725158 1894281 main.go:141] libmachine: (old-k8s-version-529869) reserved static IP address 192.168.50.117 for domain old-k8s-version-529869
I0414 15:28:22.725195 1894281 main.go:141] libmachine: (old-k8s-version-529869) waiting for SSH...
I0414 15:28:22.725206 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Getting to WaitForSSH function...
I0414 15:28:22.728147 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:22.728534 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869
I0414 15:28:22.728570 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | unable to find defined IP address of network mk-old-k8s-version-529869 interface with MAC address 52:54:00:20:2e:7f
I0414 15:28:22.728685 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Using SSH client type: external
I0414 15:28:22.728722 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Using SSH private key: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa (-rw-------)
I0414 15:28:22.728757 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa -p 22] /usr/bin/ssh <nil>}
I0414 15:28:22.728774 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | About to run SSH command:
I0414 15:28:22.728784 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | exit 0
I0414 15:28:22.732782 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | SSH cmd err, output: exit status 255:
I0414 15:28:22.732831 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0414 15:28:22.732843 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | command : exit 0
I0414 15:28:22.732851 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | err : exit status 255
I0414 15:28:22.732869 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | output :
I0414 15:28:25.733188 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Getting to WaitForSSH function...
I0414 15:28:25.736202 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:25.736562 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:25.736590 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:25.736652 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Using SSH client type: external
I0414 15:28:25.736747 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | Using SSH private key: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa (-rw-------)
I0414 15:28:25.736790 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.117 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa -p 22] /usr/bin/ssh <nil>}
I0414 15:28:25.736805 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | About to run SSH command:
I0414 15:28:25.736817 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | exit 0
I0414 15:28:25.862656 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | SSH cmd err, output: <nil>:
I0414 15:28:25.863056 1894281 main.go:141] libmachine: (old-k8s-version-529869) KVM machine creation complete
I0414 15:28:25.863408 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetConfigRaw
I0414 15:28:25.864056 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:25.864316 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:25.864494 1894281 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0414 15:28:25.864510 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetState
I0414 15:28:25.865781 1894281 main.go:141] libmachine: Detecting operating system of created instance...
I0414 15:28:25.865794 1894281 main.go:141] libmachine: Waiting for SSH to be available...
I0414 15:28:25.865805 1894281 main.go:141] libmachine: Getting to WaitForSSH function...
I0414 15:28:25.865814 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:25.867966 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:25.868469 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:25.868499 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:25.868664 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:25.868854 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:25.869026 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:25.869189 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:25.869361 1894281 main.go:141] libmachine: Using SSH client type: native
I0414 15:28:25.869588 1894281 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.50.117 22 <nil> <nil>}
I0414 15:28:25.869601 1894281 main.go:141] libmachine: About to run SSH command:
exit 0
I0414 15:28:25.974023 1894281 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 15:28:25.974055 1894281 main.go:141] libmachine: Detecting the provisioner...
I0414 15:28:25.974066 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:25.978022 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:25.978480 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:25.978535 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:25.978714 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:25.978931 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:25.979134 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:25.979304 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:25.979484 1894281 main.go:141] libmachine: Using SSH client type: native
I0414 15:28:25.979686 1894281 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.50.117 22 <nil> <nil>}
I0414 15:28:25.979696 1894281 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0414 15:28:26.087321 1894281 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0414 15:28:26.087474 1894281 main.go:141] libmachine: found compatible host: buildroot
I0414 15:28:26.087491 1894281 main.go:141] libmachine: Provisioning with buildroot...
I0414 15:28:26.087503 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetMachineName
I0414 15:28:26.087787 1894281 buildroot.go:166] provisioning hostname "old-k8s-version-529869"
I0414 15:28:26.087814 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetMachineName
I0414 15:28:26.087998 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:26.090895 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.091282 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:26.091306 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.091487 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:26.091694 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:26.091851 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:26.091976 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:26.092132 1894281 main.go:141] libmachine: Using SSH client type: native
I0414 15:28:26.092350 1894281 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.50.117 22 <nil> <nil>}
I0414 15:28:26.092362 1894281 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-529869 && echo "old-k8s-version-529869" | sudo tee /etc/hostname
I0414 15:28:26.213378 1894281 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-529869
I0414 15:28:26.213409 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:26.216798 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.217259 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:26.217312 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.217515 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:26.217797 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:26.217998 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:26.218154 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:26.218356 1894281 main.go:141] libmachine: Using SSH client type: native
I0414 15:28:26.218666 1894281 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.50.117 22 <nil> <nil>}
I0414 15:28:26.218699 1894281 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-529869' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-529869/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-529869' | sudo tee -a /etc/hosts;
fi
fi
I0414 15:28:26.336628 1894281 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 15:28:26.336662 1894281 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20512-1845971/.minikube CaCertPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20512-1845971/.minikube}
I0414 15:28:26.336721 1894281 buildroot.go:174] setting up certificates
I0414 15:28:26.336739 1894281 provision.go:84] configureAuth start
I0414 15:28:26.336764 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetMachineName
I0414 15:28:26.337120 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetIP
I0414 15:28:26.340047 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.340471 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:26.340515 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.340651 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:26.343080 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.343419 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:26.343447 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:26.343573 1894281 provision.go:143] copyHostCerts
I0414 15:28:26.343647 1894281 exec_runner.go:144] found /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.pem, removing ...
I0414 15:28:26.343675 1894281 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.pem
I0414 15:28:26.343748 1894281 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.pem (1082 bytes)
I0414 15:28:26.343883 1894281 exec_runner.go:144] found /home/jenkins/minikube-integration/20512-1845971/.minikube/cert.pem, removing ...
I0414 15:28:26.343894 1894281 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20512-1845971/.minikube/cert.pem
I0414 15:28:26.343930 1894281 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20512-1845971/.minikube/cert.pem (1123 bytes)
I0414 15:28:26.344022 1894281 exec_runner.go:144] found /home/jenkins/minikube-integration/20512-1845971/.minikube/key.pem, removing ...
I0414 15:28:26.344032 1894281 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20512-1845971/.minikube/key.pem
I0414 15:28:26.344061 1894281 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20512-1845971/.minikube/key.pem (1679 bytes)
I0414 15:28:26.344144 1894281 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-529869 san=[127.0.0.1 192.168.50.117 localhost minikube old-k8s-version-529869]
I0414 15:28:27.039226 1894281 provision.go:177] copyRemoteCerts
I0414 15:28:27.039296 1894281 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0414 15:28:27.039323 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:27.041921 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.042195 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.042237 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.042409 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:27.042639 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.042828 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:27.043012 1894281 sshutil.go:53] new ssh client: &{IP:192.168.50.117 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa Username:docker}
I0414 15:28:27.129439 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0414 15:28:27.157940 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0414 15:28:27.185372 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0414 15:28:27.212107 1894281 provision.go:87] duration metric: took 875.339015ms to configureAuth
I0414 15:28:27.212139 1894281 buildroot.go:189] setting minikube options for container-runtime
I0414 15:28:27.212358 1894281 config.go:182] Loaded profile config "old-k8s-version-529869": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 15:28:27.212453 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:27.215624 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.215990 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.216023 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.216202 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:27.216411 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.216613 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.216795 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:27.217001 1894281 main.go:141] libmachine: Using SSH client type: native
I0414 15:28:27.217296 1894281 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.50.117 22 <nil> <nil>}
I0414 15:28:27.217329 1894281 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0414 15:28:27.454649 1894281 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0414 15:28:27.454680 1894281 main.go:141] libmachine: Checking connection to Docker...
I0414 15:28:27.454692 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetURL
I0414 15:28:27.456072 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | using libvirt version 6000000
I0414 15:28:27.458149 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.458482 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.458516 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.458693 1894281 main.go:141] libmachine: Docker is up and running!
I0414 15:28:27.458708 1894281 main.go:141] libmachine: Reticulating splines...
I0414 15:28:27.458715 1894281 client.go:171] duration metric: took 27.086920596s to LocalClient.Create
I0414 15:28:27.458740 1894281 start.go:167] duration metric: took 27.086999739s to libmachine.API.Create "old-k8s-version-529869"
I0414 15:28:27.458749 1894281 start.go:293] postStartSetup for "old-k8s-version-529869" (driver="kvm2")
I0414 15:28:27.458759 1894281 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0414 15:28:27.458778 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:27.459061 1894281 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0414 15:28:27.459096 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:27.460975 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.461271 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.461299 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.461434 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:27.461634 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.461815 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:27.461990 1894281 sshutil.go:53] new ssh client: &{IP:192.168.50.117 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa Username:docker}
I0414 15:28:27.545819 1894281 ssh_runner.go:195] Run: cat /etc/os-release
I0414 15:28:27.550741 1894281 info.go:137] Remote host: Buildroot 2023.02.9
I0414 15:28:27.550770 1894281 filesync.go:126] Scanning /home/jenkins/minikube-integration/20512-1845971/.minikube/addons for local assets ...
I0414 15:28:27.550853 1894281 filesync.go:126] Scanning /home/jenkins/minikube-integration/20512-1845971/.minikube/files for local assets ...
I0414 15:28:27.550938 1894281 filesync.go:149] local asset: /home/jenkins/minikube-integration/20512-1845971/.minikube/files/etc/ssl/certs/18532702.pem -> 18532702.pem in /etc/ssl/certs
I0414 15:28:27.551071 1894281 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0414 15:28:27.561516 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/files/etc/ssl/certs/18532702.pem --> /etc/ssl/certs/18532702.pem (1708 bytes)
I0414 15:28:27.588219 1894281 start.go:296] duration metric: took 129.454006ms for postStartSetup
I0414 15:28:27.588307 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetConfigRaw
I0414 15:28:27.588965 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetIP
I0414 15:28:27.591721 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.592157 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.592205 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.592435 1894281 profile.go:143] Saving config to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/config.json ...
I0414 15:28:27.592695 1894281 start.go:128] duration metric: took 27.244434388s to createHost
I0414 15:28:27.592739 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:27.594929 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.595307 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.595333 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.595524 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:27.595726 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.595935 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.596162 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:27.596338 1894281 main.go:141] libmachine: Using SSH client type: native
I0414 15:28:27.596569 1894281 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.50.117 22 <nil> <nil>}
I0414 15:28:27.596579 1894281 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0414 15:28:27.703451 1894281 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744644507.680014345
I0414 15:28:27.703486 1894281 fix.go:216] guest clock: 1744644507.680014345
I0414 15:28:27.703493 1894281 fix.go:229] Guest: 2025-04-14 15:28:27.680014345 +0000 UTC Remote: 2025-04-14 15:28:27.592710209 +0000 UTC m=+30.037434291 (delta=87.304136ms)
I0414 15:28:27.703515 1894281 fix.go:200] guest clock delta is within tolerance: 87.304136ms
I0414 15:28:27.703520 1894281 start.go:83] releasing machines lock for "old-k8s-version-529869", held for 27.355533829s
I0414 15:28:27.703550 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:27.703943 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetIP
I0414 15:28:27.707052 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.707398 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.707429 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.707591 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:27.708157 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:27.708349 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .DriverName
I0414 15:28:27.708487 1894281 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0414 15:28:27.708530 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:27.708593 1894281 ssh_runner.go:195] Run: cat /version.json
I0414 15:28:27.708622 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHHostname
I0414 15:28:27.711653 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.711858 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.712047 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.712078 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.712196 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:27.712317 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:27.712347 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:27.712404 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.712524 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHPort
I0414 15:28:27.712597 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:27.712706 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHKeyPath
I0414 15:28:27.712807 1894281 sshutil.go:53] new ssh client: &{IP:192.168.50.117 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa Username:docker}
I0414 15:28:27.712867 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetSSHUsername
I0414 15:28:27.712993 1894281 sshutil.go:53] new ssh client: &{IP:192.168.50.117 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20512-1845971/.minikube/machines/old-k8s-version-529869/id_rsa Username:docker}
I0414 15:28:27.792516 1894281 ssh_runner.go:195] Run: systemctl --version
I0414 15:28:27.820755 1894281 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0414 15:28:27.986338 1894281 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0414 15:28:27.992913 1894281 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0414 15:28:27.993002 1894281 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0414 15:28:28.010942 1894281 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0414 15:28:28.010974 1894281 start.go:495] detecting cgroup driver to use...
I0414 15:28:28.011050 1894281 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0414 15:28:28.029857 1894281 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0414 15:28:28.048770 1894281 docker.go:217] disabling cri-docker service (if available) ...
I0414 15:28:28.048858 1894281 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0414 15:28:28.064381 1894281 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0414 15:28:28.079955 1894281 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0414 15:28:28.205055 1894281 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0414 15:28:28.370985 1894281 docker.go:233] disabling docker service ...
I0414 15:28:28.371076 1894281 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0414 15:28:28.387122 1894281 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0414 15:28:28.403547 1894281 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0414 15:28:28.564342 1894281 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0414 15:28:28.709786 1894281 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0414 15:28:28.732631 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0414 15:28:28.754326 1894281 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0414 15:28:28.754426 1894281 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 15:28:28.766174 1894281 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0414 15:28:28.766320 1894281 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 15:28:28.778180 1894281 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0414 15:28:28.790832 1894281 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0414 15:28:28.804576 1894281 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0414 15:28:28.817754 1894281 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0414 15:28:28.829400 1894281 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0414 15:28:28.829476 1894281 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0414 15:28:28.846270 1894281 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0414 15:28:28.858449 1894281 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 15:28:28.995659 1894281 ssh_runner.go:195] Run: sudo systemctl restart crio
I0414 15:28:29.112492 1894281 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0414 15:28:29.112585 1894281 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0414 15:28:29.118562 1894281 start.go:563] Will wait 60s for crictl version
I0414 15:28:29.118662 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:29.123309 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0414 15:28:29.166550 1894281 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0414 15:28:29.166651 1894281 ssh_runner.go:195] Run: crio --version
I0414 15:28:29.203635 1894281 ssh_runner.go:195] Run: crio --version
I0414 15:28:29.237214 1894281 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0414 15:28:29.238637 1894281 main.go:141] libmachine: (old-k8s-version-529869) Calling .GetIP
I0414 15:28:29.241722 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:29.242155 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:2e:7f", ip: ""} in network mk-old-k8s-version-529869: {Iface:virbr2 ExpiryTime:2025-04-14 16:28:15 +0000 UTC Type:0 Mac:52:54:00:20:2e:7f Iaid: IPaddr:192.168.50.117 Prefix:24 Hostname:old-k8s-version-529869 Clientid:01:52:54:00:20:2e:7f}
I0414 15:28:29.242183 1894281 main.go:141] libmachine: (old-k8s-version-529869) DBG | domain old-k8s-version-529869 has defined IP address 192.168.50.117 and MAC address 52:54:00:20:2e:7f in network mk-old-k8s-version-529869
I0414 15:28:29.242477 1894281 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0414 15:28:29.247255 1894281 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 15:28:29.261658 1894281 kubeadm.go:883] updating cluster {Name:old-k8s-version-529869 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-529869 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.117 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountU
ID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0414 15:28:29.261824 1894281 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 15:28:29.261869 1894281 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 15:28:29.303620 1894281 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 15:28:29.303709 1894281 ssh_runner.go:195] Run: which lz4
I0414 15:28:29.308512 1894281 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0414 15:28:29.313802 1894281 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0414 15:28:29.313848 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0414 15:28:31.204777 1894281 crio.go:462] duration metric: took 1.896295137s to copy over tarball
I0414 15:28:31.204878 1894281 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0414 15:28:34.026092 1894281 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.821182231s)
I0414 15:28:34.026123 1894281 crio.go:469] duration metric: took 2.821303518s to extract the tarball
I0414 15:28:34.026134 1894281 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0414 15:28:34.070485 1894281 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 15:28:34.136081 1894281 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 15:28:34.136112 1894281 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0414 15:28:34.136229 1894281 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.136324 1894281 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.136232 1894281 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 15:28:34.136712 1894281 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.136245 1894281 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0414 15:28:34.136245 1894281 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0414 15:28:34.136263 1894281 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.136263 1894281 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.139489 1894281 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 15:28:34.139524 1894281 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.139538 1894281 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.139621 1894281 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0414 15:28:34.139705 1894281 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.139621 1894281 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0414 15:28:34.139874 1894281 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.139980 1894281 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.281522 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.283708 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.284697 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.288600 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.292351 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0414 15:28:34.292705 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.300498 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0414 15:28:34.465285 1894281 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0414 15:28:34.465355 1894281 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.465419 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.472406 1894281 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0414 15:28:34.472488 1894281 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.472547 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.492328 1894281 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0414 15:28:34.492382 1894281 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.492441 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.496654 1894281 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0414 15:28:34.496702 1894281 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.496715 1894281 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0414 15:28:34.496753 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.496768 1894281 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0414 15:28:34.496771 1894281 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0414 15:28:34.496812 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.496822 1894281 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.496894 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.506400 1894281 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0414 15:28:34.506449 1894281 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0414 15:28:34.506455 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.506478 1894281 ssh_runner.go:195] Run: which crictl
I0414 15:28:34.506524 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.506557 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.509507 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 15:28:34.509506 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.510285 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.643863 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.643923 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.643987 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.644031 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 15:28:34.648036 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 15:28:34.648111 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.648202 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.800014 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 15:28:34.800133 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 15:28:34.800161 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 15:28:34.800240 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 15:28:34.813315 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 15:28:34.825949 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 15:28:34.825979 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 15:28:34.917704 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0414 15:28:34.997520 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0414 15:28:34.997546 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0414 15:28:34.997642 1894281 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 15:28:34.997701 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0414 15:28:34.998124 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0414 15:28:35.034393 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0414 15:28:35.034542 1894281 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0414 15:28:35.097456 1894281 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0414 15:28:35.246086 1894281 cache_images.go:92] duration metric: took 1.109950315s to LoadCachedImages
W0414 15:28:35.246201 1894281 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20512-1845971/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0414 15:28:35.246220 1894281 kubeadm.go:934] updating node { 192.168.50.117 8443 v1.20.0 crio true true} ...
I0414 15:28:35.246345 1894281 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-529869 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.117
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-529869 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0414 15:28:35.246448 1894281 ssh_runner.go:195] Run: crio config
I0414 15:28:35.296639 1894281 cni.go:84] Creating CNI manager for ""
I0414 15:28:35.296668 1894281 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 15:28:35.296680 1894281 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0414 15:28:35.296702 1894281 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.117 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-529869 NodeName:old-k8s-version-529869 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.117"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.117 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0414 15:28:35.296879 1894281 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.117
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-529869"
kubeletExtraArgs:
node-ip: 192.168.50.117
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.117"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0414 15:28:35.296962 1894281 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0414 15:28:35.309161 1894281 binaries.go:44] Found k8s binaries, skipping transfer
I0414 15:28:35.309280 1894281 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0414 15:28:35.323267 1894281 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0414 15:28:35.345127 1894281 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0414 15:28:35.367459 1894281 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0414 15:28:35.390232 1894281 ssh_runner.go:195] Run: grep 192.168.50.117 control-plane.minikube.internal$ /etc/hosts
I0414 15:28:35.395539 1894281 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.117 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 15:28:35.414011 1894281 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 15:28:35.573098 1894281 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0414 15:28:35.598084 1894281 certs.go:68] Setting up /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869 for IP: 192.168.50.117
I0414 15:28:35.598118 1894281 certs.go:194] generating shared ca certs ...
I0414 15:28:35.598142 1894281 certs.go:226] acquiring lock for ca certs: {Name:mk01199c86d4c9dbb6d756d9ad313fb9f19edafc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.598340 1894281 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.key
I0414 15:28:35.598440 1894281 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/proxy-client-ca.key
I0414 15:28:35.598457 1894281 certs.go:256] generating profile certs ...
I0414 15:28:35.598540 1894281 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/client.key
I0414 15:28:35.598562 1894281 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/client.crt with IP's: []
I0414 15:28:35.663351 1894281 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/client.crt ...
I0414 15:28:35.663391 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/client.crt: {Name:mk0705c54c63714f5df412cdf2e934b1df412659 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.663634 1894281 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/client.key ...
I0414 15:28:35.663653 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/client.key: {Name:mkf853f43a281c0985dc7bdae46d879cc2692cef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.663794 1894281 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.key.35259b7c
I0414 15:28:35.663829 1894281 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.crt.35259b7c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.117]
I0414 15:28:35.874995 1894281 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.crt.35259b7c ...
I0414 15:28:35.875032 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.crt.35259b7c: {Name:mkb0dfbad072bfd4f3afb0d5e18ea44b0cc975c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.875234 1894281 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.key.35259b7c ...
I0414 15:28:35.875255 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.key.35259b7c: {Name:mk5cb3ffbf7b5224612f9926928f46909b5e6e08 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.875359 1894281 certs.go:381] copying /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.crt.35259b7c -> /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.crt
I0414 15:28:35.875488 1894281 certs.go:385] copying /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.key.35259b7c -> /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.key
I0414 15:28:35.875585 1894281 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.key
I0414 15:28:35.875609 1894281 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.crt with IP's: []
I0414 15:28:35.960839 1894281 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.crt ...
I0414 15:28:35.960890 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.crt: {Name:mkee5e0db8c4dd4b3c741430f766f2de811cbcd6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.961094 1894281 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.key ...
I0414 15:28:35.961114 1894281 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.key: {Name:mkb015db91e0179ae66322e333ab039fc7e8bf73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 15:28:35.961291 1894281 certs.go:484] found cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/1853270.pem (1338 bytes)
W0414 15:28:35.961329 1894281 certs.go:480] ignoring /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/1853270_empty.pem, impossibly tiny 0 bytes
I0414 15:28:35.961339 1894281 certs.go:484] found cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca-key.pem (1675 bytes)
I0414 15:28:35.961364 1894281 certs.go:484] found cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/ca.pem (1082 bytes)
I0414 15:28:35.961387 1894281 certs.go:484] found cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/cert.pem (1123 bytes)
I0414 15:28:35.961409 1894281 certs.go:484] found cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/key.pem (1679 bytes)
I0414 15:28:35.961446 1894281 certs.go:484] found cert: /home/jenkins/minikube-integration/20512-1845971/.minikube/files/etc/ssl/certs/18532702.pem (1708 bytes)
I0414 15:28:35.962016 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0414 15:28:35.993351 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0414 15:28:36.023693 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0414 15:28:36.059033 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0414 15:28:36.087065 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0414 15:28:36.123921 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0414 15:28:36.155239 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0414 15:28:36.185043 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/profiles/old-k8s-version-529869/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0414 15:28:36.212150 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/certs/1853270.pem --> /usr/share/ca-certificates/1853270.pem (1338 bytes)
I0414 15:28:36.241136 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/files/etc/ssl/certs/18532702.pem --> /usr/share/ca-certificates/18532702.pem (1708 bytes)
I0414 15:28:36.270505 1894281 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20512-1845971/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0414 15:28:36.299306 1894281 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0414 15:28:36.319201 1894281 ssh_runner.go:195] Run: openssl version
I0414 15:28:36.327068 1894281 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1853270.pem && ln -fs /usr/share/ca-certificates/1853270.pem /etc/ssl/certs/1853270.pem"
I0414 15:28:36.340735 1894281 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1853270.pem
I0414 15:28:36.346354 1894281 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 14:25 /usr/share/ca-certificates/1853270.pem
I0414 15:28:36.346456 1894281 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1853270.pem
I0414 15:28:36.353143 1894281 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1853270.pem /etc/ssl/certs/51391683.0"
I0414 15:28:36.366294 1894281 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/18532702.pem && ln -fs /usr/share/ca-certificates/18532702.pem /etc/ssl/certs/18532702.pem"
I0414 15:28:36.379632 1894281 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/18532702.pem
I0414 15:28:36.385041 1894281 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 14:25 /usr/share/ca-certificates/18532702.pem
I0414 15:28:36.385132 1894281 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/18532702.pem
I0414 15:28:36.392327 1894281 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/18532702.pem /etc/ssl/certs/3ec20f2e.0"
I0414 15:28:36.405498 1894281 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0414 15:28:36.419399 1894281 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0414 15:28:36.425197 1894281 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 14:17 /usr/share/ca-certificates/minikubeCA.pem
I0414 15:28:36.425287 1894281 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0414 15:28:36.431952 1894281 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0414 15:28:36.444997 1894281 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0414 15:28:36.450589 1894281 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0414 15:28:36.450672 1894281 kubeadm.go:392] StartCluster: {Name:old-k8s-version-529869 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-529869 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.117 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:
docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 15:28:36.450779 1894281 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0414 15:28:36.450858 1894281 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0414 15:28:36.509940 1894281 cri.go:89] found id: ""
I0414 15:28:36.510038 1894281 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0414 15:28:36.522002 1894281 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0414 15:28:36.539299 1894281 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 15:28:36.551027 1894281 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 15:28:36.551063 1894281 kubeadm.go:157] found existing configuration files:
I0414 15:28:36.551139 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 15:28:36.561734 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 15:28:36.561826 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 15:28:36.576917 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 15:28:36.592228 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 15:28:36.592311 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 15:28:36.604740 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 15:28:36.614810 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 15:28:36.614901 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 15:28:36.625654 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 15:28:36.636503 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 15:28:36.636582 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 15:28:36.647360 1894281 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 15:28:36.972129 1894281 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 15:30:34.157217 1894281 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 15:30:34.157439 1894281 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0414 15:30:34.159997 1894281 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 15:30:34.160063 1894281 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 15:30:34.160151 1894281 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 15:30:34.160290 1894281 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 15:30:34.160395 1894281 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 15:30:34.160487 1894281 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 15:30:34.163062 1894281 out.go:235] - Generating certificates and keys ...
I0414 15:30:34.163152 1894281 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 15:30:34.163229 1894281 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 15:30:34.163308 1894281 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0414 15:30:34.163383 1894281 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0414 15:30:34.163462 1894281 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0414 15:30:34.163556 1894281 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0414 15:30:34.163637 1894281 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0414 15:30:34.163773 1894281 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-529869] and IPs [192.168.50.117 127.0.0.1 ::1]
I0414 15:30:34.163858 1894281 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0414 15:30:34.163990 1894281 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-529869] and IPs [192.168.50.117 127.0.0.1 ::1]
I0414 15:30:34.164084 1894281 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0414 15:30:34.164169 1894281 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0414 15:30:34.164245 1894281 kubeadm.go:310] [certs] Generating "sa" key and public key
I0414 15:30:34.164364 1894281 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 15:30:34.164438 1894281 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 15:30:34.164483 1894281 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 15:30:34.164555 1894281 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 15:30:34.164619 1894281 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 15:30:34.164762 1894281 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 15:30:34.164895 1894281 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 15:30:34.164944 1894281 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 15:30:34.165031 1894281 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 15:30:34.166677 1894281 out.go:235] - Booting up control plane ...
I0414 15:30:34.166796 1894281 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 15:30:34.166895 1894281 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 15:30:34.166986 1894281 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 15:30:34.167075 1894281 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 15:30:34.167256 1894281 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 15:30:34.167308 1894281 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 15:30:34.167414 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:30:34.167611 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:30:34.167685 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:30:34.167904 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:30:34.167972 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:30:34.168117 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:30:34.168184 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:30:34.168363 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:30:34.168463 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:30:34.168645 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:30:34.168659 1894281 kubeadm.go:310]
I0414 15:30:34.168724 1894281 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 15:30:34.168780 1894281 kubeadm.go:310] timed out waiting for the condition
I0414 15:30:34.168797 1894281 kubeadm.go:310]
I0414 15:30:34.168843 1894281 kubeadm.go:310] This error is likely caused by:
I0414 15:30:34.168878 1894281 kubeadm.go:310] - The kubelet is not running
I0414 15:30:34.169012 1894281 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 15:30:34.169021 1894281 kubeadm.go:310]
I0414 15:30:34.169162 1894281 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 15:30:34.169205 1894281 kubeadm.go:310] - 'systemctl status kubelet'
I0414 15:30:34.169264 1894281 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 15:30:34.169274 1894281 kubeadm.go:310]
I0414 15:30:34.169443 1894281 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 15:30:34.169549 1894281 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 15:30:34.169561 1894281 kubeadm.go:310]
I0414 15:30:34.169817 1894281 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 15:30:34.169992 1894281 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 15:30:34.170112 1894281 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 15:30:34.170223 1894281 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 15:30:34.170288 1894281 kubeadm.go:310]
W0414 15:30:34.170426 1894281 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-529869] and IPs [192.168.50.117 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-529869] and IPs [192.168.50.117 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-529869] and IPs [192.168.50.117 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-529869] and IPs [192.168.50.117 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0414 15:30:34.170474 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0414 15:30:35.271657 1894281 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.101152607s)
I0414 15:30:35.271754 1894281 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0414 15:30:35.287441 1894281 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 15:30:35.300257 1894281 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 15:30:35.300285 1894281 kubeadm.go:157] found existing configuration files:
I0414 15:30:35.300333 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 15:30:35.312518 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 15:30:35.312592 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 15:30:35.325047 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 15:30:35.335363 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 15:30:35.335449 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 15:30:35.346557 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 15:30:35.357110 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 15:30:35.357179 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 15:30:35.368232 1894281 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 15:30:35.378984 1894281 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 15:30:35.379075 1894281 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 15:30:35.390662 1894281 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 15:30:35.479014 1894281 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 15:30:35.479101 1894281 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 15:30:35.640561 1894281 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 15:30:35.640728 1894281 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 15:30:35.640885 1894281 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 15:30:35.853776 1894281 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 15:30:35.855833 1894281 out.go:235] - Generating certificates and keys ...
I0414 15:30:35.855951 1894281 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 15:30:35.856056 1894281 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 15:30:35.856179 1894281 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0414 15:30:35.856300 1894281 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0414 15:30:35.856397 1894281 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0414 15:30:35.856475 1894281 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0414 15:30:35.856576 1894281 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0414 15:30:35.856671 1894281 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0414 15:30:35.856769 1894281 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0414 15:30:35.856879 1894281 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0414 15:30:35.856948 1894281 kubeadm.go:310] [certs] Using the existing "sa" key
I0414 15:30:35.857031 1894281 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 15:30:35.957994 1894281 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 15:30:36.245236 1894281 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 15:30:36.321552 1894281 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 15:30:36.441440 1894281 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 15:30:36.460818 1894281 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 15:30:36.463242 1894281 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 15:30:36.463313 1894281 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 15:30:36.605866 1894281 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 15:30:36.608002 1894281 out.go:235] - Booting up control plane ...
I0414 15:30:36.608143 1894281 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 15:30:36.613221 1894281 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 15:30:36.614270 1894281 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 15:30:36.615265 1894281 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 15:30:36.617522 1894281 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 15:31:16.621289 1894281 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 15:31:16.622186 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:31:16.622502 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:31:21.623539 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:31:21.623728 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:31:31.624589 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:31:31.624844 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:31:51.623379 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:31:51.623710 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:32:31.623937 1894281 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 15:32:31.624178 1894281 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 15:32:31.624204 1894281 kubeadm.go:310]
I0414 15:32:31.624284 1894281 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 15:32:31.624361 1894281 kubeadm.go:310] timed out waiting for the condition
I0414 15:32:31.624371 1894281 kubeadm.go:310]
I0414 15:32:31.624421 1894281 kubeadm.go:310] This error is likely caused by:
I0414 15:32:31.624472 1894281 kubeadm.go:310] - The kubelet is not running
I0414 15:32:31.624637 1894281 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 15:32:31.624652 1894281 kubeadm.go:310]
I0414 15:32:31.624775 1894281 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 15:32:31.624824 1894281 kubeadm.go:310] - 'systemctl status kubelet'
I0414 15:32:31.624871 1894281 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 15:32:31.624881 1894281 kubeadm.go:310]
I0414 15:32:31.624994 1894281 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 15:32:31.625104 1894281 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 15:32:31.625116 1894281 kubeadm.go:310]
I0414 15:32:31.625306 1894281 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 15:32:31.625443 1894281 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 15:32:31.625552 1894281 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 15:32:31.625667 1894281 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 15:32:31.625681 1894281 kubeadm.go:310]
I0414 15:32:31.626398 1894281 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 15:32:31.626520 1894281 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 15:32:31.626616 1894281 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0414 15:32:31.626691 1894281 kubeadm.go:394] duration metric: took 3m55.176028745s to StartCluster
I0414 15:32:31.626732 1894281 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0414 15:32:31.626872 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0414 15:32:31.676142 1894281 cri.go:89] found id: ""
I0414 15:32:31.676174 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.676182 1894281 logs.go:284] No container was found matching "kube-apiserver"
I0414 15:32:31.676190 1894281 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0414 15:32:31.676263 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0414 15:32:31.721931 1894281 cri.go:89] found id: ""
I0414 15:32:31.721972 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.721984 1894281 logs.go:284] No container was found matching "etcd"
I0414 15:32:31.721993 1894281 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0414 15:32:31.722074 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0414 15:32:31.772448 1894281 cri.go:89] found id: ""
I0414 15:32:31.772482 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.772493 1894281 logs.go:284] No container was found matching "coredns"
I0414 15:32:31.772502 1894281 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0414 15:32:31.772578 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0414 15:32:31.814106 1894281 cri.go:89] found id: ""
I0414 15:32:31.814142 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.814152 1894281 logs.go:284] No container was found matching "kube-scheduler"
I0414 15:32:31.814161 1894281 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0414 15:32:31.814232 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0414 15:32:31.861119 1894281 cri.go:89] found id: ""
I0414 15:32:31.861146 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.861154 1894281 logs.go:284] No container was found matching "kube-proxy"
I0414 15:32:31.861167 1894281 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0414 15:32:31.861222 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0414 15:32:31.906262 1894281 cri.go:89] found id: ""
I0414 15:32:31.906298 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.906309 1894281 logs.go:284] No container was found matching "kube-controller-manager"
I0414 15:32:31.906319 1894281 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0414 15:32:31.906410 1894281 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0414 15:32:31.942875 1894281 cri.go:89] found id: ""
I0414 15:32:31.942908 1894281 logs.go:282] 0 containers: []
W0414 15:32:31.942919 1894281 logs.go:284] No container was found matching "kindnet"
I0414 15:32:31.942933 1894281 logs.go:123] Gathering logs for kubelet ...
I0414 15:32:31.942978 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0414 15:32:31.997809 1894281 logs.go:123] Gathering logs for dmesg ...
I0414 15:32:31.997856 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0414 15:32:32.013500 1894281 logs.go:123] Gathering logs for describe nodes ...
I0414 15:32:32.013535 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0414 15:32:32.151306 1894281 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0414 15:32:32.151339 1894281 logs.go:123] Gathering logs for CRI-O ...
I0414 15:32:32.151360 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0414 15:32:32.269548 1894281 logs.go:123] Gathering logs for container status ...
I0414 15:32:32.269597 1894281 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0414 15:32:32.317958 1894281 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 15:32:32.318034 1894281 out.go:270] *
*
W0414 15:32:32.318113 1894281 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 15:32:32.318138 1894281 out.go:270] *
*
W0414 15:32:32.319143 1894281 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0414 15:32:32.322986 1894281 out.go:201]
W0414 15:32:32.324360 1894281 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 15:32:32.324419 1894281 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0414 15:32:32.324446 1894281 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0414 15:32:32.325963 1894281 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-529869 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-529869 -n old-k8s-version-529869
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-529869 -n old-k8s-version-529869: exit status 6 (250.56397ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0414 15:32:32.626992 1897345 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-529869" does not appear in /home/jenkins/minikube-integration/20512-1845971/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-529869" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (275.10s)