=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-079123 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-079123 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.443394239s)
-- stdout --
* [old-k8s-version-079123] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19478
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19478-10654/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19478-10654/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-079123" primary control-plane node in "old-k8s-version-079123" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0819 18:02:02.810247 59547 out.go:345] Setting OutFile to fd 1 ...
I0819 18:02:02.810366 59547 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 18:02:02.810376 59547 out.go:358] Setting ErrFile to fd 2...
I0819 18:02:02.810382 59547 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 18:02:02.810697 59547 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19478-10654/.minikube/bin
I0819 18:02:02.811347 59547 out.go:352] Setting JSON to false
I0819 18:02:02.812502 59547 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6268,"bootTime":1724084255,"procs":233,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0819 18:02:02.812585 59547 start.go:139] virtualization: kvm guest
I0819 18:02:02.814789 59547 out.go:177] * [old-k8s-version-079123] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0819 18:02:02.816120 59547 out.go:177] - MINIKUBE_LOCATION=19478
I0819 18:02:02.816181 59547 notify.go:220] Checking for updates...
I0819 18:02:02.818843 59547 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0819 18:02:02.820246 59547 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19478-10654/kubeconfig
I0819 18:02:02.821654 59547 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19478-10654/.minikube
I0819 18:02:02.822956 59547 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0819 18:02:02.824159 59547 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0819 18:02:02.825932 59547 config.go:182] Loaded profile config "cert-expiration-975771": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 18:02:02.826072 59547 config.go:182] Loaded profile config "cert-options-948260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 18:02:02.826187 59547 config.go:182] Loaded profile config "kubernetes-upgrade-415209": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 18:02:02.826295 59547 driver.go:392] Setting default libvirt URI to qemu:///system
I0819 18:02:02.865548 59547 out.go:177] * Using the kvm2 driver based on user configuration
I0819 18:02:02.866879 59547 start.go:297] selected driver: kvm2
I0819 18:02:02.866899 59547 start.go:901] validating driver "kvm2" against <nil>
I0819 18:02:02.866911 59547 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0819 18:02:02.867596 59547 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 18:02:02.867671 59547 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19478-10654/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0819 18:02:02.884258 59547 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0819 18:02:02.884309 59547 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0819 18:02:02.884518 59547 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 18:02:02.884553 59547 cni.go:84] Creating CNI manager for ""
I0819 18:02:02.884560 59547 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0819 18:02:02.884567 59547 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0819 18:02:02.884615 59547 start.go:340] cluster config:
{Name:old-k8s-version-079123 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-079123 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 18:02:02.884722 59547 iso.go:125] acquiring lock: {Name:mkbdaeb8bfbcf2c6f3294821d44b96d88299985a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 18:02:02.886644 59547 out.go:177] * Starting "old-k8s-version-079123" primary control-plane node in "old-k8s-version-079123" cluster
I0819 18:02:02.887754 59547 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0819 18:02:02.887783 59547 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0819 18:02:02.887792 59547 cache.go:56] Caching tarball of preloaded images
I0819 18:02:02.887872 59547 preload.go:172] Found /home/jenkins/minikube-integration/19478-10654/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0819 18:02:02.887881 59547 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0819 18:02:02.887954 59547 profile.go:143] Saving config to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/config.json ...
I0819 18:02:02.887971 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/config.json: {Name:mkb4d02fe4f6ea7cf927864a20e87bdfa352ee49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:02.888088 59547 start.go:360] acquireMachinesLock for old-k8s-version-079123: {Name:mkdbb17473bc80293d28b9c40ee62663f0a485a1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0819 18:02:08.073492 59547 start.go:364] duration metric: took 5.185373242s to acquireMachinesLock for "old-k8s-version-079123"
I0819 18:02:08.073541 59547 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-079123 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-079123 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0819 18:02:08.073696 59547 start.go:125] createHost starting for "" (driver="kvm2")
I0819 18:02:08.075759 59547 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0819 18:02:08.075948 59547 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0819 18:02:08.076001 59547 main.go:141] libmachine: Launching plugin server for driver kvm2
I0819 18:02:08.097175 59547 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33275
I0819 18:02:08.097641 59547 main.go:141] libmachine: () Calling .GetVersion
I0819 18:02:08.098354 59547 main.go:141] libmachine: Using API Version 1
I0819 18:02:08.098378 59547 main.go:141] libmachine: () Calling .SetConfigRaw
I0819 18:02:08.098832 59547 main.go:141] libmachine: () Calling .GetMachineName
I0819 18:02:08.099039 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetMachineName
I0819 18:02:08.099206 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:08.099391 59547 start.go:159] libmachine.API.Create for "old-k8s-version-079123" (driver="kvm2")
I0819 18:02:08.099426 59547 client.go:168] LocalClient.Create starting
I0819 18:02:08.099471 59547 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca.pem
I0819 18:02:08.099515 59547 main.go:141] libmachine: Decoding PEM data...
I0819 18:02:08.099538 59547 main.go:141] libmachine: Parsing certificate...
I0819 18:02:08.099617 59547 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19478-10654/.minikube/certs/cert.pem
I0819 18:02:08.099646 59547 main.go:141] libmachine: Decoding PEM data...
I0819 18:02:08.099676 59547 main.go:141] libmachine: Parsing certificate...
I0819 18:02:08.099707 59547 main.go:141] libmachine: Running pre-create checks...
I0819 18:02:08.099727 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .PreCreateCheck
I0819 18:02:08.100088 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetConfigRaw
I0819 18:02:08.100537 59547 main.go:141] libmachine: Creating machine...
I0819 18:02:08.100557 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .Create
I0819 18:02:08.100693 59547 main.go:141] libmachine: (old-k8s-version-079123) Creating KVM machine...
I0819 18:02:08.102177 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found existing default KVM network
I0819 18:02:08.103678 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:08.103503 59854 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002155a0}
I0819 18:02:08.103709 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | created network xml:
I0819 18:02:08.103722 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | <network>
I0819 18:02:08.103751 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | <name>mk-old-k8s-version-079123</name>
I0819 18:02:08.103772 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | <dns enable='no'/>
I0819 18:02:08.103783 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG |
I0819 18:02:08.103793 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0819 18:02:08.103804 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | <dhcp>
I0819 18:02:08.103817 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0819 18:02:08.103828 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | </dhcp>
I0819 18:02:08.103853 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | </ip>
I0819 18:02:08.103863 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG |
I0819 18:02:08.103872 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | </network>
I0819 18:02:08.103885 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG |
I0819 18:02:08.109811 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | trying to create private KVM network mk-old-k8s-version-079123 192.168.39.0/24...
I0819 18:02:08.180917 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | private KVM network mk-old-k8s-version-079123 192.168.39.0/24 created
I0819 18:02:08.180954 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting up store path in /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123 ...
I0819 18:02:08.180968 59547 main.go:141] libmachine: (old-k8s-version-079123) Building disk image from file:///home/jenkins/minikube-integration/19478-10654/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0819 18:02:08.181029 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:08.180925 59854 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19478-10654/.minikube
I0819 18:02:08.181095 59547 main.go:141] libmachine: (old-k8s-version-079123) Downloading /home/jenkins/minikube-integration/19478-10654/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19478-10654/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0819 18:02:08.435690 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:08.435567 59854 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa...
I0819 18:02:08.849836 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:08.849736 59854 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/old-k8s-version-079123.rawdisk...
I0819 18:02:08.849876 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Writing magic tar header
I0819 18:02:08.849889 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Writing SSH key tar header
I0819 18:02:08.849898 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:08.849852 59854 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123 ...
I0819 18:02:08.849988 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123
I0819 18:02:08.850011 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting executable bit set on /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123 (perms=drwx------)
I0819 18:02:08.850032 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19478-10654/.minikube/machines
I0819 18:02:08.850048 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting executable bit set on /home/jenkins/minikube-integration/19478-10654/.minikube/machines (perms=drwxr-xr-x)
I0819 18:02:08.850068 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting executable bit set on /home/jenkins/minikube-integration/19478-10654/.minikube (perms=drwxr-xr-x)
I0819 18:02:08.850082 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting executable bit set on /home/jenkins/minikube-integration/19478-10654 (perms=drwxrwxr-x)
I0819 18:02:08.850092 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19478-10654/.minikube
I0819 18:02:08.850101 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19478-10654
I0819 18:02:08.850110 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0819 18:02:08.850118 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0819 18:02:08.850130 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home/jenkins
I0819 18:02:08.850147 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Checking permissions on dir: /home
I0819 18:02:08.850161 59547 main.go:141] libmachine: (old-k8s-version-079123) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0819 18:02:08.850180 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Skipping /home - not owner
I0819 18:02:08.850195 59547 main.go:141] libmachine: (old-k8s-version-079123) Creating domain...
I0819 18:02:08.851378 59547 main.go:141] libmachine: (old-k8s-version-079123) define libvirt domain using xml:
I0819 18:02:08.851410 59547 main.go:141] libmachine: (old-k8s-version-079123) <domain type='kvm'>
I0819 18:02:08.851427 59547 main.go:141] libmachine: (old-k8s-version-079123) <name>old-k8s-version-079123</name>
I0819 18:02:08.851438 59547 main.go:141] libmachine: (old-k8s-version-079123) <memory unit='MiB'>2200</memory>
I0819 18:02:08.851448 59547 main.go:141] libmachine: (old-k8s-version-079123) <vcpu>2</vcpu>
I0819 18:02:08.851459 59547 main.go:141] libmachine: (old-k8s-version-079123) <features>
I0819 18:02:08.851471 59547 main.go:141] libmachine: (old-k8s-version-079123) <acpi/>
I0819 18:02:08.851479 59547 main.go:141] libmachine: (old-k8s-version-079123) <apic/>
I0819 18:02:08.851489 59547 main.go:141] libmachine: (old-k8s-version-079123) <pae/>
I0819 18:02:08.851508 59547 main.go:141] libmachine: (old-k8s-version-079123)
I0819 18:02:08.851521 59547 main.go:141] libmachine: (old-k8s-version-079123) </features>
I0819 18:02:08.851545 59547 main.go:141] libmachine: (old-k8s-version-079123) <cpu mode='host-passthrough'>
I0819 18:02:08.851552 59547 main.go:141] libmachine: (old-k8s-version-079123)
I0819 18:02:08.851564 59547 main.go:141] libmachine: (old-k8s-version-079123) </cpu>
I0819 18:02:08.851571 59547 main.go:141] libmachine: (old-k8s-version-079123) <os>
I0819 18:02:08.851579 59547 main.go:141] libmachine: (old-k8s-version-079123) <type>hvm</type>
I0819 18:02:08.851595 59547 main.go:141] libmachine: (old-k8s-version-079123) <boot dev='cdrom'/>
I0819 18:02:08.851607 59547 main.go:141] libmachine: (old-k8s-version-079123) <boot dev='hd'/>
I0819 18:02:08.851618 59547 main.go:141] libmachine: (old-k8s-version-079123) <bootmenu enable='no'/>
I0819 18:02:08.851628 59547 main.go:141] libmachine: (old-k8s-version-079123) </os>
I0819 18:02:08.851635 59547 main.go:141] libmachine: (old-k8s-version-079123) <devices>
I0819 18:02:08.851647 59547 main.go:141] libmachine: (old-k8s-version-079123) <disk type='file' device='cdrom'>
I0819 18:02:08.851659 59547 main.go:141] libmachine: (old-k8s-version-079123) <source file='/home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/boot2docker.iso'/>
I0819 18:02:08.851690 59547 main.go:141] libmachine: (old-k8s-version-079123) <target dev='hdc' bus='scsi'/>
I0819 18:02:08.851703 59547 main.go:141] libmachine: (old-k8s-version-079123) <readonly/>
I0819 18:02:08.851713 59547 main.go:141] libmachine: (old-k8s-version-079123) </disk>
I0819 18:02:08.851724 59547 main.go:141] libmachine: (old-k8s-version-079123) <disk type='file' device='disk'>
I0819 18:02:08.851736 59547 main.go:141] libmachine: (old-k8s-version-079123) <driver name='qemu' type='raw' cache='default' io='threads' />
I0819 18:02:08.851754 59547 main.go:141] libmachine: (old-k8s-version-079123) <source file='/home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/old-k8s-version-079123.rawdisk'/>
I0819 18:02:08.851768 59547 main.go:141] libmachine: (old-k8s-version-079123) <target dev='hda' bus='virtio'/>
I0819 18:02:08.851780 59547 main.go:141] libmachine: (old-k8s-version-079123) </disk>
I0819 18:02:08.851801 59547 main.go:141] libmachine: (old-k8s-version-079123) <interface type='network'>
I0819 18:02:08.851815 59547 main.go:141] libmachine: (old-k8s-version-079123) <source network='mk-old-k8s-version-079123'/>
I0819 18:02:08.851825 59547 main.go:141] libmachine: (old-k8s-version-079123) <model type='virtio'/>
I0819 18:02:08.851848 59547 main.go:141] libmachine: (old-k8s-version-079123) </interface>
I0819 18:02:08.851868 59547 main.go:141] libmachine: (old-k8s-version-079123) <interface type='network'>
I0819 18:02:08.851888 59547 main.go:141] libmachine: (old-k8s-version-079123) <source network='default'/>
I0819 18:02:08.851896 59547 main.go:141] libmachine: (old-k8s-version-079123) <model type='virtio'/>
I0819 18:02:08.851902 59547 main.go:141] libmachine: (old-k8s-version-079123) </interface>
I0819 18:02:08.851909 59547 main.go:141] libmachine: (old-k8s-version-079123) <serial type='pty'>
I0819 18:02:08.851915 59547 main.go:141] libmachine: (old-k8s-version-079123) <target port='0'/>
I0819 18:02:08.851922 59547 main.go:141] libmachine: (old-k8s-version-079123) </serial>
I0819 18:02:08.851927 59547 main.go:141] libmachine: (old-k8s-version-079123) <console type='pty'>
I0819 18:02:08.851937 59547 main.go:141] libmachine: (old-k8s-version-079123) <target type='serial' port='0'/>
I0819 18:02:08.851946 59547 main.go:141] libmachine: (old-k8s-version-079123) </console>
I0819 18:02:08.851956 59547 main.go:141] libmachine: (old-k8s-version-079123) <rng model='virtio'>
I0819 18:02:08.851985 59547 main.go:141] libmachine: (old-k8s-version-079123) <backend model='random'>/dev/random</backend>
I0819 18:02:08.852009 59547 main.go:141] libmachine: (old-k8s-version-079123) </rng>
I0819 18:02:08.852020 59547 main.go:141] libmachine: (old-k8s-version-079123)
I0819 18:02:08.852030 59547 main.go:141] libmachine: (old-k8s-version-079123)
I0819 18:02:08.852039 59547 main.go:141] libmachine: (old-k8s-version-079123) </devices>
I0819 18:02:08.852050 59547 main.go:141] libmachine: (old-k8s-version-079123) </domain>
I0819 18:02:08.852062 59547 main.go:141] libmachine: (old-k8s-version-079123)
I0819 18:02:08.856270 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:ed:4f:b9 in network default
I0819 18:02:08.856879 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:08.856901 59547 main.go:141] libmachine: (old-k8s-version-079123) Ensuring networks are active...
I0819 18:02:08.857715 59547 main.go:141] libmachine: (old-k8s-version-079123) Ensuring network default is active
I0819 18:02:08.858119 59547 main.go:141] libmachine: (old-k8s-version-079123) Ensuring network mk-old-k8s-version-079123 is active
I0819 18:02:08.858713 59547 main.go:141] libmachine: (old-k8s-version-079123) Getting domain xml...
I0819 18:02:08.859474 59547 main.go:141] libmachine: (old-k8s-version-079123) Creating domain...
I0819 18:02:10.539557 59547 main.go:141] libmachine: (old-k8s-version-079123) Waiting to get IP...
I0819 18:02:10.541001 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:10.541539 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:10.541570 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:10.541462 59854 retry.go:31] will retry after 276.165203ms: waiting for machine to come up
I0819 18:02:10.819998 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:10.820766 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:10.820790 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:10.820704 59854 retry.go:31] will retry after 363.197265ms: waiting for machine to come up
I0819 18:02:11.185194 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:11.185696 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:11.185772 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:11.185654 59854 retry.go:31] will retry after 353.313816ms: waiting for machine to come up
I0819 18:02:11.540297 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:11.540856 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:11.540881 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:11.540816 59854 retry.go:31] will retry after 595.426104ms: waiting for machine to come up
I0819 18:02:12.137531 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:12.138016 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:12.138039 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:12.137966 59854 retry.go:31] will retry after 493.024165ms: waiting for machine to come up
I0819 18:02:12.632774 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:12.633234 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:12.633272 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:12.633149 59854 retry.go:31] will retry after 842.94456ms: waiting for machine to come up
I0819 18:02:13.477879 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:13.478403 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:13.478440 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:13.478348 59854 retry.go:31] will retry after 784.068549ms: waiting for machine to come up
I0819 18:02:14.264337 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:14.264881 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:14.264910 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:14.264850 59854 retry.go:31] will retry after 1.46689666s: waiting for machine to come up
I0819 18:02:15.733617 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:15.734086 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:15.734108 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:15.734039 59854 retry.go:31] will retry after 1.576604882s: waiting for machine to come up
I0819 18:02:17.312013 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:17.312477 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:17.312507 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:17.312425 59854 retry.go:31] will retry after 2.191806304s: waiting for machine to come up
I0819 18:02:19.505983 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:19.506446 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:19.506477 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:19.506404 59854 retry.go:31] will retry after 1.810754595s: waiting for machine to come up
I0819 18:02:21.319440 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:21.319978 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:21.320004 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:21.319931 59854 retry.go:31] will retry after 3.626766194s: waiting for machine to come up
I0819 18:02:24.948985 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:24.949442 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find current IP address of domain old-k8s-version-079123 in network mk-old-k8s-version-079123
I0819 18:02:24.949470 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | I0819 18:02:24.949375 59854 retry.go:31] will retry after 4.4504971s: waiting for machine to come up
I0819 18:02:29.401323 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.402243 59547 main.go:141] libmachine: (old-k8s-version-079123) Found IP for machine: 192.168.39.246
I0819 18:02:29.402271 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has current primary IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.402279 59547 main.go:141] libmachine: (old-k8s-version-079123) Reserving static IP address...
I0819 18:02:29.402771 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-079123", mac: "52:54:00:97:ce:99", ip: "192.168.39.246"} in network mk-old-k8s-version-079123
I0819 18:02:29.477541 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Getting to WaitForSSH function...
I0819 18:02:29.477582 59547 main.go:141] libmachine: (old-k8s-version-079123) Reserved static IP address: 192.168.39.246
I0819 18:02:29.477600 59547 main.go:141] libmachine: (old-k8s-version-079123) Waiting for SSH to be available...
I0819 18:02:29.480250 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.480683 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:minikube Clientid:01:52:54:00:97:ce:99}
I0819 18:02:29.480714 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.480903 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Using SSH client type: external
I0819 18:02:29.480939 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Using SSH private key: /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa (-rw-------)
I0819 18:02:29.480976 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.246 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa -p 22] /usr/bin/ssh <nil>}
I0819 18:02:29.480996 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | About to run SSH command:
I0819 18:02:29.481012 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | exit 0
I0819 18:02:29.604941 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | SSH cmd err, output: <nil>:
I0819 18:02:29.605166 59547 main.go:141] libmachine: (old-k8s-version-079123) KVM machine creation complete!
I0819 18:02:29.605579 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetConfigRaw
I0819 18:02:29.606124 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:29.606323 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:29.606474 59547 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0819 18:02:29.606492 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetState
I0819 18:02:29.607680 59547 main.go:141] libmachine: Detecting operating system of created instance...
I0819 18:02:29.607695 59547 main.go:141] libmachine: Waiting for SSH to be available...
I0819 18:02:29.607702 59547 main.go:141] libmachine: Getting to WaitForSSH function...
I0819 18:02:29.607719 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:29.609920 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.610291 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:29.610315 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.610491 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:29.610656 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.610823 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.610948 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:29.611081 59547 main.go:141] libmachine: Using SSH client type: native
I0819 18:02:29.611272 59547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.246 22 <nil> <nil>}
I0819 18:02:29.611285 59547 main.go:141] libmachine: About to run SSH command:
exit 0
I0819 18:02:29.711900 59547 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 18:02:29.711937 59547 main.go:141] libmachine: Detecting the provisioner...
I0819 18:02:29.711954 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:29.715178 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.715606 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:29.715636 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.715989 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:29.716226 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.716370 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.716528 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:29.716687 59547 main.go:141] libmachine: Using SSH client type: native
I0819 18:02:29.716875 59547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.246 22 <nil> <nil>}
I0819 18:02:29.716885 59547 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0819 18:02:29.821193 59547 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0819 18:02:29.821282 59547 main.go:141] libmachine: found compatible host: buildroot
I0819 18:02:29.821298 59547 main.go:141] libmachine: Provisioning with buildroot...
I0819 18:02:29.821309 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetMachineName
I0819 18:02:29.821571 59547 buildroot.go:166] provisioning hostname "old-k8s-version-079123"
I0819 18:02:29.821596 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetMachineName
I0819 18:02:29.821770 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:29.824425 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.824816 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:29.824848 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.824962 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:29.825172 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.825318 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.825457 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:29.825577 59547 main.go:141] libmachine: Using SSH client type: native
I0819 18:02:29.825747 59547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.246 22 <nil> <nil>}
I0819 18:02:29.825759 59547 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-079123 && echo "old-k8s-version-079123" | sudo tee /etc/hostname
I0819 18:02:29.942251 59547 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-079123
I0819 18:02:29.942291 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:29.945086 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.945473 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:29.945498 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:29.945739 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:29.945966 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.946135 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:29.946307 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:29.946458 59547 main.go:141] libmachine: Using SSH client type: native
I0819 18:02:29.946647 59547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.246 22 <nil> <nil>}
I0819 18:02:29.946669 59547 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-079123' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-079123/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-079123' | sudo tee -a /etc/hosts;
fi
fi
I0819 18:02:30.057264 59547 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 18:02:30.057292 59547 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19478-10654/.minikube CaCertPath:/home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19478-10654/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19478-10654/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19478-10654/.minikube}
I0819 18:02:30.057309 59547 buildroot.go:174] setting up certificates
I0819 18:02:30.057318 59547 provision.go:84] configureAuth start
I0819 18:02:30.057327 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetMachineName
I0819 18:02:30.057620 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetIP
I0819 18:02:30.060228 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.060707 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.060734 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.060886 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.063708 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.064067 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.064113 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.064264 59547 provision.go:143] copyHostCerts
I0819 18:02:30.064313 59547 exec_runner.go:144] found /home/jenkins/minikube-integration/19478-10654/.minikube/key.pem, removing ...
I0819 18:02:30.064331 59547 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19478-10654/.minikube/key.pem
I0819 18:02:30.064397 59547 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19478-10654/.minikube/key.pem (1679 bytes)
I0819 18:02:30.064525 59547 exec_runner.go:144] found /home/jenkins/minikube-integration/19478-10654/.minikube/ca.pem, removing ...
I0819 18:02:30.064537 59547 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19478-10654/.minikube/ca.pem
I0819 18:02:30.064569 59547 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19478-10654/.minikube/ca.pem (1078 bytes)
I0819 18:02:30.064671 59547 exec_runner.go:144] found /home/jenkins/minikube-integration/19478-10654/.minikube/cert.pem, removing ...
I0819 18:02:30.064680 59547 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19478-10654/.minikube/cert.pem
I0819 18:02:30.064700 59547 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19478-10654/.minikube/cert.pem (1123 bytes)
I0819 18:02:30.064824 59547 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19478-10654/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-079123 san=[127.0.0.1 192.168.39.246 localhost minikube old-k8s-version-079123]
I0819 18:02:30.157307 59547 provision.go:177] copyRemoteCerts
I0819 18:02:30.157365 59547 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0819 18:02:30.157388 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.159917 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.160277 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.160303 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.160478 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:30.160667 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.160854 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:30.160986 59547 sshutil.go:53] new ssh client: &{IP:192.168.39.246 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa Username:docker}
I0819 18:02:30.246549 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0819 18:02:30.268937 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0819 18:02:30.290603 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0819 18:02:30.311956 59547 provision.go:87] duration metric: took 254.614314ms to configureAuth
I0819 18:02:30.311978 59547 buildroot.go:189] setting minikube options for container-runtime
I0819 18:02:30.312133 59547 config.go:182] Loaded profile config "old-k8s-version-079123": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0819 18:02:30.312225 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.315022 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.315428 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.315458 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.315655 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:30.315833 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.315998 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.316123 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:30.316288 59547 main.go:141] libmachine: Using SSH client type: native
I0819 18:02:30.316499 59547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.246 22 <nil> <nil>}
I0819 18:02:30.316515 59547 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0819 18:02:30.565494 59547 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0819 18:02:30.565545 59547 main.go:141] libmachine: Checking connection to Docker...
I0819 18:02:30.565558 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetURL
I0819 18:02:30.566992 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | Using libvirt version 6000000
I0819 18:02:30.569512 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.569792 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.569819 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.570050 59547 main.go:141] libmachine: Docker is up and running!
I0819 18:02:30.570068 59547 main.go:141] libmachine: Reticulating splines...
I0819 18:02:30.570075 59547 client.go:171] duration metric: took 22.470639191s to LocalClient.Create
I0819 18:02:30.570100 59547 start.go:167] duration metric: took 22.470711059s to libmachine.API.Create "old-k8s-version-079123"
I0819 18:02:30.570111 59547 start.go:293] postStartSetup for "old-k8s-version-079123" (driver="kvm2")
I0819 18:02:30.570124 59547 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0819 18:02:30.570148 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:30.570430 59547 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0819 18:02:30.570459 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.572925 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.573299 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.573348 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.573540 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:30.573715 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.573931 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:30.574085 59547 sshutil.go:53] new ssh client: &{IP:192.168.39.246 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa Username:docker}
I0819 18:02:30.661717 59547 ssh_runner.go:195] Run: cat /etc/os-release
I0819 18:02:30.665781 59547 info.go:137] Remote host: Buildroot 2023.02.9
I0819 18:02:30.665804 59547 filesync.go:126] Scanning /home/jenkins/minikube-integration/19478-10654/.minikube/addons for local assets ...
I0819 18:02:30.665861 59547 filesync.go:126] Scanning /home/jenkins/minikube-integration/19478-10654/.minikube/files for local assets ...
I0819 18:02:30.665969 59547 filesync.go:149] local asset: /home/jenkins/minikube-integration/19478-10654/.minikube/files/etc/ssl/certs/178372.pem -> 178372.pem in /etc/ssl/certs
I0819 18:02:30.666092 59547 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0819 18:02:30.676297 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/files/etc/ssl/certs/178372.pem --> /etc/ssl/certs/178372.pem (1708 bytes)
I0819 18:02:30.698555 59547 start.go:296] duration metric: took 128.433431ms for postStartSetup
I0819 18:02:30.698600 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetConfigRaw
I0819 18:02:30.699272 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetIP
I0819 18:02:30.701641 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.702024 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.702049 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.702316 59547 profile.go:143] Saving config to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/config.json ...
I0819 18:02:30.702507 59547 start.go:128] duration metric: took 22.62880065s to createHost
I0819 18:02:30.702529 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.704900 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.705238 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.705260 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.705379 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:30.705562 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.705707 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.705826 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:30.706009 59547 main.go:141] libmachine: Using SSH client type: native
I0819 18:02:30.706211 59547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.246 22 <nil> <nil>}
I0819 18:02:30.706226 59547 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0819 18:02:30.808985 59547 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724090550.780171978
I0819 18:02:30.809005 59547 fix.go:216] guest clock: 1724090550.780171978
I0819 18:02:30.809012 59547 fix.go:229] Guest: 2024-08-19 18:02:30.780171978 +0000 UTC Remote: 2024-08-19 18:02:30.702519108 +0000 UTC m=+27.945165193 (delta=77.65287ms)
I0819 18:02:30.809030 59547 fix.go:200] guest clock delta is within tolerance: 77.65287ms
I0819 18:02:30.809036 59547 start.go:83] releasing machines lock for "old-k8s-version-079123", held for 22.735520293s
I0819 18:02:30.809058 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:30.809365 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetIP
I0819 18:02:30.812241 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.812655 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.812680 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.812911 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:30.813476 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:30.813658 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .DriverName
I0819 18:02:30.813764 59547 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0819 18:02:30.813805 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.813861 59547 ssh_runner.go:195] Run: cat /version.json
I0819 18:02:30.813891 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHHostname
I0819 18:02:30.816271 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.816644 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.816671 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.816763 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.816805 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:30.816961 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.817148 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:30.817184 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:30.817217 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:30.817317 59547 sshutil.go:53] new ssh client: &{IP:192.168.39.246 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa Username:docker}
I0819 18:02:30.817620 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHPort
I0819 18:02:30.817793 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHKeyPath
I0819 18:02:30.817985 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetSSHUsername
I0819 18:02:30.818146 59547 sshutil.go:53] new ssh client: &{IP:192.168.39.246 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19478-10654/.minikube/machines/old-k8s-version-079123/id_rsa Username:docker}
I0819 18:02:30.936699 59547 ssh_runner.go:195] Run: systemctl --version
I0819 18:02:30.942760 59547 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0819 18:02:31.102722 59547 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0819 18:02:31.109559 59547 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0819 18:02:31.109643 59547 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0819 18:02:31.131890 59547 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0819 18:02:31.131915 59547 start.go:495] detecting cgroup driver to use...
I0819 18:02:31.131977 59547 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0819 18:02:31.148085 59547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0819 18:02:31.161549 59547 docker.go:217] disabling cri-docker service (if available) ...
I0819 18:02:31.161622 59547 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0819 18:02:31.178079 59547 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0819 18:02:31.194129 59547 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0819 18:02:31.323173 59547 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0819 18:02:31.476353 59547 docker.go:233] disabling docker service ...
I0819 18:02:31.476443 59547 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0819 18:02:31.490108 59547 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0819 18:02:31.502722 59547 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0819 18:02:31.644521 59547 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0819 18:02:31.760484 59547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0819 18:02:31.775243 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0819 18:02:31.792417 59547 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0819 18:02:31.792479 59547 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0819 18:02:31.802435 59547 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0819 18:02:31.802498 59547 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0819 18:02:31.812262 59547 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0819 18:02:31.822251 59547 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0819 18:02:31.832352 59547 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0819 18:02:31.842930 59547 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0819 18:02:31.852197 59547 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0819 18:02:31.852271 59547 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0819 18:02:31.864200 59547 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0819 18:02:31.874124 59547 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 18:02:31.989169 59547 ssh_runner.go:195] Run: sudo systemctl restart crio
I0819 18:02:32.140821 59547 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0819 18:02:32.140886 59547 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0819 18:02:32.145247 59547 start.go:563] Will wait 60s for crictl version
I0819 18:02:32.145324 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:32.148818 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0819 18:02:32.192916 59547 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0819 18:02:32.192998 59547 ssh_runner.go:195] Run: crio --version
I0819 18:02:32.221185 59547 ssh_runner.go:195] Run: crio --version
I0819 18:02:32.249943 59547 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0819 18:02:32.250993 59547 main.go:141] libmachine: (old-k8s-version-079123) Calling .GetIP
I0819 18:02:32.254029 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:32.254436 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:97:ce:99", ip: ""} in network mk-old-k8s-version-079123: {Iface:virbr1 ExpiryTime:2024-08-19 19:02:23 +0000 UTC Type:0 Mac:52:54:00:97:ce:99 Iaid: IPaddr:192.168.39.246 Prefix:24 Hostname:old-k8s-version-079123 Clientid:01:52:54:00:97:ce:99}
I0819 18:02:32.254467 59547 main.go:141] libmachine: (old-k8s-version-079123) DBG | domain old-k8s-version-079123 has defined IP address 192.168.39.246 and MAC address 52:54:00:97:ce:99 in network mk-old-k8s-version-079123
I0819 18:02:32.254704 59547 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0819 18:02:32.258855 59547 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 18:02:32.271596 59547 kubeadm.go:883] updating cluster {Name:old-k8s-version-079123 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-079123 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.246 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0819 18:02:32.271692 59547 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0819 18:02:32.271736 59547 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 18:02:32.303829 59547 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0819 18:02:32.303898 59547 ssh_runner.go:195] Run: which lz4
I0819 18:02:32.307696 59547 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0819 18:02:32.311493 59547 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0819 18:02:32.311529 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0819 18:02:33.825734 59547 crio.go:462] duration metric: took 1.518082344s to copy over tarball
I0819 18:02:33.825803 59547 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0819 18:02:36.416294 59547 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.590463479s)
I0819 18:02:36.416331 59547 crio.go:469] duration metric: took 2.590566331s to extract the tarball
I0819 18:02:36.416366 59547 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0819 18:02:36.458074 59547 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 18:02:36.500186 59547 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0819 18:02:36.500218 59547 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0819 18:02:36.500296 59547 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0819 18:02:36.500309 59547 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:36.500346 59547 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0819 18:02:36.500419 59547 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:36.500436 59547 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:36.500443 59547 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0819 18:02:36.500538 59547 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:36.500829 59547 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0819 18:02:36.501860 59547 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:36.501914 59547 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0819 18:02:36.502016 59547 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0819 18:02:36.502208 59547 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0819 18:02:36.502015 59547 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0819 18:02:36.502325 59547 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:36.502075 59547 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:36.502367 59547 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:36.737082 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0819 18:02:36.775696 59547 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0819 18:02:36.775734 59547 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0819 18:02:36.775770 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:36.780231 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 18:02:36.808266 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:36.810470 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:36.813605 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 18:02:36.817995 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0819 18:02:36.849907 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0819 18:02:36.855960 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:36.860327 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:36.933308 59547 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0819 18:02:36.933368 59547 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:36.933404 59547 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0819 18:02:36.933441 59547 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0819 18:02:36.933477 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:36.933414 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:36.933411 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 18:02:36.933322 59547 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0819 18:02:36.933683 59547 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:36.933739 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:36.988702 59547 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0819 18:02:36.988745 59547 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0819 18:02:36.988807 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:37.002764 59547 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0819 18:02:37.002812 59547 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:37.002821 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 18:02:37.002834 59547 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0819 18:02:37.002851 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:37.002859 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:37.002865 59547 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:37.002908 59547 ssh_runner.go:195] Run: which crictl
I0819 18:02:37.024786 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0819 18:02:37.024849 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:37.024882 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 18:02:37.057084 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:37.057249 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 18:02:37.087041 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:37.087047 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:37.150413 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 18:02:37.150432 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:37.183270 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 18:02:37.183284 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:37.209690 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 18:02:37.209805 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:37.272249 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 18:02:37.276507 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 18:02:37.297512 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 18:02:37.309752 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0819 18:02:37.343938 59547 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 18:02:37.353010 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0819 18:02:37.373481 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0819 18:02:37.386291 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0819 18:02:37.398608 59547 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0819 18:02:37.403770 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0819 18:02:37.408319 59547 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0819 18:02:37.548230 59547 cache_images.go:92] duration metric: took 1.047994436s to LoadCachedImages
W0819 18:02:37.548326 59547 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19478-10654/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0819 18:02:37.548344 59547 kubeadm.go:934] updating node { 192.168.39.246 8443 v1.20.0 crio true true} ...
I0819 18:02:37.548483 59547 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-079123 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.246
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-079123 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0819 18:02:37.548562 59547 ssh_runner.go:195] Run: crio config
I0819 18:02:37.618978 59547 cni.go:84] Creating CNI manager for ""
I0819 18:02:37.619001 59547 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0819 18:02:37.619019 59547 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0819 18:02:37.619040 59547 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.246 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-079123 NodeName:old-k8s-version-079123 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.246"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.246 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0819 18:02:37.619211 59547 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.246
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-079123"
kubeletExtraArgs:
node-ip: 192.168.39.246
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.246"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0819 18:02:37.619282 59547 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0819 18:02:37.631651 59547 binaries.go:44] Found k8s binaries, skipping transfer
I0819 18:02:37.631740 59547 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0819 18:02:37.643950 59547 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0819 18:02:37.663443 59547 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0819 18:02:37.683522 59547 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0819 18:02:37.702625 59547 ssh_runner.go:195] Run: grep 192.168.39.246 control-plane.minikube.internal$ /etc/hosts
I0819 18:02:37.707125 59547 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.246 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 18:02:37.722374 59547 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 18:02:37.860026 59547 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 18:02:37.877776 59547 certs.go:68] Setting up /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123 for IP: 192.168.39.246
I0819 18:02:37.877804 59547 certs.go:194] generating shared ca certs ...
I0819 18:02:37.877822 59547 certs.go:226] acquiring lock for ca certs: {Name:mkedc27ba706b77c42f0fc763dcfbebc3047bc71 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:37.877990 59547 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19478-10654/.minikube/ca.key
I0819 18:02:37.878053 59547 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19478-10654/.minikube/proxy-client-ca.key
I0819 18:02:37.878066 59547 certs.go:256] generating profile certs ...
I0819 18:02:37.878118 59547 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/client.key
I0819 18:02:37.878130 59547 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/client.crt with IP's: []
I0819 18:02:38.138648 59547 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/client.crt ...
I0819 18:02:38.138684 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/client.crt: {Name:mka8d5821f3e9757e4890a1f1c9c5fdbb13512de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:38.138871 59547 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/client.key ...
I0819 18:02:38.138888 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/client.key: {Name:mk94454cb94e8a2ba3403952a1cbb5cc26ec86fb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:38.138990 59547 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.key.9240b1b2
I0819 18:02:38.139011 59547 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.crt.9240b1b2 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.246]
I0819 18:02:38.320250 59547 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.crt.9240b1b2 ...
I0819 18:02:38.320279 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.crt.9240b1b2: {Name:mk9387427e1c3bfa019a5a87f51b5ae6c2d7bcf8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:38.320443 59547 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.key.9240b1b2 ...
I0819 18:02:38.320459 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.key.9240b1b2: {Name:mkca83a1b1d60c9fd7379c5dfaac014cb5c04dd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:38.320551 59547 certs.go:381] copying /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.crt.9240b1b2 -> /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.crt
I0819 18:02:38.320661 59547 certs.go:385] copying /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.key.9240b1b2 -> /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.key
I0819 18:02:38.320784 59547 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.key
I0819 18:02:38.320807 59547 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.crt with IP's: []
I0819 18:02:38.454815 59547 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.crt ...
I0819 18:02:38.454849 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.crt: {Name:mka1ac407102f9e0e6eedc0bed85913b004ce0a7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:38.455039 59547 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.key ...
I0819 18:02:38.455059 59547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.key: {Name:mk1c3645cf28eb8332cba8d4c7f2860b6744a62e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 18:02:38.455289 59547 certs.go:484] found cert: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/17837.pem (1338 bytes)
W0819 18:02:38.455335 59547 certs.go:480] ignoring /home/jenkins/minikube-integration/19478-10654/.minikube/certs/17837_empty.pem, impossibly tiny 0 bytes
I0819 18:02:38.455354 59547 certs.go:484] found cert: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca-key.pem (1675 bytes)
I0819 18:02:38.455389 59547 certs.go:484] found cert: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/ca.pem (1078 bytes)
I0819 18:02:38.455418 59547 certs.go:484] found cert: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/cert.pem (1123 bytes)
I0819 18:02:38.455453 59547 certs.go:484] found cert: /home/jenkins/minikube-integration/19478-10654/.minikube/certs/key.pem (1679 bytes)
I0819 18:02:38.455511 59547 certs.go:484] found cert: /home/jenkins/minikube-integration/19478-10654/.minikube/files/etc/ssl/certs/178372.pem (1708 bytes)
I0819 18:02:38.456345 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0819 18:02:38.482949 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0819 18:02:38.508808 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0819 18:02:38.532548 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0819 18:02:38.556100 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0819 18:02:38.580856 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0819 18:02:38.604054 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0819 18:02:38.626994 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/profiles/old-k8s-version-079123/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0819 18:02:38.649326 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/certs/17837.pem --> /usr/share/ca-certificates/17837.pem (1338 bytes)
I0819 18:02:38.673308 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/files/etc/ssl/certs/178372.pem --> /usr/share/ca-certificates/178372.pem (1708 bytes)
I0819 18:02:38.698282 59547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19478-10654/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0819 18:02:38.721338 59547 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0819 18:02:38.743734 59547 ssh_runner.go:195] Run: openssl version
I0819 18:02:38.754476 59547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17837.pem && ln -fs /usr/share/ca-certificates/17837.pem /etc/ssl/certs/17837.pem"
I0819 18:02:38.771093 59547 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17837.pem
I0819 18:02:38.780844 59547 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 19 17:05 /usr/share/ca-certificates/17837.pem
I0819 18:02:38.780922 59547 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17837.pem
I0819 18:02:38.790194 59547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/17837.pem /etc/ssl/certs/51391683.0"
I0819 18:02:38.810069 59547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/178372.pem && ln -fs /usr/share/ca-certificates/178372.pem /etc/ssl/certs/178372.pem"
I0819 18:02:38.821061 59547 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/178372.pem
I0819 18:02:38.825605 59547 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 19 17:05 /usr/share/ca-certificates/178372.pem
I0819 18:02:38.825667 59547 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/178372.pem
I0819 18:02:38.831204 59547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/178372.pem /etc/ssl/certs/3ec20f2e.0"
I0819 18:02:38.842020 59547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0819 18:02:38.852729 59547 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0819 18:02:38.857361 59547 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 19 16:53 /usr/share/ca-certificates/minikubeCA.pem
I0819 18:02:38.857426 59547 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0819 18:02:38.863141 59547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0819 18:02:38.873746 59547 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0819 18:02:38.877802 59547 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0819 18:02:38.877879 59547 kubeadm.go:392] StartCluster: {Name:old-k8s-version-079123 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-079123 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.246 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 18:02:38.877954 59547 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0819 18:02:38.877995 59547 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0819 18:02:38.922138 59547 cri.go:89] found id: ""
I0819 18:02:38.922205 59547 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0819 18:02:38.932002 59547 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0819 18:02:38.941433 59547 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 18:02:38.951695 59547 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 18:02:38.951721 59547 kubeadm.go:157] found existing configuration files:
I0819 18:02:38.951780 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 18:02:38.962663 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 18:02:38.962727 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 18:02:38.972843 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 18:02:38.981549 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 18:02:38.981621 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 18:02:38.990813 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 18:02:39.000156 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 18:02:39.000217 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 18:02:39.013134 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 18:02:39.022086 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 18:02:39.022135 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 18:02:39.031022 59547 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0819 18:02:39.319232 59547 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 18:04:36.577533 59547 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0819 18:04:36.577618 59547 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0819 18:04:36.578944 59547 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0819 18:04:36.579055 59547 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 18:04:36.579166 59547 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 18:04:36.579293 59547 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 18:04:36.579433 59547 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0819 18:04:36.579515 59547 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 18:04:36.581252 59547 out.go:235] - Generating certificates and keys ...
I0819 18:04:36.581333 59547 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 18:04:36.581419 59547 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 18:04:36.581526 59547 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0819 18:04:36.581602 59547 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0819 18:04:36.581685 59547 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0819 18:04:36.581765 59547 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0819 18:04:36.581844 59547 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0819 18:04:36.582026 59547 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-079123] and IPs [192.168.39.246 127.0.0.1 ::1]
I0819 18:04:36.582094 59547 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0819 18:04:36.582279 59547 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-079123] and IPs [192.168.39.246 127.0.0.1 ::1]
I0819 18:04:36.582368 59547 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0819 18:04:36.582448 59547 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0819 18:04:36.582488 59547 kubeadm.go:310] [certs] Generating "sa" key and public key
I0819 18:04:36.582552 59547 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 18:04:36.582605 59547 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 18:04:36.582649 59547 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 18:04:36.582730 59547 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 18:04:36.582811 59547 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 18:04:36.582966 59547 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 18:04:36.583037 59547 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 18:04:36.583071 59547 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 18:04:36.583130 59547 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 18:04:36.585495 59547 out.go:235] - Booting up control plane ...
I0819 18:04:36.585571 59547 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 18:04:36.585634 59547 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 18:04:36.585704 59547 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 18:04:36.585772 59547 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 18:04:36.585926 59547 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0819 18:04:36.585991 59547 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0819 18:04:36.586065 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:04:36.586237 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:04:36.586305 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:04:36.586499 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:04:36.586568 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:04:36.586729 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:04:36.586788 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:04:36.586954 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:04:36.587029 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:04:36.587190 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:04:36.587197 59547 kubeadm.go:310]
I0819 18:04:36.587240 59547 kubeadm.go:310] Unfortunately, an error has occurred:
I0819 18:04:36.587284 59547 kubeadm.go:310] timed out waiting for the condition
I0819 18:04:36.587291 59547 kubeadm.go:310]
I0819 18:04:36.587320 59547 kubeadm.go:310] This error is likely caused by:
I0819 18:04:36.587349 59547 kubeadm.go:310] - The kubelet is not running
I0819 18:04:36.587443 59547 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0819 18:04:36.587455 59547 kubeadm.go:310]
I0819 18:04:36.587557 59547 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0819 18:04:36.587596 59547 kubeadm.go:310] - 'systemctl status kubelet'
I0819 18:04:36.587622 59547 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0819 18:04:36.587631 59547 kubeadm.go:310]
I0819 18:04:36.587739 59547 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0819 18:04:36.587812 59547 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0819 18:04:36.587822 59547 kubeadm.go:310]
I0819 18:04:36.587914 59547 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0819 18:04:36.587988 59547 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0819 18:04:36.588066 59547 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0819 18:04:36.588130 59547 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0819 18:04:36.588180 59547 kubeadm.go:310]
W0819 18:04:36.588256 59547 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-079123] and IPs [192.168.39.246 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-079123] and IPs [192.168.39.246 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-079123] and IPs [192.168.39.246 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-079123] and IPs [192.168.39.246 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0819 18:04:36.588290 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0819 18:04:38.120267 59547 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.531955978s)
I0819 18:04:38.120348 59547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0819 18:04:38.134667 59547 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 18:04:38.143762 59547 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 18:04:38.143783 59547 kubeadm.go:157] found existing configuration files:
I0819 18:04:38.143829 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 18:04:38.152516 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 18:04:38.152576 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 18:04:38.161636 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 18:04:38.170419 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 18:04:38.170490 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 18:04:38.179800 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 18:04:38.188471 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 18:04:38.188529 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 18:04:38.197523 59547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 18:04:38.206122 59547 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 18:04:38.206191 59547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 18:04:38.215076 59547 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0819 18:04:38.289087 59547 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0819 18:04:38.289144 59547 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 18:04:38.427711 59547 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 18:04:38.427846 59547 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 18:04:38.427968 59547 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0819 18:04:38.596068 59547 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 18:04:38.597865 59547 out.go:235] - Generating certificates and keys ...
I0819 18:04:38.597961 59547 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 18:04:38.598053 59547 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 18:04:38.598190 59547 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0819 18:04:38.598302 59547 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0819 18:04:38.598424 59547 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0819 18:04:38.598515 59547 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0819 18:04:38.599150 59547 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0819 18:04:38.599955 59547 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0819 18:04:38.600441 59547 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0819 18:04:38.601066 59547 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0819 18:04:38.601191 59547 kubeadm.go:310] [certs] Using the existing "sa" key
I0819 18:04:38.601268 59547 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 18:04:38.687878 59547 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 18:04:38.976744 59547 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 18:04:39.215077 59547 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 18:04:39.311669 59547 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 18:04:39.325449 59547 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 18:04:39.326560 59547 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 18:04:39.326638 59547 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 18:04:39.460548 59547 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 18:04:39.462330 59547 out.go:235] - Booting up control plane ...
I0819 18:04:39.462451 59547 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 18:04:39.465407 59547 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 18:04:39.466703 59547 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 18:04:39.468438 59547 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 18:04:39.472725 59547 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0819 18:05:19.475640 59547 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0819 18:05:19.475756 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:05:19.475966 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:05:24.476434 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:05:24.476613 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:05:34.477460 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:05:34.477670 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:05:54.476964 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:05:54.477159 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:06:34.477015 59547 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 18:06:34.477290 59547 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 18:06:34.477309 59547 kubeadm.go:310]
I0819 18:06:34.477365 59547 kubeadm.go:310] Unfortunately, an error has occurred:
I0819 18:06:34.477418 59547 kubeadm.go:310] timed out waiting for the condition
I0819 18:06:34.477430 59547 kubeadm.go:310]
I0819 18:06:34.477490 59547 kubeadm.go:310] This error is likely caused by:
I0819 18:06:34.477532 59547 kubeadm.go:310] - The kubelet is not running
I0819 18:06:34.477672 59547 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0819 18:06:34.477683 59547 kubeadm.go:310]
I0819 18:06:34.477829 59547 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0819 18:06:34.477875 59547 kubeadm.go:310] - 'systemctl status kubelet'
I0819 18:06:34.477914 59547 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0819 18:06:34.477922 59547 kubeadm.go:310]
I0819 18:06:34.478035 59547 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0819 18:06:34.478127 59547 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0819 18:06:34.478136 59547 kubeadm.go:310]
I0819 18:06:34.478272 59547 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0819 18:06:34.478393 59547 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0819 18:06:34.478490 59547 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0819 18:06:34.478584 59547 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0819 18:06:34.478595 59547 kubeadm.go:310]
I0819 18:06:34.479340 59547 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 18:06:34.479467 59547 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0819 18:06:34.479571 59547 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0819 18:06:34.479649 59547 kubeadm.go:394] duration metric: took 3m55.601774361s to StartCluster
I0819 18:06:34.479701 59547 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0819 18:06:34.479769 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 18:06:34.524319 59547 cri.go:89] found id: ""
I0819 18:06:34.524369 59547 logs.go:276] 0 containers: []
W0819 18:06:34.524381 59547 logs.go:278] No container was found matching "kube-apiserver"
I0819 18:06:34.524390 59547 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0819 18:06:34.524462 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 18:06:34.568771 59547 cri.go:89] found id: ""
I0819 18:06:34.568798 59547 logs.go:276] 0 containers: []
W0819 18:06:34.568808 59547 logs.go:278] No container was found matching "etcd"
I0819 18:06:34.568815 59547 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0819 18:06:34.568873 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 18:06:34.611478 59547 cri.go:89] found id: ""
I0819 18:06:34.611509 59547 logs.go:276] 0 containers: []
W0819 18:06:34.611519 59547 logs.go:278] No container was found matching "coredns"
I0819 18:06:34.611526 59547 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0819 18:06:34.611591 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 18:06:34.650596 59547 cri.go:89] found id: ""
I0819 18:06:34.650623 59547 logs.go:276] 0 containers: []
W0819 18:06:34.650634 59547 logs.go:278] No container was found matching "kube-scheduler"
I0819 18:06:34.650641 59547 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0819 18:06:34.650707 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 18:06:34.697426 59547 cri.go:89] found id: ""
I0819 18:06:34.697449 59547 logs.go:276] 0 containers: []
W0819 18:06:34.697457 59547 logs.go:278] No container was found matching "kube-proxy"
I0819 18:06:34.697463 59547 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0819 18:06:34.697503 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 18:06:34.748234 59547 cri.go:89] found id: ""
I0819 18:06:34.748253 59547 logs.go:276] 0 containers: []
W0819 18:06:34.748261 59547 logs.go:278] No container was found matching "kube-controller-manager"
I0819 18:06:34.748266 59547 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0819 18:06:34.748306 59547 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 18:06:34.796392 59547 cri.go:89] found id: ""
I0819 18:06:34.796421 59547 logs.go:276] 0 containers: []
W0819 18:06:34.796432 59547 logs.go:278] No container was found matching "kindnet"
I0819 18:06:34.796444 59547 logs.go:123] Gathering logs for describe nodes ...
I0819 18:06:34.796460 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0819 18:06:34.954950 59547 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0819 18:06:34.954976 59547 logs.go:123] Gathering logs for CRI-O ...
I0819 18:06:34.954993 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0819 18:06:35.074640 59547 logs.go:123] Gathering logs for container status ...
I0819 18:06:35.074674 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 18:06:35.118237 59547 logs.go:123] Gathering logs for kubelet ...
I0819 18:06:35.118263 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0819 18:06:35.166037 59547 logs.go:123] Gathering logs for dmesg ...
I0819 18:06:35.166068 59547 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0819 18:06:35.184559 59547 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 18:06:35.184630 59547 out.go:270] *
*
W0819 18:06:35.184699 59547 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 18:06:35.184717 59547 out.go:270] *
*
W0819 18:06:35.185878 59547 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0819 18:06:35.189336 59547 out.go:201]
W0819 18:06:35.190680 59547 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 18:06:35.190729 59547 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0819 18:06:35.190757 59547 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0819 18:06:35.192297 59547 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-079123 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-079123 -n old-k8s-version-079123
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-079123 -n old-k8s-version-079123: exit status 6 (210.687251ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0819 18:06:35.450273 62344 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-079123" does not appear in /home/jenkins/minikube-integration/19478-10654/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-079123" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.71s)