=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-901761 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-901761 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m48.544886695s)
-- stdout --
* [old-k8s-version-901761] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19264
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19264-3908/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19264-3908/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-901761" primary control-plane node in "old-k8s-version-901761" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0717 01:45:31.987884 64668 out.go:291] Setting OutFile to fd 1 ...
I0717 01:45:31.988048 64668 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 01:45:31.988059 64668 out.go:304] Setting ErrFile to fd 2...
I0717 01:45:31.988066 64668 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 01:45:31.988323 64668 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19264-3908/.minikube/bin
I0717 01:45:31.989023 64668 out.go:298] Setting JSON to false
I0717 01:45:31.990472 64668 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":5274,"bootTime":1721175458,"procs":318,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0717 01:45:31.990542 64668 start.go:139] virtualization: kvm guest
I0717 01:45:31.992826 64668 out.go:177] * [old-k8s-version-901761] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0717 01:45:31.994813 64668 out.go:177] - MINIKUBE_LOCATION=19264
I0717 01:45:31.994844 64668 notify.go:220] Checking for updates...
I0717 01:45:31.998573 64668 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0717 01:45:32.003607 64668 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19264-3908/kubeconfig
I0717 01:45:32.004925 64668 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19264-3908/.minikube
I0717 01:45:32.006349 64668 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0717 01:45:32.007807 64668 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0717 01:45:32.009586 64668 config.go:182] Loaded profile config "bridge-894370": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 01:45:32.009673 64668 config.go:182] Loaded profile config "enable-default-cni-894370": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 01:45:32.009750 64668 config.go:182] Loaded profile config "flannel-894370": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 01:45:32.009850 64668 driver.go:392] Setting default libvirt URI to qemu:///system
I0717 01:45:32.046781 64668 out.go:177] * Using the kvm2 driver based on user configuration
I0717 01:45:32.048067 64668 start.go:297] selected driver: kvm2
I0717 01:45:32.048093 64668 start.go:901] validating driver "kvm2" against <nil>
I0717 01:45:32.048108 64668 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0717 01:45:32.048901 64668 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 01:45:32.049013 64668 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19264-3908/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0717 01:45:32.064313 64668 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0717 01:45:32.064373 64668 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0717 01:45:32.064639 64668 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0717 01:45:32.064724 64668 cni.go:84] Creating CNI manager for ""
I0717 01:45:32.064741 64668 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 01:45:32.064752 64668 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0717 01:45:32.064841 64668 start.go:340] cluster config:
{Name:old-k8s-version-901761 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-901761 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 01:45:32.064934 64668 iso.go:125] acquiring lock: {Name:mk1e382ea32906eee794c9b90164432d2562b456 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 01:45:32.066654 64668 out.go:177] * Starting "old-k8s-version-901761" primary control-plane node in "old-k8s-version-901761" cluster
I0717 01:45:32.068044 64668 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 01:45:32.068083 64668 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0717 01:45:32.068106 64668 cache.go:56] Caching tarball of preloaded images
I0717 01:45:32.068210 64668 preload.go:172] Found /home/jenkins/minikube-integration/19264-3908/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0717 01:45:32.068222 64668 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0717 01:45:32.068323 64668 profile.go:143] Saving config to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/config.json ...
I0717 01:45:32.068347 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/config.json: {Name:mk64c2656f04d0669fd9bdba21b2d382ff9496f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:45:32.068491 64668 start.go:360] acquireMachinesLock for old-k8s-version-901761: {Name:mk3d74c1dda2b8a7af17fb95b766ad68098974c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0717 01:45:45.455582 64668 start.go:364] duration metric: took 13.387060949s to acquireMachinesLock for "old-k8s-version-901761"
I0717 01:45:45.455659 64668 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-901761 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-901761 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0717 01:45:45.455770 64668 start.go:125] createHost starting for "" (driver="kvm2")
I0717 01:45:45.457796 64668 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0717 01:45:45.458003 64668 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0717 01:45:45.458047 64668 main.go:141] libmachine: Launching plugin server for driver kvm2
I0717 01:45:45.474825 64668 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38807
I0717 01:45:45.475272 64668 main.go:141] libmachine: () Calling .GetVersion
I0717 01:45:45.475842 64668 main.go:141] libmachine: Using API Version 1
I0717 01:45:45.475868 64668 main.go:141] libmachine: () Calling .SetConfigRaw
I0717 01:45:45.476332 64668 main.go:141] libmachine: () Calling .GetMachineName
I0717 01:45:45.476553 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetMachineName
I0717 01:45:45.476745 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:45:45.476925 64668 start.go:159] libmachine.API.Create for "old-k8s-version-901761" (driver="kvm2")
I0717 01:45:45.476969 64668 client.go:168] LocalClient.Create starting
I0717 01:45:45.477013 64668 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca.pem
I0717 01:45:45.477056 64668 main.go:141] libmachine: Decoding PEM data...
I0717 01:45:45.477078 64668 main.go:141] libmachine: Parsing certificate...
I0717 01:45:45.477140 64668 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19264-3908/.minikube/certs/cert.pem
I0717 01:45:45.477165 64668 main.go:141] libmachine: Decoding PEM data...
I0717 01:45:45.477181 64668 main.go:141] libmachine: Parsing certificate...
I0717 01:45:45.477204 64668 main.go:141] libmachine: Running pre-create checks...
I0717 01:45:45.477216 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .PreCreateCheck
I0717 01:45:45.477628 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetConfigRaw
I0717 01:45:45.478101 64668 main.go:141] libmachine: Creating machine...
I0717 01:45:45.478119 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .Create
I0717 01:45:45.478266 64668 main.go:141] libmachine: (old-k8s-version-901761) Creating KVM machine...
I0717 01:45:45.479399 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found existing default KVM network
I0717 01:45:45.480655 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:45.480505 65963 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:d2:d4:9d} reservation:<nil>}
I0717 01:45:45.481768 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:45.481683 65963 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002f65b0}
I0717 01:45:45.481803 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | created network xml:
I0717 01:45:45.481817 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | <network>
I0717 01:45:45.481828 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | <name>mk-old-k8s-version-901761</name>
I0717 01:45:45.481849 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | <dns enable='no'/>
I0717 01:45:45.481858 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG |
I0717 01:45:45.481868 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0717 01:45:45.481877 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | <dhcp>
I0717 01:45:45.481895 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0717 01:45:45.481909 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | </dhcp>
I0717 01:45:45.481915 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | </ip>
I0717 01:45:45.481921 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG |
I0717 01:45:45.481928 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | </network>
I0717 01:45:45.481937 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG |
I0717 01:45:45.488186 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | trying to create private KVM network mk-old-k8s-version-901761 192.168.50.0/24...
I0717 01:45:45.563881 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | private KVM network mk-old-k8s-version-901761 192.168.50.0/24 created
I0717 01:45:45.563917 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:45.563853 65963 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19264-3908/.minikube
I0717 01:45:45.563934 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting up store path in /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761 ...
I0717 01:45:45.563946 64668 main.go:141] libmachine: (old-k8s-version-901761) Building disk image from file:///home/jenkins/minikube-integration/19264-3908/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso
I0717 01:45:45.564039 64668 main.go:141] libmachine: (old-k8s-version-901761) Downloading /home/jenkins/minikube-integration/19264-3908/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19264-3908/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso...
I0717 01:45:45.837592 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:45.837494 65963 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa...
I0717 01:45:45.913727 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:45.913596 65963 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/old-k8s-version-901761.rawdisk...
I0717 01:45:45.913762 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Writing magic tar header
I0717 01:45:45.913779 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Writing SSH key tar header
I0717 01:45:45.913794 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:45.913749 65963 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761 ...
I0717 01:45:45.913894 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761
I0717 01:45:45.913926 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting executable bit set on /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761 (perms=drwx------)
I0717 01:45:45.913937 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19264-3908/.minikube/machines
I0717 01:45:45.913952 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19264-3908/.minikube
I0717 01:45:45.913966 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19264-3908
I0717 01:45:45.913979 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0717 01:45:45.913990 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home/jenkins
I0717 01:45:45.914026 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting executable bit set on /home/jenkins/minikube-integration/19264-3908/.minikube/machines (perms=drwxr-xr-x)
I0717 01:45:45.914046 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting executable bit set on /home/jenkins/minikube-integration/19264-3908/.minikube (perms=drwxr-xr-x)
I0717 01:45:45.914060 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting executable bit set on /home/jenkins/minikube-integration/19264-3908 (perms=drwxrwxr-x)
I0717 01:45:45.914100 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Checking permissions on dir: /home
I0717 01:45:45.914125 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0717 01:45:45.914138 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Skipping /home - not owner
I0717 01:45:45.914156 64668 main.go:141] libmachine: (old-k8s-version-901761) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0717 01:45:45.914166 64668 main.go:141] libmachine: (old-k8s-version-901761) Creating domain...
I0717 01:45:45.915180 64668 main.go:141] libmachine: (old-k8s-version-901761) define libvirt domain using xml:
I0717 01:45:45.915198 64668 main.go:141] libmachine: (old-k8s-version-901761) <domain type='kvm'>
I0717 01:45:45.915209 64668 main.go:141] libmachine: (old-k8s-version-901761) <name>old-k8s-version-901761</name>
I0717 01:45:45.915219 64668 main.go:141] libmachine: (old-k8s-version-901761) <memory unit='MiB'>2200</memory>
I0717 01:45:45.915231 64668 main.go:141] libmachine: (old-k8s-version-901761) <vcpu>2</vcpu>
I0717 01:45:45.915240 64668 main.go:141] libmachine: (old-k8s-version-901761) <features>
I0717 01:45:45.915261 64668 main.go:141] libmachine: (old-k8s-version-901761) <acpi/>
I0717 01:45:45.915271 64668 main.go:141] libmachine: (old-k8s-version-901761) <apic/>
I0717 01:45:45.915306 64668 main.go:141] libmachine: (old-k8s-version-901761) <pae/>
I0717 01:45:45.915329 64668 main.go:141] libmachine: (old-k8s-version-901761)
I0717 01:45:45.915343 64668 main.go:141] libmachine: (old-k8s-version-901761) </features>
I0717 01:45:45.915360 64668 main.go:141] libmachine: (old-k8s-version-901761) <cpu mode='host-passthrough'>
I0717 01:45:45.915371 64668 main.go:141] libmachine: (old-k8s-version-901761)
I0717 01:45:45.915381 64668 main.go:141] libmachine: (old-k8s-version-901761) </cpu>
I0717 01:45:45.915403 64668 main.go:141] libmachine: (old-k8s-version-901761) <os>
I0717 01:45:45.915429 64668 main.go:141] libmachine: (old-k8s-version-901761) <type>hvm</type>
I0717 01:45:45.915440 64668 main.go:141] libmachine: (old-k8s-version-901761) <boot dev='cdrom'/>
I0717 01:45:45.915451 64668 main.go:141] libmachine: (old-k8s-version-901761) <boot dev='hd'/>
I0717 01:45:45.915464 64668 main.go:141] libmachine: (old-k8s-version-901761) <bootmenu enable='no'/>
I0717 01:45:45.915473 64668 main.go:141] libmachine: (old-k8s-version-901761) </os>
I0717 01:45:45.915482 64668 main.go:141] libmachine: (old-k8s-version-901761) <devices>
I0717 01:45:45.915494 64668 main.go:141] libmachine: (old-k8s-version-901761) <disk type='file' device='cdrom'>
I0717 01:45:45.915511 64668 main.go:141] libmachine: (old-k8s-version-901761) <source file='/home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/boot2docker.iso'/>
I0717 01:45:45.915523 64668 main.go:141] libmachine: (old-k8s-version-901761) <target dev='hdc' bus='scsi'/>
I0717 01:45:45.915535 64668 main.go:141] libmachine: (old-k8s-version-901761) <readonly/>
I0717 01:45:45.915543 64668 main.go:141] libmachine: (old-k8s-version-901761) </disk>
I0717 01:45:45.915556 64668 main.go:141] libmachine: (old-k8s-version-901761) <disk type='file' device='disk'>
I0717 01:45:45.915569 64668 main.go:141] libmachine: (old-k8s-version-901761) <driver name='qemu' type='raw' cache='default' io='threads' />
I0717 01:45:45.915592 64668 main.go:141] libmachine: (old-k8s-version-901761) <source file='/home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/old-k8s-version-901761.rawdisk'/>
I0717 01:45:45.915602 64668 main.go:141] libmachine: (old-k8s-version-901761) <target dev='hda' bus='virtio'/>
I0717 01:45:45.915613 64668 main.go:141] libmachine: (old-k8s-version-901761) </disk>
I0717 01:45:45.915623 64668 main.go:141] libmachine: (old-k8s-version-901761) <interface type='network'>
I0717 01:45:45.915636 64668 main.go:141] libmachine: (old-k8s-version-901761) <source network='mk-old-k8s-version-901761'/>
I0717 01:45:45.915656 64668 main.go:141] libmachine: (old-k8s-version-901761) <model type='virtio'/>
I0717 01:45:45.915667 64668 main.go:141] libmachine: (old-k8s-version-901761) </interface>
I0717 01:45:45.915679 64668 main.go:141] libmachine: (old-k8s-version-901761) <interface type='network'>
I0717 01:45:45.915689 64668 main.go:141] libmachine: (old-k8s-version-901761) <source network='default'/>
I0717 01:45:45.915699 64668 main.go:141] libmachine: (old-k8s-version-901761) <model type='virtio'/>
I0717 01:45:45.915707 64668 main.go:141] libmachine: (old-k8s-version-901761) </interface>
I0717 01:45:45.915726 64668 main.go:141] libmachine: (old-k8s-version-901761) <serial type='pty'>
I0717 01:45:45.915734 64668 main.go:141] libmachine: (old-k8s-version-901761) <target port='0'/>
I0717 01:45:45.915743 64668 main.go:141] libmachine: (old-k8s-version-901761) </serial>
I0717 01:45:45.915753 64668 main.go:141] libmachine: (old-k8s-version-901761) <console type='pty'>
I0717 01:45:45.915762 64668 main.go:141] libmachine: (old-k8s-version-901761) <target type='serial' port='0'/>
I0717 01:45:45.915769 64668 main.go:141] libmachine: (old-k8s-version-901761) </console>
I0717 01:45:45.915778 64668 main.go:141] libmachine: (old-k8s-version-901761) <rng model='virtio'>
I0717 01:45:45.915789 64668 main.go:141] libmachine: (old-k8s-version-901761) <backend model='random'>/dev/random</backend>
I0717 01:45:45.915799 64668 main.go:141] libmachine: (old-k8s-version-901761) </rng>
I0717 01:45:45.915809 64668 main.go:141] libmachine: (old-k8s-version-901761)
I0717 01:45:45.915840 64668 main.go:141] libmachine: (old-k8s-version-901761)
I0717 01:45:45.915863 64668 main.go:141] libmachine: (old-k8s-version-901761) </devices>
I0717 01:45:45.915875 64668 main.go:141] libmachine: (old-k8s-version-901761) </domain>
I0717 01:45:45.915883 64668 main.go:141] libmachine: (old-k8s-version-901761)
I0717 01:45:45.919887 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:d2:71:8b in network default
I0717 01:45:45.920393 64668 main.go:141] libmachine: (old-k8s-version-901761) Ensuring networks are active...
I0717 01:45:45.920413 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:45.921058 64668 main.go:141] libmachine: (old-k8s-version-901761) Ensuring network default is active
I0717 01:45:45.921407 64668 main.go:141] libmachine: (old-k8s-version-901761) Ensuring network mk-old-k8s-version-901761 is active
I0717 01:45:45.921959 64668 main.go:141] libmachine: (old-k8s-version-901761) Getting domain xml...
I0717 01:45:45.922734 64668 main.go:141] libmachine: (old-k8s-version-901761) Creating domain...
I0717 01:45:47.338510 64668 main.go:141] libmachine: (old-k8s-version-901761) Waiting to get IP...
I0717 01:45:47.339378 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:47.339871 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:47.339898 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:47.339849 65963 retry.go:31] will retry after 207.469711ms: waiting for machine to come up
I0717 01:45:47.549491 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:47.550120 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:47.550148 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:47.550078 65963 retry.go:31] will retry after 299.858548ms: waiting for machine to come up
I0717 01:45:47.851590 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:47.852098 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:47.852127 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:47.852053 65963 retry.go:31] will retry after 391.578226ms: waiting for machine to come up
I0717 01:45:48.245844 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:48.246307 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:48.246381 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:48.246273 65963 retry.go:31] will retry after 400.282251ms: waiting for machine to come up
I0717 01:45:48.647866 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:48.648443 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:48.648468 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:48.648358 65963 retry.go:31] will retry after 543.270331ms: waiting for machine to come up
I0717 01:45:49.193103 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:49.193623 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:49.193646 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:49.193602 65963 retry.go:31] will retry after 744.536888ms: waiting for machine to come up
I0717 01:45:49.939461 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:49.940012 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:49.940043 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:49.939964 65963 retry.go:31] will retry after 1.060995242s: waiting for machine to come up
I0717 01:45:51.002677 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:51.003117 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:51.003148 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:51.003080 65963 retry.go:31] will retry after 1.040904425s: waiting for machine to come up
I0717 01:45:52.045117 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:52.045607 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:52.045634 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:52.045558 65963 retry.go:31] will retry after 1.521915125s: waiting for machine to come up
I0717 01:45:53.569497 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:53.570001 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:53.570023 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:53.569949 65963 retry.go:31] will retry after 1.947087749s: waiting for machine to come up
I0717 01:45:55.518356 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:55.518855 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:55.518882 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:55.518804 65963 retry.go:31] will retry after 2.837612719s: waiting for machine to come up
I0717 01:45:58.357591 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:45:58.358061 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:45:58.358088 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:45:58.358013 65963 retry.go:31] will retry after 2.961334628s: waiting for machine to come up
I0717 01:46:01.320657 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:01.321211 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:46:01.321241 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:46:01.321156 65963 retry.go:31] will retry after 3.028286391s: waiting for machine to come up
I0717 01:46:04.351613 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:04.352158 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find current IP address of domain old-k8s-version-901761 in network mk-old-k8s-version-901761
I0717 01:46:04.352192 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | I0717 01:46:04.352111 65963 retry.go:31] will retry after 4.818649417s: waiting for machine to come up
I0717 01:46:09.172638 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:09.173143 64668 main.go:141] libmachine: (old-k8s-version-901761) Found IP for machine: 192.168.50.44
I0717 01:46:09.173170 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has current primary IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:09.173179 64668 main.go:141] libmachine: (old-k8s-version-901761) Reserving static IP address...
I0717 01:46:09.174155 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-901761", mac: "52:54:00:8f:84:01", ip: "192.168.50.44"} in network mk-old-k8s-version-901761
I0717 01:46:09.250882 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Getting to WaitForSSH function...
I0717 01:46:09.250930 64668 main.go:141] libmachine: (old-k8s-version-901761) Reserved static IP address: 192.168.50.44
I0717 01:46:09.250944 64668 main.go:141] libmachine: (old-k8s-version-901761) Waiting for SSH to be available...
I0717 01:46:09.253453 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:09.253827 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761
I0717 01:46:09.253863 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | unable to find defined IP address of network mk-old-k8s-version-901761 interface with MAC address 52:54:00:8f:84:01
I0717 01:46:09.254009 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Using SSH client type: external
I0717 01:46:09.254035 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Using SSH private key: /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa (-rw-------)
I0717 01:46:09.254077 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa -p 22] /usr/bin/ssh <nil>}
I0717 01:46:09.254099 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | About to run SSH command:
I0717 01:46:09.254112 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | exit 0
I0717 01:46:09.258126 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | SSH cmd err, output: exit status 255:
I0717 01:46:09.258151 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0717 01:46:09.258177 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | command : exit 0
I0717 01:46:09.258199 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | err : exit status 255
I0717 01:46:09.258212 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | output :
I0717 01:46:12.258730 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Getting to WaitForSSH function...
I0717 01:46:12.261512 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.261890 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.261920 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.262041 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Using SSH client type: external
I0717 01:46:12.262069 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Using SSH private key: /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa (-rw-------)
I0717 01:46:12.262114 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.44 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa -p 22] /usr/bin/ssh <nil>}
I0717 01:46:12.262128 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | About to run SSH command:
I0717 01:46:12.262158 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | exit 0
I0717 01:46:12.387067 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | SSH cmd err, output: <nil>:
I0717 01:46:12.387470 64668 main.go:141] libmachine: (old-k8s-version-901761) KVM machine creation complete!
I0717 01:46:12.387774 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetConfigRaw
I0717 01:46:12.388400 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:12.388604 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:12.388773 64668 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0717 01:46:12.388787 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetState
I0717 01:46:12.390157 64668 main.go:141] libmachine: Detecting operating system of created instance...
I0717 01:46:12.390174 64668 main.go:141] libmachine: Waiting for SSH to be available...
I0717 01:46:12.390182 64668 main.go:141] libmachine: Getting to WaitForSSH function...
I0717 01:46:12.390191 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:12.392468 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.392807 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.392833 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.393023 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:12.393211 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.393368 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.393504 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:12.393700 64668 main.go:141] libmachine: Using SSH client type: native
I0717 01:46:12.393943 64668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.50.44 22 <nil> <nil>}
I0717 01:46:12.393965 64668 main.go:141] libmachine: About to run SSH command:
exit 0
I0717 01:46:12.502127 64668 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 01:46:12.502152 64668 main.go:141] libmachine: Detecting the provisioner...
I0717 01:46:12.502159 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:12.505207 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.505545 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.505572 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.505731 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:12.505956 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.506165 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.506303 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:12.506437 64668 main.go:141] libmachine: Using SSH client type: native
I0717 01:46:12.506655 64668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.50.44 22 <nil> <nil>}
I0717 01:46:12.506670 64668 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0717 01:46:12.617004 64668 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0717 01:46:12.617109 64668 main.go:141] libmachine: found compatible host: buildroot
I0717 01:46:12.617125 64668 main.go:141] libmachine: Provisioning with buildroot...
I0717 01:46:12.617141 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetMachineName
I0717 01:46:12.617407 64668 buildroot.go:166] provisioning hostname "old-k8s-version-901761"
I0717 01:46:12.617433 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetMachineName
I0717 01:46:12.617600 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:12.620152 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.620528 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.620560 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.620659 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:12.620829 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.620989 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.621109 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:12.621244 64668 main.go:141] libmachine: Using SSH client type: native
I0717 01:46:12.621455 64668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.50.44 22 <nil> <nil>}
I0717 01:46:12.621467 64668 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-901761 && echo "old-k8s-version-901761" | sudo tee /etc/hostname
I0717 01:46:12.751151 64668 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-901761
I0717 01:46:12.751196 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:12.754165 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.754593 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.754623 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.754811 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:12.755019 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.755190 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:12.755351 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:12.755511 64668 main.go:141] libmachine: Using SSH client type: native
I0717 01:46:12.755738 64668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.50.44 22 <nil> <nil>}
I0717 01:46:12.755765 64668 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-901761' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-901761/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-901761' | sudo tee -a /etc/hosts;
fi
fi
I0717 01:46:12.885021 64668 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 01:46:12.885053 64668 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19264-3908/.minikube CaCertPath:/home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19264-3908/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19264-3908/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19264-3908/.minikube}
I0717 01:46:12.885107 64668 buildroot.go:174] setting up certificates
I0717 01:46:12.885134 64668 provision.go:84] configureAuth start
I0717 01:46:12.885154 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetMachineName
I0717 01:46:12.885457 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetIP
I0717 01:46:12.888427 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.888826 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.888851 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.889155 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:12.891686 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.892099 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:12.892150 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:12.892240 64668 provision.go:143] copyHostCerts
I0717 01:46:12.892309 64668 exec_runner.go:144] found /home/jenkins/minikube-integration/19264-3908/.minikube/ca.pem, removing ...
I0717 01:46:12.892334 64668 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19264-3908/.minikube/ca.pem
I0717 01:46:12.892430 64668 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19264-3908/.minikube/ca.pem (1078 bytes)
I0717 01:46:12.892551 64668 exec_runner.go:144] found /home/jenkins/minikube-integration/19264-3908/.minikube/cert.pem, removing ...
I0717 01:46:12.892563 64668 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19264-3908/.minikube/cert.pem
I0717 01:46:12.892596 64668 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19264-3908/.minikube/cert.pem (1123 bytes)
I0717 01:46:12.892685 64668 exec_runner.go:144] found /home/jenkins/minikube-integration/19264-3908/.minikube/key.pem, removing ...
I0717 01:46:12.892695 64668 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19264-3908/.minikube/key.pem
I0717 01:46:12.892731 64668 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19264-3908/.minikube/key.pem (1675 bytes)
I0717 01:46:12.892814 64668 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19264-3908/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-901761 san=[127.0.0.1 192.168.50.44 localhost minikube old-k8s-version-901761]
I0717 01:46:13.275065 64668 provision.go:177] copyRemoteCerts
I0717 01:46:13.275135 64668 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0717 01:46:13.275164 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:13.277827 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.278159 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.278203 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.278400 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:13.278626 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:13.278790 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:13.278965 64668 sshutil.go:53] new ssh client: &{IP:192.168.50.44 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa Username:docker}
I0717 01:46:13.366933 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0717 01:46:13.394408 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0717 01:46:13.423188 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0717 01:46:13.449015 64668 provision.go:87] duration metric: took 563.863228ms to configureAuth
I0717 01:46:13.449043 64668 buildroot.go:189] setting minikube options for container-runtime
I0717 01:46:13.449232 64668 config.go:182] Loaded profile config "old-k8s-version-901761": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0717 01:46:13.449317 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:13.452270 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.452580 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.452610 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.452754 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:13.452971 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:13.453137 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:13.453323 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:13.453485 64668 main.go:141] libmachine: Using SSH client type: native
I0717 01:46:13.453639 64668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.50.44 22 <nil> <nil>}
I0717 01:46:13.453660 64668 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0717 01:46:13.725251 64668 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0717 01:46:13.725280 64668 main.go:141] libmachine: Checking connection to Docker...
I0717 01:46:13.725291 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetURL
I0717 01:46:13.726481 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | Using libvirt version 6000000
I0717 01:46:13.728850 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.729200 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.729225 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.729414 64668 main.go:141] libmachine: Docker is up and running!
I0717 01:46:13.729436 64668 main.go:141] libmachine: Reticulating splines...
I0717 01:46:13.729442 64668 client.go:171] duration metric: took 28.252463476s to LocalClient.Create
I0717 01:46:13.729467 64668 start.go:167] duration metric: took 28.25254241s to libmachine.API.Create "old-k8s-version-901761"
I0717 01:46:13.729481 64668 start.go:293] postStartSetup for "old-k8s-version-901761" (driver="kvm2")
I0717 01:46:13.729497 64668 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0717 01:46:13.729517 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:13.729794 64668 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0717 01:46:13.729828 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:13.731967 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.732262 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.732307 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.732364 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:13.732522 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:13.732667 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:13.732800 64668 sshutil.go:53] new ssh client: &{IP:192.168.50.44 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa Username:docker}
I0717 01:46:13.817299 64668 ssh_runner.go:195] Run: cat /etc/os-release
I0717 01:46:13.821567 64668 info.go:137] Remote host: Buildroot 2023.02.9
I0717 01:46:13.821591 64668 filesync.go:126] Scanning /home/jenkins/minikube-integration/19264-3908/.minikube/addons for local assets ...
I0717 01:46:13.821680 64668 filesync.go:126] Scanning /home/jenkins/minikube-integration/19264-3908/.minikube/files for local assets ...
I0717 01:46:13.821795 64668 filesync.go:149] local asset: /home/jenkins/minikube-integration/19264-3908/.minikube/files/etc/ssl/certs/112592.pem -> 112592.pem in /etc/ssl/certs
I0717 01:46:13.821919 64668 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0717 01:46:13.831113 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/files/etc/ssl/certs/112592.pem --> /etc/ssl/certs/112592.pem (1708 bytes)
I0717 01:46:13.857758 64668 start.go:296] duration metric: took 128.261473ms for postStartSetup
I0717 01:46:13.857824 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetConfigRaw
I0717 01:46:13.862149 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetIP
I0717 01:46:13.864968 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.865301 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.865325 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.865593 64668 profile.go:143] Saving config to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/config.json ...
I0717 01:46:13.880841 64668 start.go:128] duration metric: took 28.425055364s to createHost
I0717 01:46:13.880881 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:13.883478 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.883848 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.883885 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.884076 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:13.884288 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:13.884447 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:13.884602 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:13.884792 64668 main.go:141] libmachine: Using SSH client type: native
I0717 01:46:13.884994 64668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.50.44 22 <nil> <nil>}
I0717 01:46:13.885008 64668 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0717 01:46:13.995342 64668 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721180773.973823223
I0717 01:46:13.995364 64668 fix.go:216] guest clock: 1721180773.973823223
I0717 01:46:13.995375 64668 fix.go:229] Guest: 2024-07-17 01:46:13.973823223 +0000 UTC Remote: 2024-07-17 01:46:13.880863653 +0000 UTC m=+41.928723400 (delta=92.95957ms)
I0717 01:46:13.995425 64668 fix.go:200] guest clock delta is within tolerance: 92.95957ms
I0717 01:46:13.995434 64668 start.go:83] releasing machines lock for "old-k8s-version-901761", held for 28.539808532s
I0717 01:46:13.995460 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:13.995677 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetIP
I0717 01:46:13.998477 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.998843 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:13.998882 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:13.999045 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:13.999519 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:13.999662 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .DriverName
I0717 01:46:13.999736 64668 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0717 01:46:13.999781 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:13.999840 64668 ssh_runner.go:195] Run: cat /version.json
I0717 01:46:13.999863 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHHostname
I0717 01:46:14.002192 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:14.002416 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:14.002582 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:14.002612 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:14.002787 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:14.002819 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:14.002788 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:14.002995 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:14.003020 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHPort
I0717 01:46:14.003112 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHKeyPath
I0717 01:46:14.003163 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:14.003280 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetSSHUsername
I0717 01:46:14.003349 64668 sshutil.go:53] new ssh client: &{IP:192.168.50.44 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa Username:docker}
I0717 01:46:14.003656 64668 sshutil.go:53] new ssh client: &{IP:192.168.50.44 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19264-3908/.minikube/machines/old-k8s-version-901761/id_rsa Username:docker}
I0717 01:46:14.107043 64668 ssh_runner.go:195] Run: systemctl --version
I0717 01:46:14.115638 64668 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0717 01:46:14.371419 64668 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0717 01:46:14.380372 64668 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0717 01:46:14.380467 64668 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0717 01:46:14.405918 64668 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0717 01:46:14.405994 64668 start.go:495] detecting cgroup driver to use...
I0717 01:46:14.406075 64668 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0717 01:46:14.429216 64668 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0717 01:46:14.448147 64668 docker.go:217] disabling cri-docker service (if available) ...
I0717 01:46:14.448214 64668 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0717 01:46:14.465123 64668 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0717 01:46:14.481448 64668 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0717 01:46:14.635607 64668 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0717 01:46:14.805584 64668 docker.go:233] disabling docker service ...
I0717 01:46:14.805638 64668 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0717 01:46:14.820854 64668 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0717 01:46:14.834458 64668 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0717 01:46:14.971617 64668 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0717 01:46:15.093422 64668 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0717 01:46:15.108586 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0717 01:46:15.129240 64668 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0717 01:46:15.129303 64668 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:46:15.139963 64668 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0717 01:46:15.140046 64668 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:46:15.150211 64668 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:46:15.161768 64668 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:46:15.172411 64668 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0717 01:46:15.183310 64668 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0717 01:46:15.193417 64668 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0717 01:46:15.193471 64668 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0717 01:46:15.207778 64668 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0717 01:46:15.218245 64668 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 01:46:15.346696 64668 ssh_runner.go:195] Run: sudo systemctl restart crio
I0717 01:46:15.512102 64668 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0717 01:46:15.512157 64668 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0717 01:46:15.518160 64668 start.go:563] Will wait 60s for crictl version
I0717 01:46:15.518218 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:15.524389 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0717 01:46:15.583072 64668 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0717 01:46:15.583149 64668 ssh_runner.go:195] Run: crio --version
I0717 01:46:15.622842 64668 ssh_runner.go:195] Run: crio --version
I0717 01:46:15.666404 64668 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0717 01:46:15.667602 64668 main.go:141] libmachine: (old-k8s-version-901761) Calling .GetIP
I0717 01:46:15.670939 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:15.671450 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8f:84:01", ip: ""} in network mk-old-k8s-version-901761: {Iface:virbr1 ExpiryTime:2024-07-17 02:46:00 +0000 UTC Type:0 Mac:52:54:00:8f:84:01 Iaid: IPaddr:192.168.50.44 Prefix:24 Hostname:old-k8s-version-901761 Clientid:01:52:54:00:8f:84:01}
I0717 01:46:15.671481 64668 main.go:141] libmachine: (old-k8s-version-901761) DBG | domain old-k8s-version-901761 has defined IP address 192.168.50.44 and MAC address 52:54:00:8f:84:01 in network mk-old-k8s-version-901761
I0717 01:46:15.671827 64668 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0717 01:46:15.677353 64668 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 01:46:15.694711 64668 kubeadm.go:883] updating cluster {Name:old-k8s-version-901761 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-901761 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.44 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0717 01:46:15.694850 64668 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 01:46:15.694958 64668 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 01:46:15.739715 64668 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 01:46:15.739799 64668 ssh_runner.go:195] Run: which lz4
I0717 01:46:15.744960 64668 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0717 01:46:15.750485 64668 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0717 01:46:15.750516 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0717 01:46:17.652671 64668 crio.go:462] duration metric: took 1.907747596s to copy over tarball
I0717 01:46:17.652831 64668 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0717 01:46:20.411649 64668 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.758772933s)
I0717 01:46:20.411678 64668 crio.go:469] duration metric: took 2.75891114s to extract the tarball
I0717 01:46:20.411686 64668 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0717 01:46:20.456428 64668 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 01:46:20.512331 64668 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 01:46:20.512353 64668 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0717 01:46:20.512415 64668 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 01:46:20.512445 64668 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:46:20.512466 64668 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0717 01:46:20.512425 64668 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:46:20.512491 64668 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0717 01:46:20.512422 64668 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0717 01:46:20.512474 64668 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0717 01:46:20.512473 64668 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:46:20.514012 64668 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0717 01:46:20.514035 64668 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0717 01:46:20.514023 64668 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0717 01:46:20.514063 64668 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:46:20.514014 64668 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 01:46:20.514015 64668 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:46:20.514104 64668 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:46:20.514161 64668 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0717 01:46:20.671524 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:46:20.680806 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:46:20.698516 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0717 01:46:20.699369 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:46:20.700420 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0717 01:46:20.702410 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0717 01:46:20.730701 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0717 01:46:20.779553 64668 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0717 01:46:20.779660 64668 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:46:20.779725 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.822185 64668 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0717 01:46:20.822237 64668 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:46:20.822291 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.867670 64668 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0717 01:46:20.867717 64668 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0717 01:46:20.867743 64668 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0717 01:46:20.867776 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.867774 64668 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:46:20.867912 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.867801 64668 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0717 01:46:20.867983 64668 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0717 01:46:20.867862 64668 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0717 01:46:20.868009 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.868026 64668 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0717 01:46:20.868069 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.883302 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:46:20.883338 64668 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0717 01:46:20.883358 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:46:20.883371 64668 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0717 01:46:20.883398 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0717 01:46:20.883401 64668 ssh_runner.go:195] Run: which crictl
I0717 01:46:20.883986 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0717 01:46:20.884061 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0717 01:46:20.884861 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:46:21.025372 64668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0717 01:46:21.025400 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0717 01:46:21.025444 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0717 01:46:21.025487 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0717 01:46:21.025554 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0717 01:46:21.025604 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0717 01:46:21.025648 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0717 01:46:21.063305 64668 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0717 01:46:21.806335 64668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0717 01:46:21.949840 64668 cache_images.go:92] duration metric: took 1.437470927s to LoadCachedImages
W0717 01:46:21.949965 64668 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19264-3908/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0717 01:46:21.949983 64668 kubeadm.go:934] updating node { 192.168.50.44 8443 v1.20.0 crio true true} ...
I0717 01:46:21.950099 64668 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-901761 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.44
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-901761 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0717 01:46:21.950184 64668 ssh_runner.go:195] Run: crio config
I0717 01:46:22.011370 64668 cni.go:84] Creating CNI manager for ""
I0717 01:46:22.011399 64668 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 01:46:22.011414 64668 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0717 01:46:22.011450 64668 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.44 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-901761 NodeName:old-k8s-version-901761 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.44"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.44 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0717 01:46:22.011615 64668 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.44
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-901761"
kubeletExtraArgs:
node-ip: 192.168.50.44
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.44"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0717 01:46:22.011685 64668 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0717 01:46:22.023637 64668 binaries.go:44] Found k8s binaries, skipping transfer
I0717 01:46:22.023703 64668 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0717 01:46:22.035427 64668 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0717 01:46:22.054641 64668 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0717 01:46:22.074540 64668 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0717 01:46:22.096500 64668 ssh_runner.go:195] Run: grep 192.168.50.44 control-plane.minikube.internal$ /etc/hosts
I0717 01:46:22.101558 64668 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.44 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 01:46:22.114508 64668 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 01:46:22.247773 64668 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0717 01:46:22.269026 64668 certs.go:68] Setting up /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761 for IP: 192.168.50.44
I0717 01:46:22.269052 64668 certs.go:194] generating shared ca certs ...
I0717 01:46:22.269067 64668 certs.go:226] acquiring lock for ca certs: {Name:mkc74cfd5a99c9dac635b1a438fee23ce449c2c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.269203 64668 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19264-3908/.minikube/ca.key
I0717 01:46:22.269241 64668 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19264-3908/.minikube/proxy-client-ca.key
I0717 01:46:22.269249 64668 certs.go:256] generating profile certs ...
I0717 01:46:22.269295 64668 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/client.key
I0717 01:46:22.269308 64668 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/client.crt with IP's: []
I0717 01:46:22.634015 64668 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/client.crt ...
I0717 01:46:22.634056 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/client.crt: {Name:mk22d52e2eee694141b8e52a4c5696978ee5e5cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.634261 64668 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/client.key ...
I0717 01:46:22.634279 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/client.key: {Name:mk3362e7f7eac75d8cdde5aa87fe8c540e0a473d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.634364 64668 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.key.f41162e5
I0717 01:46:22.634381 64668 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.crt.f41162e5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.44]
I0717 01:46:22.744463 64668 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.crt.f41162e5 ...
I0717 01:46:22.744495 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.crt.f41162e5: {Name:mkeac2c7580c10156b32edbc5217cc1477c3bdf9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.746646 64668 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.key.f41162e5 ...
I0717 01:46:22.746675 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.key.f41162e5: {Name:mkb29240c1afe356d078a465af7526b92e02c5b9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.746801 64668 certs.go:381] copying /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.crt.f41162e5 -> /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.crt
I0717 01:46:22.746905 64668 certs.go:385] copying /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.key.f41162e5 -> /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.key
I0717 01:46:22.746976 64668 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.key
I0717 01:46:22.746995 64668 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.crt with IP's: []
I0717 01:46:22.929984 64668 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.crt ...
I0717 01:46:22.930011 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.crt: {Name:mkf59a9cf8df71e1db0ddd7bd150c8ae5df3748d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.930196 64668 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.key ...
I0717 01:46:22.930212 64668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.key: {Name:mkf9d8ed48db6a4d09aae71eae2edf26e71e94f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:46:22.930422 64668 certs.go:484] found cert: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/11259.pem (1338 bytes)
W0717 01:46:22.930457 64668 certs.go:480] ignoring /home/jenkins/minikube-integration/19264-3908/.minikube/certs/11259_empty.pem, impossibly tiny 0 bytes
I0717 01:46:22.930467 64668 certs.go:484] found cert: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca-key.pem (1675 bytes)
I0717 01:46:22.930485 64668 certs.go:484] found cert: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/ca.pem (1078 bytes)
I0717 01:46:22.930504 64668 certs.go:484] found cert: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/cert.pem (1123 bytes)
I0717 01:46:22.930532 64668 certs.go:484] found cert: /home/jenkins/minikube-integration/19264-3908/.minikube/certs/key.pem (1675 bytes)
I0717 01:46:22.930580 64668 certs.go:484] found cert: /home/jenkins/minikube-integration/19264-3908/.minikube/files/etc/ssl/certs/112592.pem (1708 bytes)
I0717 01:46:22.931098 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0717 01:46:22.962619 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0717 01:46:22.991839 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0717 01:46:23.018942 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0717 01:46:23.046485 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0717 01:46:23.072994 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0717 01:46:23.099309 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0717 01:46:23.127979 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/profiles/old-k8s-version-901761/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0717 01:46:23.194954 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/files/etc/ssl/certs/112592.pem --> /usr/share/ca-certificates/112592.pem (1708 bytes)
I0717 01:46:23.231769 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0717 01:46:23.261566 64668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19264-3908/.minikube/certs/11259.pem --> /usr/share/ca-certificates/11259.pem (1338 bytes)
I0717 01:46:23.291466 64668 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0717 01:46:23.314020 64668 ssh_runner.go:195] Run: openssl version
I0717 01:46:23.320058 64668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/112592.pem && ln -fs /usr/share/ca-certificates/112592.pem /etc/ssl/certs/112592.pem"
I0717 01:46:23.330969 64668 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/112592.pem
I0717 01:46:23.335702 64668 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 17 00:37 /usr/share/ca-certificates/112592.pem
I0717 01:46:23.335770 64668 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/112592.pem
I0717 01:46:23.342046 64668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/112592.pem /etc/ssl/certs/3ec20f2e.0"
I0717 01:46:23.352860 64668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0717 01:46:23.363797 64668 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0717 01:46:23.368598 64668 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 17 00:24 /usr/share/ca-certificates/minikubeCA.pem
I0717 01:46:23.368653 64668 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0717 01:46:23.374411 64668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0717 01:46:23.385551 64668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11259.pem && ln -fs /usr/share/ca-certificates/11259.pem /etc/ssl/certs/11259.pem"
I0717 01:46:23.396209 64668 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11259.pem
I0717 01:46:23.400978 64668 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 17 00:37 /usr/share/ca-certificates/11259.pem
I0717 01:46:23.401041 64668 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11259.pem
I0717 01:46:23.407314 64668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11259.pem /etc/ssl/certs/51391683.0"
I0717 01:46:23.418227 64668 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0717 01:46:23.423509 64668 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0717 01:46:23.423555 64668 kubeadm.go:392] StartCluster: {Name:old-k8s-version-901761 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-901761 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.44 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 01:46:23.423642 64668 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0717 01:46:23.423692 64668 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0717 01:46:23.462616 64668 cri.go:89] found id: ""
I0717 01:46:23.462695 64668 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0717 01:46:23.473094 64668 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0717 01:46:23.483479 64668 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 01:46:23.496634 64668 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 01:46:23.496658 64668 kubeadm.go:157] found existing configuration files:
I0717 01:46:23.496713 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 01:46:23.507349 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 01:46:23.507417 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 01:46:23.523682 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 01:46:23.534743 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 01:46:23.534816 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 01:46:23.544815 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 01:46:23.554877 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 01:46:23.554952 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 01:46:23.567714 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 01:46:23.580020 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 01:46:23.580098 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 01:46:23.591331 64668 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 01:46:23.708042 64668 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 01:46:23.708126 64668 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 01:46:23.856499 64668 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 01:46:23.856692 64668 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 01:46:23.856831 64668 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 01:46:24.111187 64668 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 01:46:24.113883 64668 out.go:204] - Generating certificates and keys ...
I0717 01:46:24.114019 64668 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 01:46:24.114129 64668 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 01:46:24.418936 64668 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0717 01:46:24.573278 64668 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0717 01:46:24.733305 64668 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0717 01:46:24.982668 64668 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0717 01:46:25.094937 64668 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0717 01:46:25.095446 64668 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-901761] and IPs [192.168.50.44 127.0.0.1 ::1]
I0717 01:46:25.294917 64668 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0717 01:46:25.295337 64668 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-901761] and IPs [192.168.50.44 127.0.0.1 ::1]
I0717 01:46:25.426768 64668 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0717 01:46:25.755365 64668 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0717 01:46:25.917283 64668 kubeadm.go:310] [certs] Generating "sa" key and public key
I0717 01:46:25.917582 64668 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 01:46:26.298878 64668 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 01:46:26.652916 64668 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 01:46:26.785974 64668 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 01:46:27.275401 64668 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 01:46:27.299490 64668 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 01:46:27.299616 64668 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 01:46:27.299662 64668 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 01:46:27.482655 64668 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 01:46:27.484437 64668 out.go:204] - Booting up control plane ...
I0717 01:46:27.484540 64668 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 01:46:27.502686 64668 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 01:46:27.504660 64668 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 01:46:27.506063 64668 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 01:46:27.511744 64668 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 01:47:07.508464 64668 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 01:47:07.508707 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:47:07.508895 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:47:12.509285 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:47:12.509542 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:47:22.509225 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:47:22.509508 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:47:42.509381 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:47:42.509558 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:48:22.512006 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:48:22.512430 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:48:22.512441 64668 kubeadm.go:310]
I0717 01:48:22.512554 64668 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 01:48:22.512661 64668 kubeadm.go:310] timed out waiting for the condition
I0717 01:48:22.512676 64668 kubeadm.go:310]
I0717 01:48:22.512757 64668 kubeadm.go:310] This error is likely caused by:
I0717 01:48:22.512838 64668 kubeadm.go:310] - The kubelet is not running
I0717 01:48:22.513084 64668 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 01:48:22.513103 64668 kubeadm.go:310]
I0717 01:48:22.513349 64668 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 01:48:22.513433 64668 kubeadm.go:310] - 'systemctl status kubelet'
I0717 01:48:22.513511 64668 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 01:48:22.513524 64668 kubeadm.go:310]
I0717 01:48:22.513771 64668 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 01:48:22.513991 64668 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 01:48:22.514037 64668 kubeadm.go:310]
I0717 01:48:22.514361 64668 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 01:48:22.514532 64668 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 01:48:22.514753 64668 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 01:48:22.515007 64668 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 01:48:22.515027 64668 kubeadm.go:310]
I0717 01:48:22.515460 64668 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 01:48:22.515613 64668 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 01:48:22.515713 64668 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0717 01:48:22.515866 64668 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-901761] and IPs [192.168.50.44 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-901761] and IPs [192.168.50.44 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-901761] and IPs [192.168.50.44 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-901761] and IPs [192.168.50.44 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0717 01:48:22.515908 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0717 01:48:23.264997 64668 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0717 01:48:23.279167 64668 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 01:48:23.289273 64668 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 01:48:23.289292 64668 kubeadm.go:157] found existing configuration files:
I0717 01:48:23.289338 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 01:48:23.298794 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 01:48:23.298856 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 01:48:23.309084 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 01:48:23.318366 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 01:48:23.318416 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 01:48:23.328684 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 01:48:23.337772 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 01:48:23.337820 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 01:48:23.357069 64668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 01:48:23.367399 64668 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 01:48:23.367468 64668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 01:48:23.376850 64668 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 01:48:23.450173 64668 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 01:48:23.450296 64668 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 01:48:23.594766 64668 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 01:48:23.594882 64668 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 01:48:23.595002 64668 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 01:48:23.789844 64668 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 01:48:23.791777 64668 out.go:204] - Generating certificates and keys ...
I0717 01:48:23.791871 64668 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 01:48:23.791926 64668 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 01:48:23.792024 64668 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0717 01:48:23.792116 64668 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0717 01:48:23.792222 64668 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0717 01:48:23.792284 64668 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0717 01:48:23.792370 64668 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0717 01:48:23.792443 64668 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0717 01:48:23.792815 64668 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0717 01:48:23.793730 64668 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0717 01:48:23.793900 64668 kubeadm.go:310] [certs] Using the existing "sa" key
I0717 01:48:23.793979 64668 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 01:48:24.088771 64668 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 01:48:24.280820 64668 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 01:48:24.553826 64668 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 01:48:24.708537 64668 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 01:48:24.722925 64668 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 01:48:24.725141 64668 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 01:48:24.725335 64668 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 01:48:24.864767 64668 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 01:48:24.866562 64668 out.go:204] - Booting up control plane ...
I0717 01:48:24.866689 64668 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 01:48:24.875144 64668 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 01:48:24.875985 64668 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 01:48:24.876813 64668 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 01:48:24.878932 64668 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 01:49:04.882131 64668 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 01:49:04.882493 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:49:04.882749 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:49:09.883393 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:49:09.883579 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:49:19.883417 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:49:19.883676 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:49:39.882270 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:49:39.882480 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:50:19.881693 64668 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:50:19.881854 64668 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:50:19.881863 64668 kubeadm.go:310]
I0717 01:50:19.881903 64668 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 01:50:19.881933 64668 kubeadm.go:310] timed out waiting for the condition
I0717 01:50:19.881960 64668 kubeadm.go:310]
I0717 01:50:19.882046 64668 kubeadm.go:310] This error is likely caused by:
I0717 01:50:19.882091 64668 kubeadm.go:310] - The kubelet is not running
I0717 01:50:19.882188 64668 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 01:50:19.882212 64668 kubeadm.go:310]
I0717 01:50:19.882353 64668 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 01:50:19.882394 64668 kubeadm.go:310] - 'systemctl status kubelet'
I0717 01:50:19.882430 64668 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 01:50:19.882439 64668 kubeadm.go:310]
I0717 01:50:19.882580 64668 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 01:50:19.882673 64668 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 01:50:19.882681 64668 kubeadm.go:310]
I0717 01:50:19.882827 64668 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 01:50:19.882918 64668 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 01:50:19.882976 64668 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 01:50:19.883035 64668 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 01:50:19.883041 64668 kubeadm.go:310]
I0717 01:50:19.884015 64668 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 01:50:19.884098 64668 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 01:50:19.884195 64668 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0717 01:50:19.884253 64668 kubeadm.go:394] duration metric: took 3m56.460697669s to StartCluster
I0717 01:50:19.884289 64668 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0717 01:50:19.884335 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0717 01:50:19.924737 64668 cri.go:89] found id: ""
I0717 01:50:19.924764 64668 logs.go:276] 0 containers: []
W0717 01:50:19.924772 64668 logs.go:278] No container was found matching "kube-apiserver"
I0717 01:50:19.924778 64668 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0717 01:50:19.924827 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0717 01:50:19.973161 64668 cri.go:89] found id: ""
I0717 01:50:19.973188 64668 logs.go:276] 0 containers: []
W0717 01:50:19.973198 64668 logs.go:278] No container was found matching "etcd"
I0717 01:50:19.973205 64668 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0717 01:50:19.973262 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0717 01:50:20.018848 64668 cri.go:89] found id: ""
I0717 01:50:20.018878 64668 logs.go:276] 0 containers: []
W0717 01:50:20.018889 64668 logs.go:278] No container was found matching "coredns"
I0717 01:50:20.018896 64668 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0717 01:50:20.018955 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0717 01:50:20.053365 64668 cri.go:89] found id: ""
I0717 01:50:20.053387 64668 logs.go:276] 0 containers: []
W0717 01:50:20.053396 64668 logs.go:278] No container was found matching "kube-scheduler"
I0717 01:50:20.053401 64668 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0717 01:50:20.053447 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0717 01:50:20.086729 64668 cri.go:89] found id: ""
I0717 01:50:20.086752 64668 logs.go:276] 0 containers: []
W0717 01:50:20.086760 64668 logs.go:278] No container was found matching "kube-proxy"
I0717 01:50:20.086764 64668 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0717 01:50:20.086810 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0717 01:50:20.121028 64668 cri.go:89] found id: ""
I0717 01:50:20.121055 64668 logs.go:276] 0 containers: []
W0717 01:50:20.121062 64668 logs.go:278] No container was found matching "kube-controller-manager"
I0717 01:50:20.121068 64668 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0717 01:50:20.121117 64668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0717 01:50:20.155203 64668 cri.go:89] found id: ""
I0717 01:50:20.155223 64668 logs.go:276] 0 containers: []
W0717 01:50:20.155230 64668 logs.go:278] No container was found matching "kindnet"
I0717 01:50:20.155239 64668 logs.go:123] Gathering logs for CRI-O ...
I0717 01:50:20.155253 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0717 01:50:20.253015 64668 logs.go:123] Gathering logs for container status ...
I0717 01:50:20.253050 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0717 01:50:20.295010 64668 logs.go:123] Gathering logs for kubelet ...
I0717 01:50:20.295042 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0717 01:50:20.346041 64668 logs.go:123] Gathering logs for dmesg ...
I0717 01:50:20.346071 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0717 01:50:20.359652 64668 logs.go:123] Gathering logs for describe nodes ...
I0717 01:50:20.359677 64668 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0717 01:50:20.482145 64668 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0717 01:50:20.482191 64668 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 01:50:20.482234 64668 out.go:239] *
*
W0717 01:50:20.482289 64668 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 01:50:20.482322 64668 out.go:239] *
*
W0717 01:50:20.483212 64668 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0717 01:50:20.486125 64668 out.go:177]
W0717 01:50:20.487385 64668 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 01:50:20.487425 64668 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0717 01:50:20.487449 64668 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0717 01:50:20.489120 64668 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-901761 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-901761 -n old-k8s-version-901761
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-901761 -n old-k8s-version-901761: exit status 6 (223.79239ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0717 01:50:20.754020 71001 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-901761" does not appear in /home/jenkins/minikube-integration/19264-3908/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-901761" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (288.82s)