=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-847766 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-847766 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m55.918999175s)
-- stdout --
* [old-k8s-version-847766] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20091
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20091-7083/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20091-7083/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-847766" primary control-plane node in "old-k8s-version-847766" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1216 20:48:41.992075 56531 out.go:345] Setting OutFile to fd 1 ...
I1216 20:48:41.992212 56531 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1216 20:48:41.992225 56531 out.go:358] Setting ErrFile to fd 2...
I1216 20:48:41.992232 56531 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1216 20:48:41.992552 56531 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20091-7083/.minikube/bin
I1216 20:48:41.993441 56531 out.go:352] Setting JSON to false
I1216 20:48:41.994920 56531 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":5467,"bootTime":1734376655,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1216 20:48:41.995065 56531 start.go:139] virtualization: kvm guest
I1216 20:48:41.997665 56531 out.go:177] * [old-k8s-version-847766] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I1216 20:48:41.999347 56531 notify.go:220] Checking for updates...
I1216 20:48:41.999397 56531 out.go:177] - MINIKUBE_LOCATION=20091
I1216 20:48:42.001199 56531 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1216 20:48:42.002803 56531 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20091-7083/kubeconfig
I1216 20:48:42.004373 56531 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20091-7083/.minikube
I1216 20:48:42.005894 56531 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1216 20:48:42.007333 56531 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1216 20:48:42.009712 56531 config.go:182] Loaded profile config "cert-expiration-270954": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1216 20:48:42.009849 56531 config.go:182] Loaded profile config "kubernetes-upgrade-560677": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I1216 20:48:42.009998 56531 config.go:182] Loaded profile config "stopped-upgrade-976873": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I1216 20:48:42.010120 56531 driver.go:394] Setting default libvirt URI to qemu:///system
I1216 20:48:42.050061 56531 out.go:177] * Using the kvm2 driver based on user configuration
I1216 20:48:42.051434 56531 start.go:297] selected driver: kvm2
I1216 20:48:42.051448 56531 start.go:901] validating driver "kvm2" against <nil>
I1216 20:48:42.051460 56531 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1216 20:48:42.052246 56531 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1216 20:48:42.052332 56531 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20091-7083/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1216 20:48:42.069188 56531 install.go:137] /home/jenkins/minikube-integration/20091-7083/.minikube/bin/docker-machine-driver-kvm2 version is 1.34.0
I1216 20:48:42.069260 56531 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1216 20:48:42.069577 56531 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1216 20:48:42.069609 56531 cni.go:84] Creating CNI manager for ""
I1216 20:48:42.069667 56531 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1216 20:48:42.069681 56531 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1216 20:48:42.069734 56531 start.go:340] cluster config:
{Name:old-k8s-version-847766 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-847766 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1216 20:48:42.069857 56531 iso.go:125] acquiring lock: {Name:mk60ed2ba7ed00047edacd09f4f6bf84214f0831 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1216 20:48:42.072016 56531 out.go:177] * Starting "old-k8s-version-847766" primary control-plane node in "old-k8s-version-847766" cluster
I1216 20:48:42.073638 56531 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1216 20:48:42.073694 56531 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I1216 20:48:42.073704 56531 cache.go:56] Caching tarball of preloaded images
I1216 20:48:42.073773 56531 preload.go:172] Found /home/jenkins/minikube-integration/20091-7083/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1216 20:48:42.073784 56531 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I1216 20:48:42.073905 56531 profile.go:143] Saving config to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/config.json ...
I1216 20:48:42.073930 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/config.json: {Name:mkd0337f60e9db1a361ad5bec3bef3ef58698e23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:48:42.074093 56531 start.go:360] acquireMachinesLock for old-k8s-version-847766: {Name:mk014ce1133f8d018fee1f78c9c31a354da6dd77 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1216 20:49:06.888208 56531 start.go:364] duration metric: took 24.81406333s to acquireMachinesLock for "old-k8s-version-847766"
I1216 20:49:06.888348 56531 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-847766 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20090/minikube-v1.34.0-1734029574-20090-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-847766 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1216 20:49:06.888466 56531 start.go:125] createHost starting for "" (driver="kvm2")
I1216 20:49:06.890518 56531 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1216 20:49:06.890707 56531 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/20091-7083/.minikube/bin/docker-machine-driver-kvm2
I1216 20:49:06.890784 56531 main.go:141] libmachine: Launching plugin server for driver kvm2
I1216 20:49:06.910956 56531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43289
I1216 20:49:06.911505 56531 main.go:141] libmachine: () Calling .GetVersion
I1216 20:49:06.912162 56531 main.go:141] libmachine: Using API Version 1
I1216 20:49:06.912189 56531 main.go:141] libmachine: () Calling .SetConfigRaw
I1216 20:49:06.912581 56531 main.go:141] libmachine: () Calling .GetMachineName
I1216 20:49:06.912795 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetMachineName
I1216 20:49:06.912957 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:06.913132 56531 start.go:159] libmachine.API.Create for "old-k8s-version-847766" (driver="kvm2")
I1216 20:49:06.913167 56531 client.go:168] LocalClient.Create starting
I1216 20:49:06.913241 56531 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca.pem
I1216 20:49:06.913301 56531 main.go:141] libmachine: Decoding PEM data...
I1216 20:49:06.913326 56531 main.go:141] libmachine: Parsing certificate...
I1216 20:49:06.913419 56531 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20091-7083/.minikube/certs/cert.pem
I1216 20:49:06.913452 56531 main.go:141] libmachine: Decoding PEM data...
I1216 20:49:06.913472 56531 main.go:141] libmachine: Parsing certificate...
I1216 20:49:06.913493 56531 main.go:141] libmachine: Running pre-create checks...
I1216 20:49:06.913512 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .PreCreateCheck
I1216 20:49:06.913930 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetConfigRaw
I1216 20:49:06.914332 56531 main.go:141] libmachine: Creating machine...
I1216 20:49:06.914346 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .Create
I1216 20:49:06.914490 56531 main.go:141] libmachine: (old-k8s-version-847766) Creating KVM machine...
I1216 20:49:06.915657 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found existing default KVM network
I1216 20:49:06.917169 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:06.917007 56867 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:4d:64:1b} reservation:<nil>}
I1216 20:49:06.917882 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:06.917798 56867 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:99:57:ff} reservation:<nil>}
I1216 20:49:06.918801 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:06.918751 56867 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:26:ec:2a} reservation:<nil>}
I1216 20:49:06.919934 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:06.919849 56867 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003090f0}
I1216 20:49:06.919957 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | created network xml:
I1216 20:49:06.919968 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | <network>
I1216 20:49:06.919976 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | <name>mk-old-k8s-version-847766</name>
I1216 20:49:06.919986 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | <dns enable='no'/>
I1216 20:49:06.919998 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG |
I1216 20:49:06.920013 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I1216 20:49:06.920034 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | <dhcp>
I1216 20:49:06.920049 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I1216 20:49:06.920063 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | </dhcp>
I1216 20:49:06.920073 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | </ip>
I1216 20:49:06.920082 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG |
I1216 20:49:06.920093 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | </network>
I1216 20:49:06.920106 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG |
I1216 20:49:06.925946 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | trying to create private KVM network mk-old-k8s-version-847766 192.168.72.0/24...
I1216 20:49:07.000617 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | private KVM network mk-old-k8s-version-847766 192.168.72.0/24 created
I1216 20:49:07.000649 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting up store path in /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766 ...
I1216 20:49:07.000677 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:07.000611 56867 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/20091-7083/.minikube
I1216 20:49:07.000689 56531 main.go:141] libmachine: (old-k8s-version-847766) Building disk image from file:///home/jenkins/minikube-integration/20091-7083/.minikube/cache/iso/amd64/minikube-v1.34.0-1734029574-20090-amd64.iso
I1216 20:49:07.000778 56531 main.go:141] libmachine: (old-k8s-version-847766) Downloading /home/jenkins/minikube-integration/20091-7083/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20091-7083/.minikube/cache/iso/amd64/minikube-v1.34.0-1734029574-20090-amd64.iso...
I1216 20:49:07.246293 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:07.246153 56867 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa...
I1216 20:49:07.352795 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:07.352675 56867 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/old-k8s-version-847766.rawdisk...
I1216 20:49:07.352827 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Writing magic tar header
I1216 20:49:07.352842 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Writing SSH key tar header
I1216 20:49:07.352856 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:07.352783 56867 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766 ...
I1216 20:49:07.352873 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766
I1216 20:49:07.352947 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting executable bit set on /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766 (perms=drwx------)
I1216 20:49:07.352985 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting executable bit set on /home/jenkins/minikube-integration/20091-7083/.minikube/machines (perms=drwxr-xr-x)
I1216 20:49:07.353001 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/20091-7083/.minikube/machines
I1216 20:49:07.353018 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/20091-7083/.minikube
I1216 20:49:07.353027 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/20091-7083
I1216 20:49:07.353051 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I1216 20:49:07.353064 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home/jenkins
I1216 20:49:07.353075 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting executable bit set on /home/jenkins/minikube-integration/20091-7083/.minikube (perms=drwxr-xr-x)
I1216 20:49:07.353088 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Checking permissions on dir: /home
I1216 20:49:07.353103 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Skipping /home - not owner
I1216 20:49:07.353120 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting executable bit set on /home/jenkins/minikube-integration/20091-7083 (perms=drwxrwxr-x)
I1216 20:49:07.353134 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I1216 20:49:07.353147 56531 main.go:141] libmachine: (old-k8s-version-847766) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I1216 20:49:07.353160 56531 main.go:141] libmachine: (old-k8s-version-847766) Creating domain...
I1216 20:49:07.354181 56531 main.go:141] libmachine: (old-k8s-version-847766) define libvirt domain using xml:
I1216 20:49:07.354204 56531 main.go:141] libmachine: (old-k8s-version-847766) <domain type='kvm'>
I1216 20:49:07.354220 56531 main.go:141] libmachine: (old-k8s-version-847766) <name>old-k8s-version-847766</name>
I1216 20:49:07.354242 56531 main.go:141] libmachine: (old-k8s-version-847766) <memory unit='MiB'>2200</memory>
I1216 20:49:07.354252 56531 main.go:141] libmachine: (old-k8s-version-847766) <vcpu>2</vcpu>
I1216 20:49:07.354263 56531 main.go:141] libmachine: (old-k8s-version-847766) <features>
I1216 20:49:07.354274 56531 main.go:141] libmachine: (old-k8s-version-847766) <acpi/>
I1216 20:49:07.354286 56531 main.go:141] libmachine: (old-k8s-version-847766) <apic/>
I1216 20:49:07.354291 56531 main.go:141] libmachine: (old-k8s-version-847766) <pae/>
I1216 20:49:07.354295 56531 main.go:141] libmachine: (old-k8s-version-847766)
I1216 20:49:07.354300 56531 main.go:141] libmachine: (old-k8s-version-847766) </features>
I1216 20:49:07.354307 56531 main.go:141] libmachine: (old-k8s-version-847766) <cpu mode='host-passthrough'>
I1216 20:49:07.354312 56531 main.go:141] libmachine: (old-k8s-version-847766)
I1216 20:49:07.354317 56531 main.go:141] libmachine: (old-k8s-version-847766) </cpu>
I1216 20:49:07.354327 56531 main.go:141] libmachine: (old-k8s-version-847766) <os>
I1216 20:49:07.354337 56531 main.go:141] libmachine: (old-k8s-version-847766) <type>hvm</type>
I1216 20:49:07.354349 56531 main.go:141] libmachine: (old-k8s-version-847766) <boot dev='cdrom'/>
I1216 20:49:07.354357 56531 main.go:141] libmachine: (old-k8s-version-847766) <boot dev='hd'/>
I1216 20:49:07.354368 56531 main.go:141] libmachine: (old-k8s-version-847766) <bootmenu enable='no'/>
I1216 20:49:07.354382 56531 main.go:141] libmachine: (old-k8s-version-847766) </os>
I1216 20:49:07.354390 56531 main.go:141] libmachine: (old-k8s-version-847766) <devices>
I1216 20:49:07.354395 56531 main.go:141] libmachine: (old-k8s-version-847766) <disk type='file' device='cdrom'>
I1216 20:49:07.354405 56531 main.go:141] libmachine: (old-k8s-version-847766) <source file='/home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/boot2docker.iso'/>
I1216 20:49:07.354410 56531 main.go:141] libmachine: (old-k8s-version-847766) <target dev='hdc' bus='scsi'/>
I1216 20:49:07.354420 56531 main.go:141] libmachine: (old-k8s-version-847766) <readonly/>
I1216 20:49:07.354426 56531 main.go:141] libmachine: (old-k8s-version-847766) </disk>
I1216 20:49:07.354440 56531 main.go:141] libmachine: (old-k8s-version-847766) <disk type='file' device='disk'>
I1216 20:49:07.354456 56531 main.go:141] libmachine: (old-k8s-version-847766) <driver name='qemu' type='raw' cache='default' io='threads' />
I1216 20:49:07.354472 56531 main.go:141] libmachine: (old-k8s-version-847766) <source file='/home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/old-k8s-version-847766.rawdisk'/>
I1216 20:49:07.354479 56531 main.go:141] libmachine: (old-k8s-version-847766) <target dev='hda' bus='virtio'/>
I1216 20:49:07.354486 56531 main.go:141] libmachine: (old-k8s-version-847766) </disk>
I1216 20:49:07.354494 56531 main.go:141] libmachine: (old-k8s-version-847766) <interface type='network'>
I1216 20:49:07.354500 56531 main.go:141] libmachine: (old-k8s-version-847766) <source network='mk-old-k8s-version-847766'/>
I1216 20:49:07.354509 56531 main.go:141] libmachine: (old-k8s-version-847766) <model type='virtio'/>
I1216 20:49:07.354522 56531 main.go:141] libmachine: (old-k8s-version-847766) </interface>
I1216 20:49:07.354537 56531 main.go:141] libmachine: (old-k8s-version-847766) <interface type='network'>
I1216 20:49:07.354559 56531 main.go:141] libmachine: (old-k8s-version-847766) <source network='default'/>
I1216 20:49:07.354569 56531 main.go:141] libmachine: (old-k8s-version-847766) <model type='virtio'/>
I1216 20:49:07.354575 56531 main.go:141] libmachine: (old-k8s-version-847766) </interface>
I1216 20:49:07.354580 56531 main.go:141] libmachine: (old-k8s-version-847766) <serial type='pty'>
I1216 20:49:07.354586 56531 main.go:141] libmachine: (old-k8s-version-847766) <target port='0'/>
I1216 20:49:07.354592 56531 main.go:141] libmachine: (old-k8s-version-847766) </serial>
I1216 20:49:07.354600 56531 main.go:141] libmachine: (old-k8s-version-847766) <console type='pty'>
I1216 20:49:07.354616 56531 main.go:141] libmachine: (old-k8s-version-847766) <target type='serial' port='0'/>
I1216 20:49:07.354628 56531 main.go:141] libmachine: (old-k8s-version-847766) </console>
I1216 20:49:07.354639 56531 main.go:141] libmachine: (old-k8s-version-847766) <rng model='virtio'>
I1216 20:49:07.354648 56531 main.go:141] libmachine: (old-k8s-version-847766) <backend model='random'>/dev/random</backend>
I1216 20:49:07.354657 56531 main.go:141] libmachine: (old-k8s-version-847766) </rng>
I1216 20:49:07.354665 56531 main.go:141] libmachine: (old-k8s-version-847766)
I1216 20:49:07.354674 56531 main.go:141] libmachine: (old-k8s-version-847766)
I1216 20:49:07.354679 56531 main.go:141] libmachine: (old-k8s-version-847766) </devices>
I1216 20:49:07.354693 56531 main.go:141] libmachine: (old-k8s-version-847766) </domain>
I1216 20:49:07.354707 56531 main.go:141] libmachine: (old-k8s-version-847766)
I1216 20:49:07.359394 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:e7:ba:32 in network default
I1216 20:49:07.359979 56531 main.go:141] libmachine: (old-k8s-version-847766) Ensuring networks are active...
I1216 20:49:07.360000 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:07.360632 56531 main.go:141] libmachine: (old-k8s-version-847766) Ensuring network default is active
I1216 20:49:07.361002 56531 main.go:141] libmachine: (old-k8s-version-847766) Ensuring network mk-old-k8s-version-847766 is active
I1216 20:49:07.361644 56531 main.go:141] libmachine: (old-k8s-version-847766) Getting domain xml...
I1216 20:49:07.362511 56531 main.go:141] libmachine: (old-k8s-version-847766) Creating domain...
I1216 20:49:08.621121 56531 main.go:141] libmachine: (old-k8s-version-847766) Waiting to get IP...
I1216 20:49:08.621892 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:08.622335 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:08.622388 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:08.622336 56867 retry.go:31] will retry after 226.226751ms: waiting for machine to come up
I1216 20:49:08.849768 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:08.850240 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:08.850265 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:08.850210 56867 retry.go:31] will retry after 324.730569ms: waiting for machine to come up
I1216 20:49:09.176862 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:09.177452 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:09.177476 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:09.177409 56867 retry.go:31] will retry after 321.708299ms: waiting for machine to come up
I1216 20:49:09.500921 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:09.501442 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:09.501469 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:09.501382 56867 retry.go:31] will retry after 480.830696ms: waiting for machine to come up
I1216 20:49:09.984093 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:09.984560 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:09.984583 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:09.984527 56867 retry.go:31] will retry after 522.805446ms: waiting for machine to come up
I1216 20:49:10.509272 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:10.509750 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:10.509804 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:10.509705 56867 retry.go:31] will retry after 593.443336ms: waiting for machine to come up
I1216 20:49:11.104390 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:11.105170 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:11.105202 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:11.105120 56867 retry.go:31] will retry after 852.201692ms: waiting for machine to come up
I1216 20:49:11.959515 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:11.960393 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:11.960449 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:11.960346 56867 retry.go:31] will retry after 1.064028002s: waiting for machine to come up
I1216 20:49:13.025820 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:13.026427 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:13.026482 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:13.026380 56867 retry.go:31] will retry after 1.630445443s: waiting for machine to come up
I1216 20:49:14.659296 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:14.659750 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:14.659781 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:14.659702 56867 retry.go:31] will retry after 1.991362325s: waiting for machine to come up
I1216 20:49:16.652359 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:16.652961 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:16.652991 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:16.652887 56867 retry.go:31] will retry after 1.971734539s: waiting for machine to come up
I1216 20:49:18.625925 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:18.626450 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:18.626471 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:18.626407 56867 retry.go:31] will retry after 3.627882909s: waiting for machine to come up
I1216 20:49:22.256120 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:22.256548 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:22.256573 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:22.256523 56867 retry.go:31] will retry after 2.863726326s: waiting for machine to come up
I1216 20:49:25.121707 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:25.122339 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find current IP address of domain old-k8s-version-847766 in network mk-old-k8s-version-847766
I1216 20:49:25.122372 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | I1216 20:49:25.122277 56867 retry.go:31] will retry after 4.944629647s: waiting for machine to come up
I1216 20:49:30.070529 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.071253 56531 main.go:141] libmachine: (old-k8s-version-847766) Found IP for machine: 192.168.72.240
I1216 20:49:30.071311 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has current primary IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.071320 56531 main.go:141] libmachine: (old-k8s-version-847766) Reserving static IP address...
I1216 20:49:30.071809 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-847766", mac: "52:54:00:c4:f2:8a", ip: "192.168.72.240"} in network mk-old-k8s-version-847766
I1216 20:49:30.157116 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Getting to WaitForSSH function...
I1216 20:49:30.157156 56531 main.go:141] libmachine: (old-k8s-version-847766) Reserved static IP address: 192.168.72.240
I1216 20:49:30.157190 56531 main.go:141] libmachine: (old-k8s-version-847766) Waiting for SSH to be available...
I1216 20:49:30.160374 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.160880 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.160919 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.161202 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Using SSH client type: external
I1216 20:49:30.161234 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Using SSH private key: /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa (-rw-------)
I1216 20:49:30.161266 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.240 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa -p 22] /usr/bin/ssh <nil>}
I1216 20:49:30.161281 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | About to run SSH command:
I1216 20:49:30.161296 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | exit 0
I1216 20:49:30.292031 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | SSH cmd err, output: <nil>:
I1216 20:49:30.292329 56531 main.go:141] libmachine: (old-k8s-version-847766) KVM machine creation complete!
I1216 20:49:30.292677 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetConfigRaw
I1216 20:49:30.293223 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:30.293435 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:30.293608 56531 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1216 20:49:30.293625 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetState
I1216 20:49:30.294879 56531 main.go:141] libmachine: Detecting operating system of created instance...
I1216 20:49:30.294897 56531 main.go:141] libmachine: Waiting for SSH to be available...
I1216 20:49:30.294904 56531 main.go:141] libmachine: Getting to WaitForSSH function...
I1216 20:49:30.294912 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:30.297649 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.298048 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.298082 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.298190 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:30.298400 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.298542 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.298681 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:30.298856 56531 main.go:141] libmachine: Using SSH client type: native
I1216 20:49:30.299044 56531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I1216 20:49:30.299055 56531 main.go:141] libmachine: About to run SSH command:
exit 0
I1216 20:49:30.414806 56531 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1216 20:49:30.414829 56531 main.go:141] libmachine: Detecting the provisioner...
I1216 20:49:30.414837 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:30.417985 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.418343 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.418380 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.418554 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:30.418787 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.419001 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.419220 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:30.419439 56531 main.go:141] libmachine: Using SSH client type: native
I1216 20:49:30.419662 56531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I1216 20:49:30.419677 56531 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1216 20:49:30.532486 56531 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1216 20:49:30.532602 56531 main.go:141] libmachine: found compatible host: buildroot
I1216 20:49:30.532618 56531 main.go:141] libmachine: Provisioning with buildroot...
I1216 20:49:30.532635 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetMachineName
I1216 20:49:30.532944 56531 buildroot.go:166] provisioning hostname "old-k8s-version-847766"
I1216 20:49:30.532965 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetMachineName
I1216 20:49:30.533184 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:30.535663 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.535995 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.536016 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.536175 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:30.536385 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.536544 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.536669 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:30.536823 56531 main.go:141] libmachine: Using SSH client type: native
I1216 20:49:30.537007 56531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I1216 20:49:30.537029 56531 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-847766 && echo "old-k8s-version-847766" | sudo tee /etc/hostname
I1216 20:49:30.664728 56531 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-847766
I1216 20:49:30.664766 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:30.667814 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.668216 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.668246 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.668441 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:30.668643 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.668837 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:30.668994 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:30.669184 56531 main.go:141] libmachine: Using SSH client type: native
I1216 20:49:30.669376 56531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I1216 20:49:30.669393 56531 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-847766' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-847766/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-847766' | sudo tee -a /etc/hosts;
fi
fi
I1216 20:49:30.794470 56531 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1216 20:49:30.794510 56531 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20091-7083/.minikube CaCertPath:/home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20091-7083/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20091-7083/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20091-7083/.minikube}
I1216 20:49:30.794573 56531 buildroot.go:174] setting up certificates
I1216 20:49:30.794585 56531 provision.go:84] configureAuth start
I1216 20:49:30.794601 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetMachineName
I1216 20:49:30.794916 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetIP
I1216 20:49:30.797955 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.798427 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.798464 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.798673 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:30.801149 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.801535 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:30.801562 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:30.801743 56531 provision.go:143] copyHostCerts
I1216 20:49:30.801806 56531 exec_runner.go:144] found /home/jenkins/minikube-integration/20091-7083/.minikube/cert.pem, removing ...
I1216 20:49:30.801819 56531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20091-7083/.minikube/cert.pem
I1216 20:49:30.801883 56531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20091-7083/.minikube/cert.pem (1123 bytes)
I1216 20:49:30.802032 56531 exec_runner.go:144] found /home/jenkins/minikube-integration/20091-7083/.minikube/key.pem, removing ...
I1216 20:49:30.802042 56531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20091-7083/.minikube/key.pem
I1216 20:49:30.802069 56531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20091-7083/.minikube/key.pem (1679 bytes)
I1216 20:49:30.802142 56531 exec_runner.go:144] found /home/jenkins/minikube-integration/20091-7083/.minikube/ca.pem, removing ...
I1216 20:49:30.802152 56531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20091-7083/.minikube/ca.pem
I1216 20:49:30.802175 56531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20091-7083/.minikube/ca.pem (1082 bytes)
I1216 20:49:30.802236 56531 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20091-7083/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-847766 san=[127.0.0.1 192.168.72.240 localhost minikube old-k8s-version-847766]
I1216 20:49:31.228980 56531 provision.go:177] copyRemoteCerts
I1216 20:49:31.229054 56531 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1216 20:49:31.229076 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:31.232415 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.232827 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.232862 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.233200 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:31.233473 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.233680 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:31.233864 56531 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa Username:docker}
I1216 20:49:31.322485 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1216 20:49:31.354171 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1216 20:49:31.387444 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1216 20:49:31.416157 56531 provision.go:87] duration metric: took 621.536959ms to configureAuth
I1216 20:49:31.416197 56531 buildroot.go:189] setting minikube options for container-runtime
I1216 20:49:31.416410 56531 config.go:182] Loaded profile config "old-k8s-version-847766": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I1216 20:49:31.416519 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:31.419643 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.420124 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.420159 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.420359 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:31.420579 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.420756 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.420897 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:31.421112 56531 main.go:141] libmachine: Using SSH client type: native
I1216 20:49:31.421312 56531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I1216 20:49:31.421329 56531 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1216 20:49:31.667226 56531 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1216 20:49:31.667281 56531 main.go:141] libmachine: Checking connection to Docker...
I1216 20:49:31.667292 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetURL
I1216 20:49:31.668781 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | Using libvirt version 6000000
I1216 20:49:31.671072 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.671458 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.671501 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.671689 56531 main.go:141] libmachine: Docker is up and running!
I1216 20:49:31.671716 56531 main.go:141] libmachine: Reticulating splines...
I1216 20:49:31.671724 56531 client.go:171] duration metric: took 24.758545738s to LocalClient.Create
I1216 20:49:31.671751 56531 start.go:167] duration metric: took 24.758627557s to libmachine.API.Create "old-k8s-version-847766"
I1216 20:49:31.671765 56531 start.go:293] postStartSetup for "old-k8s-version-847766" (driver="kvm2")
I1216 20:49:31.671779 56531 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1216 20:49:31.671803 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:31.672095 56531 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1216 20:49:31.672119 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:31.674300 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.674618 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.674653 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.674762 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:31.674932 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.675094 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:31.675262 56531 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa Username:docker}
I1216 20:49:31.762996 56531 ssh_runner.go:195] Run: cat /etc/os-release
I1216 20:49:31.767798 56531 info.go:137] Remote host: Buildroot 2023.02.9
I1216 20:49:31.767829 56531 filesync.go:126] Scanning /home/jenkins/minikube-integration/20091-7083/.minikube/addons for local assets ...
I1216 20:49:31.767903 56531 filesync.go:126] Scanning /home/jenkins/minikube-integration/20091-7083/.minikube/files for local assets ...
I1216 20:49:31.768025 56531 filesync.go:149] local asset: /home/jenkins/minikube-integration/20091-7083/.minikube/files/etc/ssl/certs/142542.pem -> 142542.pem in /etc/ssl/certs
I1216 20:49:31.768158 56531 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1216 20:49:31.779402 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/files/etc/ssl/certs/142542.pem --> /etc/ssl/certs/142542.pem (1708 bytes)
I1216 20:49:31.806127 56531 start.go:296] duration metric: took 134.344822ms for postStartSetup
I1216 20:49:31.806190 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetConfigRaw
I1216 20:49:31.806828 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetIP
I1216 20:49:31.809823 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.810273 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.810298 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.810604 56531 profile.go:143] Saving config to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/config.json ...
I1216 20:49:31.810818 56531 start.go:128] duration metric: took 24.922339536s to createHost
I1216 20:49:31.810844 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:31.813281 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.813715 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.813748 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.814016 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:31.814258 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.814477 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.814658 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:31.814907 56531 main.go:141] libmachine: Using SSH client type: native
I1216 20:49:31.815136 56531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I1216 20:49:31.815158 56531 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1216 20:49:31.940756 56531 main.go:141] libmachine: SSH cmd err, output: <nil>: 1734382171.895455278
I1216 20:49:31.940789 56531 fix.go:216] guest clock: 1734382171.895455278
I1216 20:49:31.940802 56531 fix.go:229] Guest: 2024-12-16 20:49:31.895455278 +0000 UTC Remote: 2024-12-16 20:49:31.810832048 +0000 UTC m=+49.859631765 (delta=84.62323ms)
I1216 20:49:31.940865 56531 fix.go:200] guest clock delta is within tolerance: 84.62323ms
I1216 20:49:31.940877 56531 start.go:83] releasing machines lock for "old-k8s-version-847766", held for 25.052605458s
I1216 20:49:31.940912 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:31.941194 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetIP
I1216 20:49:31.944387 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.944805 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.944844 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.945085 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:31.945648 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:31.945876 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .DriverName
I1216 20:49:31.945964 56531 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1216 20:49:31.946048 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:31.946153 56531 ssh_runner.go:195] Run: cat /version.json
I1216 20:49:31.946209 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHHostname
I1216 20:49:31.949465 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.949949 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.949988 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.950324 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:31.950574 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.950733 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.950774 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:31.950806 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:31.950856 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:31.951016 56531 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa Username:docker}
I1216 20:49:31.951355 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHPort
I1216 20:49:31.951561 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHKeyPath
I1216 20:49:31.951753 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetSSHUsername
I1216 20:49:31.951981 56531 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20091-7083/.minikube/machines/old-k8s-version-847766/id_rsa Username:docker}
I1216 20:49:32.064629 56531 ssh_runner.go:195] Run: systemctl --version
I1216 20:49:32.071675 56531 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1216 20:49:32.240567 56531 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1216 20:49:32.247987 56531 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1216 20:49:32.248053 56531 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1216 20:49:32.267477 56531 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1216 20:49:32.267505 56531 start.go:495] detecting cgroup driver to use...
I1216 20:49:32.267577 56531 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1216 20:49:32.292307 56531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1216 20:49:32.308242 56531 docker.go:217] disabling cri-docker service (if available) ...
I1216 20:49:32.308320 56531 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1216 20:49:32.324207 56531 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1216 20:49:32.340574 56531 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1216 20:49:32.485270 56531 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1216 20:49:32.671882 56531 docker.go:233] disabling docker service ...
I1216 20:49:32.671953 56531 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1216 20:49:32.689705 56531 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1216 20:49:32.705597 56531 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1216 20:49:32.867340 56531 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1216 20:49:33.054306 56531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1216 20:49:33.072305 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1216 20:49:33.096159 56531 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I1216 20:49:33.096218 56531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I1216 20:49:33.112165 56531 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1216 20:49:33.112230 56531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1216 20:49:33.124419 56531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1216 20:49:33.139874 56531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1216 20:49:33.156255 56531 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1216 20:49:33.171439 56531 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1216 20:49:33.183572 56531 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1216 20:49:33.183646 56531 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1216 20:49:33.206172 56531 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1216 20:49:33.222327 56531 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1216 20:49:33.366560 56531 ssh_runner.go:195] Run: sudo systemctl restart crio
I1216 20:49:33.474097 56531 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I1216 20:49:33.474177 56531 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1216 20:49:33.479649 56531 start.go:563] Will wait 60s for crictl version
I1216 20:49:33.479725 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:33.484026 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1216 20:49:33.545486 56531 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I1216 20:49:33.545579 56531 ssh_runner.go:195] Run: crio --version
I1216 20:49:33.580082 56531 ssh_runner.go:195] Run: crio --version
I1216 20:49:33.620437 56531 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I1216 20:49:33.621929 56531 main.go:141] libmachine: (old-k8s-version-847766) Calling .GetIP
I1216 20:49:33.625124 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:33.625529 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c4:f2:8a", ip: ""} in network mk-old-k8s-version-847766: {Iface:virbr4 ExpiryTime:2024-12-16 21:49:23 +0000 UTC Type:0 Mac:52:54:00:c4:f2:8a Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-847766 Clientid:01:52:54:00:c4:f2:8a}
I1216 20:49:33.625562 56531 main.go:141] libmachine: (old-k8s-version-847766) DBG | domain old-k8s-version-847766 has defined IP address 192.168.72.240 and MAC address 52:54:00:c4:f2:8a in network mk-old-k8s-version-847766
I1216 20:49:33.625792 56531 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I1216 20:49:33.631857 56531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1216 20:49:33.645867 56531 kubeadm.go:883] updating cluster {Name:old-k8s-version-847766 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20090/minikube-v1.34.0-1734029574-20090-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-847766 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.240 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1216 20:49:33.646014 56531 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1216 20:49:33.646084 56531 ssh_runner.go:195] Run: sudo crictl images --output json
I1216 20:49:33.688285 56531 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1216 20:49:33.688374 56531 ssh_runner.go:195] Run: which lz4
I1216 20:49:33.693991 56531 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I1216 20:49:33.698661 56531 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1216 20:49:33.698698 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I1216 20:49:35.539198 56531 crio.go:462] duration metric: took 1.845242896s to copy over tarball
I1216 20:49:35.539322 56531 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I1216 20:49:38.373242 56531 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.833883979s)
I1216 20:49:38.373283 56531 crio.go:469] duration metric: took 2.834048362s to extract the tarball
I1216 20:49:38.373294 56531 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1216 20:49:38.421281 56531 ssh_runner.go:195] Run: sudo crictl images --output json
I1216 20:49:38.592770 56531 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1216 20:49:38.592804 56531 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I1216 20:49:38.592856 56531 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I1216 20:49:38.592907 56531 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:38.592935 56531 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I1216 20:49:38.592972 56531 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I1216 20:49:38.593155 56531 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I1216 20:49:38.593165 56531 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:38.593170 56531 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:38.593244 56531 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:38.594547 56531 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:38.594582 56531 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:38.594607 56531 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:38.594613 56531 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I1216 20:49:38.594633 56531 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:38.594644 56531 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I1216 20:49:38.594698 56531 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I1216 20:49:38.594710 56531 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I1216 20:49:38.784643 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:38.817492 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I1216 20:49:38.820204 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:38.823847 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I1216 20:49:38.836163 56531 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I1216 20:49:38.836212 56531 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:38.836249 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:38.848477 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I1216 20:49:38.901816 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:38.913492 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:38.943280 56531 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I1216 20:49:38.943337 56531 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I1216 20:49:38.943397 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:38.943418 56531 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I1216 20:49:38.943458 56531 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:38.943523 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:38.951348 56531 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I1216 20:49:38.951385 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:38.951397 56531 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I1216 20:49:38.951435 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:38.995047 56531 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I1216 20:49:38.995114 56531 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I1216 20:49:38.995167 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:39.011688 56531 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I1216 20:49:39.036321 56531 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I1216 20:49:39.036362 56531 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:39.036407 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:39.036412 56531 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I1216 20:49:39.036452 56531 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:39.036497 56531 ssh_runner.go:195] Run: which crictl
I1216 20:49:39.036525 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1216 20:49:39.036557 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:39.036588 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1216 20:49:39.061033 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:39.061081 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1216 20:49:39.268715 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:39.268775 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:39.268822 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1216 20:49:39.268888 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1216 20:49:39.268909 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:39.268976 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1216 20:49:39.269003 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1216 20:49:39.428104 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1216 20:49:39.428152 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1216 20:49:39.428200 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:39.428228 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:39.428256 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I1216 20:49:39.428331 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1216 20:49:39.428483 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1216 20:49:39.542834 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I1216 20:49:39.553237 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I1216 20:49:39.554709 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1216 20:49:39.554729 56531 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1216 20:49:39.560655 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I1216 20:49:39.560697 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I1216 20:49:39.610889 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I1216 20:49:39.612694 56531 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I1216 20:49:39.612747 56531 cache_images.go:92] duration metric: took 1.019930851s to LoadCachedImages
W1216 20:49:39.612825 56531 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20091-7083/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I1216 20:49:39.612841 56531 kubeadm.go:934] updating node { 192.168.72.240 8443 v1.20.0 crio true true} ...
I1216 20:49:39.612983 56531 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-847766 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.240
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-847766 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1216 20:49:39.613062 56531 ssh_runner.go:195] Run: crio config
I1216 20:49:39.665201 56531 cni.go:84] Creating CNI manager for ""
I1216 20:49:39.665232 56531 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1216 20:49:39.665244 56531 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1216 20:49:39.665265 56531 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.240 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-847766 NodeName:old-k8s-version-847766 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.240"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.240 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1216 20:49:39.665408 56531 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.240
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-847766"
kubeletExtraArgs:
node-ip: 192.168.72.240
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.240"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1216 20:49:39.665465 56531 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1216 20:49:39.675824 56531 binaries.go:44] Found k8s binaries, skipping transfer
I1216 20:49:39.675887 56531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1216 20:49:39.686107 56531 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I1216 20:49:39.703746 56531 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1216 20:49:39.720998 56531 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I1216 20:49:39.741871 56531 ssh_runner.go:195] Run: grep 192.168.72.240 control-plane.minikube.internal$ /etc/hosts
I1216 20:49:39.747296 56531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.240 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1216 20:49:39.762495 56531 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1216 20:49:39.896834 56531 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1216 20:49:39.915118 56531 certs.go:68] Setting up /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766 for IP: 192.168.72.240
I1216 20:49:39.915142 56531 certs.go:194] generating shared ca certs ...
I1216 20:49:39.915163 56531 certs.go:226] acquiring lock for ca certs: {Name:mk7f8f83a04be3d39897a025f51d4d8228b5a509 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:39.915358 56531 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20091-7083/.minikube/ca.key
I1216 20:49:39.915399 56531 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20091-7083/.minikube/proxy-client-ca.key
I1216 20:49:39.915406 56531 certs.go:256] generating profile certs ...
I1216 20:49:39.915473 56531 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/client.key
I1216 20:49:39.915502 56531 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/client.crt with IP's: []
I1216 20:49:39.987915 56531 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/client.crt ...
I1216 20:49:39.987951 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/client.crt: {Name:mk1b3cb29709881f505e20ebed154122396e997a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:39.988147 56531 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/client.key ...
I1216 20:49:39.988167 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/client.key: {Name:mke44337bded7eaafc49a0d47a7b3425df020e7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:39.988279 56531 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.key.6c8704df
I1216 20:49:39.988300 56531 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.crt.6c8704df with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.240]
I1216 20:49:40.295443 56531 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.crt.6c8704df ...
I1216 20:49:40.295484 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.crt.6c8704df: {Name:mk232487c862ec228ef6989676c146335af7baf9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:40.295680 56531 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.key.6c8704df ...
I1216 20:49:40.295698 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.key.6c8704df: {Name:mkf65e89456c49009688dd53057c1791551574d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:40.295799 56531 certs.go:381] copying /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.crt.6c8704df -> /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.crt
I1216 20:49:40.295893 56531 certs.go:385] copying /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.key.6c8704df -> /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.key
I1216 20:49:40.295970 56531 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.key
I1216 20:49:40.295995 56531 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.crt with IP's: []
I1216 20:49:40.404276 56531 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.crt ...
I1216 20:49:40.404308 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.crt: {Name:mk77caa74d193d4defbb3235785fc2b444b7a7b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:40.442338 56531 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.key ...
I1216 20:49:40.442381 56531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.key: {Name:mk97e44419ef6855e928d6392f9fd28fb9baf09c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1216 20:49:40.442606 56531 certs.go:484] found cert: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/14254.pem (1338 bytes)
W1216 20:49:40.442668 56531 certs.go:480] ignoring /home/jenkins/minikube-integration/20091-7083/.minikube/certs/14254_empty.pem, impossibly tiny 0 bytes
I1216 20:49:40.442685 56531 certs.go:484] found cert: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca-key.pem (1679 bytes)
I1216 20:49:40.442726 56531 certs.go:484] found cert: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/ca.pem (1082 bytes)
I1216 20:49:40.442760 56531 certs.go:484] found cert: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/cert.pem (1123 bytes)
I1216 20:49:40.442798 56531 certs.go:484] found cert: /home/jenkins/minikube-integration/20091-7083/.minikube/certs/key.pem (1679 bytes)
I1216 20:49:40.442854 56531 certs.go:484] found cert: /home/jenkins/minikube-integration/20091-7083/.minikube/files/etc/ssl/certs/142542.pem (1708 bytes)
I1216 20:49:40.443492 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1216 20:49:40.472119 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1216 20:49:40.497991 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1216 20:49:40.523528 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1216 20:49:40.548863 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1216 20:49:40.582718 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1216 20:49:40.608389 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1216 20:49:40.634836 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/profiles/old-k8s-version-847766/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1216 20:49:40.661381 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1216 20:49:40.687619 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/certs/14254.pem --> /usr/share/ca-certificates/14254.pem (1338 bytes)
I1216 20:49:40.713124 56531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20091-7083/.minikube/files/etc/ssl/certs/142542.pem --> /usr/share/ca-certificates/142542.pem (1708 bytes)
I1216 20:49:40.739606 56531 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1216 20:49:40.760923 56531 ssh_runner.go:195] Run: openssl version
I1216 20:49:40.776674 56531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/142542.pem && ln -fs /usr/share/ca-certificates/142542.pem /etc/ssl/certs/142542.pem"
I1216 20:49:40.795440 56531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/142542.pem
I1216 20:49:40.804634 56531 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Dec 16 19:42 /usr/share/ca-certificates/142542.pem
I1216 20:49:40.804711 56531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/142542.pem
I1216 20:49:40.816878 56531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/142542.pem /etc/ssl/certs/3ec20f2e.0"
I1216 20:49:40.830987 56531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1216 20:49:40.843838 56531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1216 20:49:40.848859 56531 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 16 19:35 /usr/share/ca-certificates/minikubeCA.pem
I1216 20:49:40.848933 56531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1216 20:49:40.857201 56531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1216 20:49:40.869306 56531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14254.pem && ln -fs /usr/share/ca-certificates/14254.pem /etc/ssl/certs/14254.pem"
I1216 20:49:40.881995 56531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14254.pem
I1216 20:49:40.888201 56531 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Dec 16 19:42 /usr/share/ca-certificates/14254.pem
I1216 20:49:40.888286 56531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14254.pem
I1216 20:49:40.895874 56531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/14254.pem /etc/ssl/certs/51391683.0"
I1216 20:49:40.912742 56531 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1216 20:49:40.917878 56531 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1216 20:49:40.917944 56531 kubeadm.go:392] StartCluster: {Name:old-k8s-version-847766 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20090/minikube-v1.34.0-1734029574-20090-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-847766 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.240 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1216 20:49:40.918036 56531 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1216 20:49:40.918093 56531 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1216 20:49:40.963021 56531 cri.go:89] found id: ""
I1216 20:49:40.963104 56531 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1216 20:49:40.974677 56531 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1216 20:49:40.985702 56531 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1216 20:49:40.996723 56531 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1216 20:49:40.996744 56531 kubeadm.go:157] found existing configuration files:
I1216 20:49:40.996789 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1216 20:49:41.007593 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1216 20:49:41.007664 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1216 20:49:41.018265 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1216 20:49:41.028526 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1216 20:49:41.028591 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1216 20:49:41.038611 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1216 20:49:41.050726 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1216 20:49:41.050806 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1216 20:49:41.060798 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1216 20:49:41.070487 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1216 20:49:41.070557 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1216 20:49:41.081942 56531 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1216 20:49:41.378999 56531 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1216 20:51:38.834144 56531 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1216 20:51:38.834302 56531 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I1216 20:51:38.835839 56531 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1216 20:51:38.835891 56531 kubeadm.go:310] [preflight] Running pre-flight checks
I1216 20:51:38.835979 56531 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1216 20:51:38.836168 56531 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1216 20:51:38.836301 56531 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1216 20:51:38.836422 56531 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1216 20:51:38.837911 56531 out.go:235] - Generating certificates and keys ...
I1216 20:51:38.838021 56531 kubeadm.go:310] [certs] Using existing ca certificate authority
I1216 20:51:38.838105 56531 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1216 20:51:38.838208 56531 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1216 20:51:38.838284 56531 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1216 20:51:38.838370 56531 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1216 20:51:38.838436 56531 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1216 20:51:38.838508 56531 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1216 20:51:38.838675 56531 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-847766] and IPs [192.168.72.240 127.0.0.1 ::1]
I1216 20:51:38.838746 56531 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1216 20:51:38.838916 56531 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-847766] and IPs [192.168.72.240 127.0.0.1 ::1]
I1216 20:51:38.839004 56531 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1216 20:51:38.839089 56531 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1216 20:51:38.839157 56531 kubeadm.go:310] [certs] Generating "sa" key and public key
I1216 20:51:38.839232 56531 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1216 20:51:38.839319 56531 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1216 20:51:38.839401 56531 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1216 20:51:38.839488 56531 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1216 20:51:38.839560 56531 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1216 20:51:38.839674 56531 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1216 20:51:38.839796 56531 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1216 20:51:38.839865 56531 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1216 20:51:38.839954 56531 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1216 20:51:38.841525 56531 out.go:235] - Booting up control plane ...
I1216 20:51:38.841634 56531 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1216 20:51:38.841741 56531 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1216 20:51:38.841829 56531 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1216 20:51:38.841930 56531 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1216 20:51:38.842124 56531 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1216 20:51:38.842182 56531 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1216 20:51:38.842237 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:51:38.842415 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:51:38.842525 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:51:38.842709 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:51:38.842784 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:51:38.842938 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:51:38.843012 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:51:38.843179 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:51:38.843304 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:51:38.843513 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:51:38.843526 56531 kubeadm.go:310]
I1216 20:51:38.843558 56531 kubeadm.go:310] Unfortunately, an error has occurred:
I1216 20:51:38.843594 56531 kubeadm.go:310] timed out waiting for the condition
I1216 20:51:38.843614 56531 kubeadm.go:310]
I1216 20:51:38.843655 56531 kubeadm.go:310] This error is likely caused by:
I1216 20:51:38.843691 56531 kubeadm.go:310] - The kubelet is not running
I1216 20:51:38.843778 56531 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1216 20:51:38.843786 56531 kubeadm.go:310]
I1216 20:51:38.843891 56531 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1216 20:51:38.843957 56531 kubeadm.go:310] - 'systemctl status kubelet'
I1216 20:51:38.844011 56531 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1216 20:51:38.844021 56531 kubeadm.go:310]
I1216 20:51:38.844168 56531 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1216 20:51:38.844270 56531 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1216 20:51:38.844278 56531 kubeadm.go:310]
I1216 20:51:38.844360 56531 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1216 20:51:38.844479 56531 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1216 20:51:38.844615 56531 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1216 20:51:38.844715 56531 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1216 20:51:38.844743 56531 kubeadm.go:310]
W1216 20:51:38.844858 56531 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-847766] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-847766] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-847766] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-847766] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1216 20:51:38.844892 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I1216 20:51:40.574085 56531 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.729157865s)
I1216 20:51:40.574202 56531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1216 20:51:40.590747 56531 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1216 20:51:40.601309 56531 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1216 20:51:40.601333 56531 kubeadm.go:157] found existing configuration files:
I1216 20:51:40.601375 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1216 20:51:40.612319 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1216 20:51:40.612385 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1216 20:51:40.622605 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1216 20:51:40.632190 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1216 20:51:40.632260 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1216 20:51:40.643354 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1216 20:51:40.653552 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1216 20:51:40.653633 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1216 20:51:40.666051 56531 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1216 20:51:40.675867 56531 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1216 20:51:40.675944 56531 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1216 20:51:40.686413 56531 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1216 20:51:40.914165 56531 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1216 20:53:37.217618 56531 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1216 20:53:37.217710 56531 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I1216 20:53:37.219349 56531 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1216 20:53:37.219411 56531 kubeadm.go:310] [preflight] Running pre-flight checks
I1216 20:53:37.219504 56531 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1216 20:53:37.219624 56531 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1216 20:53:37.219735 56531 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1216 20:53:37.219797 56531 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1216 20:53:37.221817 56531 out.go:235] - Generating certificates and keys ...
I1216 20:53:37.221887 56531 kubeadm.go:310] [certs] Using existing ca certificate authority
I1216 20:53:37.221944 56531 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1216 20:53:37.222016 56531 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1216 20:53:37.222070 56531 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I1216 20:53:37.222134 56531 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I1216 20:53:37.222180 56531 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I1216 20:53:37.222237 56531 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I1216 20:53:37.222304 56531 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I1216 20:53:37.222372 56531 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1216 20:53:37.222439 56531 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1216 20:53:37.222473 56531 kubeadm.go:310] [certs] Using the existing "sa" key
I1216 20:53:37.222525 56531 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1216 20:53:37.222568 56531 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1216 20:53:37.222673 56531 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1216 20:53:37.222769 56531 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1216 20:53:37.222830 56531 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1216 20:53:37.222933 56531 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1216 20:53:37.223008 56531 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1216 20:53:37.223053 56531 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1216 20:53:37.223119 56531 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1216 20:53:37.224931 56531 out.go:235] - Booting up control plane ...
I1216 20:53:37.225040 56531 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1216 20:53:37.225129 56531 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1216 20:53:37.225196 56531 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1216 20:53:37.225275 56531 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1216 20:53:37.225436 56531 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1216 20:53:37.225487 56531 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1216 20:53:37.225548 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:53:37.225718 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:53:37.225783 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:53:37.225962 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:53:37.226040 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:53:37.226262 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:53:37.226364 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:53:37.226526 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:53:37.226586 56531 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1216 20:53:37.226747 56531 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1216 20:53:37.226755 56531 kubeadm.go:310]
I1216 20:53:37.226788 56531 kubeadm.go:310] Unfortunately, an error has occurred:
I1216 20:53:37.226836 56531 kubeadm.go:310] timed out waiting for the condition
I1216 20:53:37.226843 56531 kubeadm.go:310]
I1216 20:53:37.226876 56531 kubeadm.go:310] This error is likely caused by:
I1216 20:53:37.226910 56531 kubeadm.go:310] - The kubelet is not running
I1216 20:53:37.227002 56531 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1216 20:53:37.227008 56531 kubeadm.go:310]
I1216 20:53:37.227110 56531 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1216 20:53:37.227144 56531 kubeadm.go:310] - 'systemctl status kubelet'
I1216 20:53:37.227179 56531 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1216 20:53:37.227185 56531 kubeadm.go:310]
I1216 20:53:37.227335 56531 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1216 20:53:37.227448 56531 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1216 20:53:37.227456 56531 kubeadm.go:310]
I1216 20:53:37.227544 56531 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1216 20:53:37.227651 56531 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1216 20:53:37.227726 56531 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1216 20:53:37.227792 56531 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1216 20:53:37.227854 56531 kubeadm.go:394] duration metric: took 3m56.309916205s to StartCluster
I1216 20:53:37.227887 56531 kubeadm.go:310]
I1216 20:53:37.227911 56531 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1216 20:53:37.227966 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1216 20:53:37.273056 56531 cri.go:89] found id: ""
I1216 20:53:37.273091 56531 logs.go:282] 0 containers: []
W1216 20:53:37.273100 56531 logs.go:284] No container was found matching "kube-apiserver"
I1216 20:53:37.273106 56531 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1216 20:53:37.273157 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1216 20:53:37.309150 56531 cri.go:89] found id: ""
I1216 20:53:37.309187 56531 logs.go:282] 0 containers: []
W1216 20:53:37.309200 56531 logs.go:284] No container was found matching "etcd"
I1216 20:53:37.309209 56531 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1216 20:53:37.309278 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1216 20:53:37.346549 56531 cri.go:89] found id: ""
I1216 20:53:37.346580 56531 logs.go:282] 0 containers: []
W1216 20:53:37.346589 56531 logs.go:284] No container was found matching "coredns"
I1216 20:53:37.346597 56531 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1216 20:53:37.346663 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1216 20:53:37.383727 56531 cri.go:89] found id: ""
I1216 20:53:37.383756 56531 logs.go:282] 0 containers: []
W1216 20:53:37.383766 56531 logs.go:284] No container was found matching "kube-scheduler"
I1216 20:53:37.383775 56531 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1216 20:53:37.383839 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1216 20:53:37.422335 56531 cri.go:89] found id: ""
I1216 20:53:37.422368 56531 logs.go:282] 0 containers: []
W1216 20:53:37.422376 56531 logs.go:284] No container was found matching "kube-proxy"
I1216 20:53:37.422381 56531 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1216 20:53:37.422445 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1216 20:53:37.463896 56531 cri.go:89] found id: ""
I1216 20:53:37.463925 56531 logs.go:282] 0 containers: []
W1216 20:53:37.463933 56531 logs.go:284] No container was found matching "kube-controller-manager"
I1216 20:53:37.463938 56531 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1216 20:53:37.463985 56531 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1216 20:53:37.501187 56531 cri.go:89] found id: ""
I1216 20:53:37.501220 56531 logs.go:282] 0 containers: []
W1216 20:53:37.501231 56531 logs.go:284] No container was found matching "kindnet"
I1216 20:53:37.501244 56531 logs.go:123] Gathering logs for kubelet ...
I1216 20:53:37.501261 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1216 20:53:37.550941 56531 logs.go:123] Gathering logs for dmesg ...
I1216 20:53:37.550975 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1216 20:53:37.565963 56531 logs.go:123] Gathering logs for describe nodes ...
I1216 20:53:37.565993 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1216 20:53:37.700370 56531 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1216 20:53:37.700397 56531 logs.go:123] Gathering logs for CRI-O ...
I1216 20:53:37.700410 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1216 20:53:37.809100 56531 logs.go:123] Gathering logs for container status ...
I1216 20:53:37.809148 56531 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W1216 20:53:37.853441 56531 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1216 20:53:37.853507 56531 out.go:270] *
*
W1216 20:53:37.853561 56531 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1216 20:53:37.853577 56531 out.go:270] *
*
W1216 20:53:37.854491 56531 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1216 20:53:37.857839 56531 out.go:201]
W1216 20:53:37.859270 56531 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1216 20:53:37.859309 56531 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1216 20:53:37.859333 56531 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1216 20:53:37.860843 56531 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-847766 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-847766 -n old-k8s-version-847766
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-847766 -n old-k8s-version-847766: exit status 6 (236.775363ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1216 20:53:38.136584 59804 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-847766" does not appear in /home/jenkins/minikube-integration/20091-7083/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-847766" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (296.21s)