=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-335468 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-335468 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m36.171880121s)
-- stdout --
* [old-k8s-version-335468] minikube v1.36.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=21341
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21341-109162/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21341-109162/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-335468" primary control-plane node in "old-k8s-version-335468" cluster
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
-- /stdout --
** stderr **
I0903 23:35:18.039041 161984 out.go:360] Setting OutFile to fd 1 ...
I0903 23:35:18.039263 161984 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0903 23:35:18.039272 161984 out.go:374] Setting ErrFile to fd 2...
I0903 23:35:18.039276 161984 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0903 23:35:18.039485 161984 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21341-109162/.minikube/bin
I0903 23:35:18.040093 161984 out.go:368] Setting JSON to false
I0903 23:35:18.041204 161984 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":8262,"bootTime":1756934256,"procs":298,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1083-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0903 23:35:18.041264 161984 start.go:140] virtualization: kvm guest
I0903 23:35:18.043021 161984 out.go:179] * [old-k8s-version-335468] minikube v1.36.0 on Ubuntu 20.04 (kvm/amd64)
I0903 23:35:18.044495 161984 notify.go:220] Checking for updates...
I0903 23:35:18.044515 161984 out.go:179] - MINIKUBE_LOCATION=21341
I0903 23:35:18.045888 161984 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0903 23:35:18.046984 161984 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21341-109162/kubeconfig
I0903 23:35:18.048018 161984 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21341-109162/.minikube
I0903 23:35:18.049067 161984 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I0903 23:35:18.050188 161984 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I0903 23:35:18.051917 161984 config.go:182] Loaded profile config "bridge-380966": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0903 23:35:18.052073 161984 config.go:182] Loaded profile config "enable-default-cni-380966": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0903 23:35:18.052204 161984 config.go:182] Loaded profile config "flannel-380966": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0903 23:35:18.052345 161984 driver.go:421] Setting default libvirt URI to qemu:///system
I0903 23:35:18.096651 161984 out.go:179] * Using the kvm2 driver based on user configuration
I0903 23:35:18.097947 161984 start.go:304] selected driver: kvm2
I0903 23:35:18.097969 161984 start.go:918] validating driver "kvm2" against <nil>
I0903 23:35:18.097985 161984 start.go:929] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0903 23:35:18.099114 161984 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0903 23:35:18.099215 161984 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/21341-109162/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0903 23:35:18.122005 161984 install.go:137] /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2 version is 1.36.0
I0903 23:35:18.122079 161984 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I0903 23:35:18.122349 161984 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0903 23:35:18.122388 161984 cni.go:84] Creating CNI manager for ""
I0903 23:35:18.122437 161984 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0903 23:35:18.122447 161984 start_flags.go:336] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0903 23:35:18.122528 161984 start.go:348] cluster config:
{Name:old-k8s-version-335468 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-335468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHA
gentPID:0 GPUs: AutoPauseInterval:1m0s}
I0903 23:35:18.122693 161984 iso.go:125] acquiring lock: {Name:mk1032fbced3c9e76ba5a04480289e9f07d0eb9c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0903 23:35:18.124470 161984 out.go:179] * Starting "old-k8s-version-335468" primary control-plane node in "old-k8s-version-335468" cluster
I0903 23:35:18.125623 161984 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0903 23:35:18.125667 161984 preload.go:146] Found local preload: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0903 23:35:18.125675 161984 cache.go:58] Caching tarball of preloaded images
I0903 23:35:18.125758 161984 preload.go:172] Found /home/jenkins/minikube-integration/21341-109162/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0903 23:35:18.125771 161984 cache.go:61] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0903 23:35:18.125863 161984 profile.go:143] Saving config to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/config.json ...
I0903 23:35:18.125883 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/config.json: {Name:mk71decff7b8a487d7ca47735da709ca1e531539 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:18.126032 161984 start.go:360] acquireMachinesLock for old-k8s-version-335468: {Name:mkcbe368d68a51a2a3c0eadc653c4df7d9736b4b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0903 23:35:18.126062 161984 start.go:364] duration metric: took 16.268µs to acquireMachinesLock for "old-k8s-version-335468"
I0903 23:35:18.126077 161984 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-335468 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/21147/minikube-v1.36.0-1753487480-21147-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-335468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:do
cker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0903 23:35:18.126133 161984 start.go:125] createHost starting for "" (driver="kvm2")
I0903 23:35:18.127693 161984 out.go:252] * Creating kvm2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
I0903 23:35:18.127837 161984 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:35:18.127882 161984 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:35:18.145759 161984 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38561
I0903 23:35:18.146254 161984 main.go:141] libmachine: () Calling .GetVersion
I0903 23:35:18.146814 161984 main.go:141] libmachine: Using API Version 1
I0903 23:35:18.146837 161984 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:35:18.147257 161984 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:35:18.147472 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetMachineName
I0903 23:35:18.147659 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:18.147839 161984 start.go:159] libmachine.API.Create for "old-k8s-version-335468" (driver="kvm2")
I0903 23:35:18.147866 161984 client.go:168] LocalClient.Create starting
I0903 23:35:18.147900 161984 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem
I0903 23:35:18.147945 161984 main.go:141] libmachine: Decoding PEM data...
I0903 23:35:18.147958 161984 main.go:141] libmachine: Parsing certificate...
I0903 23:35:18.148006 161984 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21341-109162/.minikube/certs/cert.pem
I0903 23:35:18.148034 161984 main.go:141] libmachine: Decoding PEM data...
I0903 23:35:18.148046 161984 main.go:141] libmachine: Parsing certificate...
I0903 23:35:18.148065 161984 main.go:141] libmachine: Running pre-create checks...
I0903 23:35:18.148074 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .PreCreateCheck
I0903 23:35:18.148438 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetConfigRaw
I0903 23:35:18.148896 161984 main.go:141] libmachine: Creating machine...
I0903 23:35:18.148913 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .Create
I0903 23:35:18.149067 161984 main.go:141] libmachine: (old-k8s-version-335468) creating KVM machine...
I0903 23:35:18.149094 161984 main.go:141] libmachine: (old-k8s-version-335468) creating network...
I0903 23:35:18.150557 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found existing default KVM network
I0903 23:35:18.152152 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:18.151987 162006 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:7e:87:4f} reservation:<nil>}
I0903 23:35:18.153262 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:18.153146 162006 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:a3:da:20} reservation:<nil>}
I0903 23:35:18.154416 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:18.154323 162006 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a2ed0}
I0903 23:35:18.154442 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | created network xml:
I0903 23:35:18.154458 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | <network>
I0903 23:35:18.154473 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | <name>mk-old-k8s-version-335468</name>
I0903 23:35:18.154513 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | <dns enable='no'/>
I0903 23:35:18.154526 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG |
I0903 23:35:18.154550 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0903 23:35:18.154566 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | <dhcp>
I0903 23:35:18.154575 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0903 23:35:18.154583 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | </dhcp>
I0903 23:35:18.154591 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | </ip>
I0903 23:35:18.154597 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG |
I0903 23:35:18.154605 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | </network>
I0903 23:35:18.154613 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG |
I0903 23:35:18.159527 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | trying to create private KVM network mk-old-k8s-version-335468 192.168.61.0/24...
I0903 23:35:18.246513 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | private KVM network mk-old-k8s-version-335468 192.168.61.0/24 created
I0903 23:35:18.246638 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:18.246372 162006 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/21341-109162/.minikube
I0903 23:35:18.246672 161984 main.go:141] libmachine: (old-k8s-version-335468) setting up store path in /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468 ...
I0903 23:35:18.246708 161984 main.go:141] libmachine: (old-k8s-version-335468) building disk image from file:///home/jenkins/minikube-integration/21341-109162/.minikube/cache/iso/amd64/minikube-v1.36.0-1753487480-21147-amd64.iso
I0903 23:35:18.246726 161984 main.go:141] libmachine: (old-k8s-version-335468) Downloading /home/jenkins/minikube-integration/21341-109162/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/21341-109162/.minikube/cache/iso/amd64/minikube-v1.36.0-1753487480-21147-amd64.iso...
I0903 23:35:18.572372 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:18.572227 162006 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa...
I0903 23:35:19.471333 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:19.471163 162006 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/old-k8s-version-335468.rawdisk...
I0903 23:35:19.471372 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Writing magic tar header
I0903 23:35:19.471390 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Writing SSH key tar header
I0903 23:35:19.471404 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:19.471287 162006 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468 ...
I0903 23:35:19.471460 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468
I0903 23:35:19.471506 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/21341-109162/.minikube/machines
I0903 23:35:19.471531 161984 main.go:141] libmachine: (old-k8s-version-335468) setting executable bit set on /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468 (perms=drwx------)
I0903 23:35:19.471554 161984 main.go:141] libmachine: (old-k8s-version-335468) setting executable bit set on /home/jenkins/minikube-integration/21341-109162/.minikube/machines (perms=drwxr-xr-x)
I0903 23:35:19.471563 161984 main.go:141] libmachine: (old-k8s-version-335468) setting executable bit set on /home/jenkins/minikube-integration/21341-109162/.minikube (perms=drwxr-xr-x)
I0903 23:35:19.471577 161984 main.go:141] libmachine: (old-k8s-version-335468) setting executable bit set on /home/jenkins/minikube-integration/21341-109162 (perms=drwxrwxr-x)
I0903 23:35:19.471591 161984 main.go:141] libmachine: (old-k8s-version-335468) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0903 23:35:19.471604 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/21341-109162/.minikube
I0903 23:35:19.471616 161984 main.go:141] libmachine: (old-k8s-version-335468) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0903 23:35:19.471631 161984 main.go:141] libmachine: (old-k8s-version-335468) creating domain...
I0903 23:35:19.471654 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/21341-109162
I0903 23:35:19.471665 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0903 23:35:19.471678 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home/jenkins
I0903 23:35:19.471689 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | checking permissions on dir: /home
I0903 23:35:19.471703 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | skipping /home - not owner
I0903 23:35:19.472753 161984 main.go:141] libmachine: (old-k8s-version-335468) define libvirt domain using xml:
I0903 23:35:19.472782 161984 main.go:141] libmachine: (old-k8s-version-335468) <domain type='kvm'>
I0903 23:35:19.472825 161984 main.go:141] libmachine: (old-k8s-version-335468) <name>old-k8s-version-335468</name>
I0903 23:35:19.472853 161984 main.go:141] libmachine: (old-k8s-version-335468) <memory unit='MiB'>3072</memory>
I0903 23:35:19.472862 161984 main.go:141] libmachine: (old-k8s-version-335468) <vcpu>2</vcpu>
I0903 23:35:19.472874 161984 main.go:141] libmachine: (old-k8s-version-335468) <features>
I0903 23:35:19.472937 161984 main.go:141] libmachine: (old-k8s-version-335468) <acpi/>
I0903 23:35:19.472964 161984 main.go:141] libmachine: (old-k8s-version-335468) <apic/>
I0903 23:35:19.472974 161984 main.go:141] libmachine: (old-k8s-version-335468) <pae/>
I0903 23:35:19.472984 161984 main.go:141] libmachine: (old-k8s-version-335468)
I0903 23:35:19.472992 161984 main.go:141] libmachine: (old-k8s-version-335468) </features>
I0903 23:35:19.473004 161984 main.go:141] libmachine: (old-k8s-version-335468) <cpu mode='host-passthrough'>
I0903 23:35:19.473015 161984 main.go:141] libmachine: (old-k8s-version-335468)
I0903 23:35:19.473023 161984 main.go:141] libmachine: (old-k8s-version-335468) </cpu>
I0903 23:35:19.473028 161984 main.go:141] libmachine: (old-k8s-version-335468) <os>
I0903 23:35:19.473034 161984 main.go:141] libmachine: (old-k8s-version-335468) <type>hvm</type>
I0903 23:35:19.473040 161984 main.go:141] libmachine: (old-k8s-version-335468) <boot dev='cdrom'/>
I0903 23:35:19.473046 161984 main.go:141] libmachine: (old-k8s-version-335468) <boot dev='hd'/>
I0903 23:35:19.473052 161984 main.go:141] libmachine: (old-k8s-version-335468) <bootmenu enable='no'/>
I0903 23:35:19.473058 161984 main.go:141] libmachine: (old-k8s-version-335468) </os>
I0903 23:35:19.473062 161984 main.go:141] libmachine: (old-k8s-version-335468) <devices>
I0903 23:35:19.473067 161984 main.go:141] libmachine: (old-k8s-version-335468) <disk type='file' device='cdrom'>
I0903 23:35:19.473078 161984 main.go:141] libmachine: (old-k8s-version-335468) <source file='/home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/boot2docker.iso'/>
I0903 23:35:19.473087 161984 main.go:141] libmachine: (old-k8s-version-335468) <target dev='hdc' bus='scsi'/>
I0903 23:35:19.473092 161984 main.go:141] libmachine: (old-k8s-version-335468) <readonly/>
I0903 23:35:19.473097 161984 main.go:141] libmachine: (old-k8s-version-335468) </disk>
I0903 23:35:19.473103 161984 main.go:141] libmachine: (old-k8s-version-335468) <disk type='file' device='disk'>
I0903 23:35:19.473110 161984 main.go:141] libmachine: (old-k8s-version-335468) <driver name='qemu' type='raw' cache='default' io='threads' />
I0903 23:35:19.473123 161984 main.go:141] libmachine: (old-k8s-version-335468) <source file='/home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/old-k8s-version-335468.rawdisk'/>
I0903 23:35:19.473130 161984 main.go:141] libmachine: (old-k8s-version-335468) <target dev='hda' bus='virtio'/>
I0903 23:35:19.473134 161984 main.go:141] libmachine: (old-k8s-version-335468) </disk>
I0903 23:35:19.473141 161984 main.go:141] libmachine: (old-k8s-version-335468) <interface type='network'>
I0903 23:35:19.473147 161984 main.go:141] libmachine: (old-k8s-version-335468) <source network='mk-old-k8s-version-335468'/>
I0903 23:35:19.473153 161984 main.go:141] libmachine: (old-k8s-version-335468) <model type='virtio'/>
I0903 23:35:19.473159 161984 main.go:141] libmachine: (old-k8s-version-335468) </interface>
I0903 23:35:19.473165 161984 main.go:141] libmachine: (old-k8s-version-335468) <interface type='network'>
I0903 23:35:19.473170 161984 main.go:141] libmachine: (old-k8s-version-335468) <source network='default'/>
I0903 23:35:19.473177 161984 main.go:141] libmachine: (old-k8s-version-335468) <model type='virtio'/>
I0903 23:35:19.473181 161984 main.go:141] libmachine: (old-k8s-version-335468) </interface>
I0903 23:35:19.473186 161984 main.go:141] libmachine: (old-k8s-version-335468) <serial type='pty'>
I0903 23:35:19.473194 161984 main.go:141] libmachine: (old-k8s-version-335468) <target port='0'/>
I0903 23:35:19.473198 161984 main.go:141] libmachine: (old-k8s-version-335468) </serial>
I0903 23:35:19.473203 161984 main.go:141] libmachine: (old-k8s-version-335468) <console type='pty'>
I0903 23:35:19.473209 161984 main.go:141] libmachine: (old-k8s-version-335468) <target type='serial' port='0'/>
I0903 23:35:19.473214 161984 main.go:141] libmachine: (old-k8s-version-335468) </console>
I0903 23:35:19.473218 161984 main.go:141] libmachine: (old-k8s-version-335468) <rng model='virtio'>
I0903 23:35:19.473225 161984 main.go:141] libmachine: (old-k8s-version-335468) <backend model='random'>/dev/random</backend>
I0903 23:35:19.473237 161984 main.go:141] libmachine: (old-k8s-version-335468) </rng>
I0903 23:35:19.473245 161984 main.go:141] libmachine: (old-k8s-version-335468)
I0903 23:35:19.473249 161984 main.go:141] libmachine: (old-k8s-version-335468)
I0903 23:35:19.473253 161984 main.go:141] libmachine: (old-k8s-version-335468) </devices>
I0903 23:35:19.473257 161984 main.go:141] libmachine: (old-k8s-version-335468) </domain>
I0903 23:35:19.473264 161984 main.go:141] libmachine: (old-k8s-version-335468)
I0903 23:35:19.477501 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:12:53:33 in network default
I0903 23:35:19.478334 161984 main.go:141] libmachine: (old-k8s-version-335468) starting domain...
I0903 23:35:19.478352 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:19.478359 161984 main.go:141] libmachine: (old-k8s-version-335468) ensuring networks are active...
I0903 23:35:19.479136 161984 main.go:141] libmachine: (old-k8s-version-335468) Ensuring network default is active
I0903 23:35:19.479565 161984 main.go:141] libmachine: (old-k8s-version-335468) Ensuring network mk-old-k8s-version-335468 is active
I0903 23:35:19.480118 161984 main.go:141] libmachine: (old-k8s-version-335468) getting domain XML...
I0903 23:35:19.480936 161984 main.go:141] libmachine: (old-k8s-version-335468) creating domain...
I0903 23:35:21.134737 161984 main.go:141] libmachine: (old-k8s-version-335468) waiting for IP...
I0903 23:35:21.135797 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:21.136403 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:21.136511 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:21.136394 162006 retry.go:31] will retry after 215.50994ms: waiting for domain to come up
I0903 23:35:21.354263 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:21.355062 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:21.355091 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:21.355024 162006 retry.go:31] will retry after 325.723507ms: waiting for domain to come up
I0903 23:35:21.682934 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:21.683877 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:21.683909 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:21.683847 162006 retry.go:31] will retry after 459.355647ms: waiting for domain to come up
I0903 23:35:22.144573 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:22.145156 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:22.145236 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:22.145120 162006 retry.go:31] will retry after 503.203879ms: waiting for domain to come up
I0903 23:35:22.649977 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:22.650621 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:22.650657 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:22.650594 162006 retry.go:31] will retry after 464.720851ms: waiting for domain to come up
I0903 23:35:23.117574 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:23.118149 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:23.118203 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:23.118108 162006 retry.go:31] will retry after 732.826722ms: waiting for domain to come up
I0903 23:35:23.852683 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:23.853184 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:23.853214 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:23.853152 162006 retry.go:31] will retry after 781.935962ms: waiting for domain to come up
I0903 23:35:24.637351 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:24.637878 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:24.637902 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:24.637848 162006 retry.go:31] will retry after 968.285439ms: waiting for domain to come up
I0903 23:35:25.607379 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:25.607853 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:25.607876 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:25.607821 162006 retry.go:31] will retry after 1.261113415s: waiting for domain to come up
I0903 23:35:26.870700 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:26.871285 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:26.871312 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:26.871194 162006 retry.go:31] will retry after 1.46273447s: waiting for domain to come up
I0903 23:35:28.335735 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:28.336266 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:28.336290 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:28.336211 162006 retry.go:31] will retry after 2.185610178s: waiting for domain to come up
I0903 23:35:30.529470 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:30.529960 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:30.529988 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:30.529875 162006 retry.go:31] will retry after 3.077161977s: waiting for domain to come up
I0903 23:35:33.608647 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:33.609280 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:33.609418 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:33.609262 162006 retry.go:31] will retry after 4.288810735s: waiting for domain to come up
I0903 23:35:37.902701 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:37.903190 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find current IP address of domain old-k8s-version-335468 in network mk-old-k8s-version-335468
I0903 23:35:37.903218 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | I0903 23:35:37.903142 162006 retry.go:31] will retry after 3.436518575s: waiting for domain to come up
I0903 23:35:41.342510 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:41.343095 161984 main.go:141] libmachine: (old-k8s-version-335468) found domain IP: 192.168.61.80
I0903 23:35:41.343123 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has current primary IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:41.343136 161984 main.go:141] libmachine: (old-k8s-version-335468) reserving static IP address...
I0903 23:35:41.343494 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-335468", mac: "52:54:00:a2:6b:b9", ip: "192.168.61.80"} in network mk-old-k8s-version-335468
I0903 23:35:41.421658 161984 main.go:141] libmachine: (old-k8s-version-335468) reserved static IP address 192.168.61.80 for domain old-k8s-version-335468
I0903 23:35:41.421683 161984 main.go:141] libmachine: (old-k8s-version-335468) waiting for SSH...
I0903 23:35:41.421705 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Getting to WaitForSSH function...
I0903 23:35:41.424609 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:41.424940 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468
I0903 23:35:41.424966 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | unable to find defined IP address of network mk-old-k8s-version-335468 interface with MAC address 52:54:00:a2:6b:b9
I0903 23:35:41.425109 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Using SSH client type: external
I0903 23:35:41.425133 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Using SSH private key: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa (-rw-------)
I0903 23:35:41.425195 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa -p 22] /usr/bin/ssh <nil>}
I0903 23:35:41.425212 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | About to run SSH command:
I0903 23:35:41.425230 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | exit 0
I0903 23:35:41.429031 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | SSH cmd err, output: exit status 255:
I0903 23:35:41.429056 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0903 23:35:41.429066 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | command : exit 0
I0903 23:35:41.429079 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | err : exit status 255
I0903 23:35:41.429093 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | output :
I0903 23:35:44.429588 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Getting to WaitForSSH function...
I0903 23:35:44.432460 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.432863 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:44.432891 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.433079 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Using SSH client type: external
I0903 23:35:44.433106 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | Using SSH private key: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa (-rw-------)
I0903 23:35:44.433135 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.80 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa -p 22] /usr/bin/ssh <nil>}
I0903 23:35:44.433148 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | About to run SSH command:
I0903 23:35:44.433164 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | exit 0
I0903 23:35:44.565742 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | SSH cmd err, output: <nil>:
I0903 23:35:44.566039 161984 main.go:141] libmachine: (old-k8s-version-335468) KVM machine creation complete
I0903 23:35:44.566365 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetConfigRaw
I0903 23:35:44.566992 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:44.567168 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:44.567347 161984 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0903 23:35:44.567366 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetState
I0903 23:35:44.568762 161984 main.go:141] libmachine: Detecting operating system of created instance...
I0903 23:35:44.568775 161984 main.go:141] libmachine: Waiting for SSH to be available...
I0903 23:35:44.568780 161984 main.go:141] libmachine: Getting to WaitForSSH function...
I0903 23:35:44.568786 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:44.571280 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.571676 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:44.571710 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.571860 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:44.572051 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.572222 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.572379 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:44.572555 161984 main.go:141] libmachine: Using SSH client type: native
I0903 23:35:44.572927 161984 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.61.80 22 <nil> <nil>}
I0903 23:35:44.572949 161984 main.go:141] libmachine: About to run SSH command:
exit 0
I0903 23:35:44.688743 161984 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0903 23:35:44.688767 161984 main.go:141] libmachine: Detecting the provisioner...
I0903 23:35:44.688780 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:44.691495 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.691822 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:44.691846 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.692029 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:44.692202 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.692372 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.692490 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:44.692633 161984 main.go:141] libmachine: Using SSH client type: native
I0903 23:35:44.692877 161984 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.61.80 22 <nil> <nil>}
I0903 23:35:44.692891 161984 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0903 23:35:44.811000 161984 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2025.02-dirty
ID=buildroot
VERSION_ID=2025.02
PRETTY_NAME="Buildroot 2025.02"
I0903 23:35:44.811087 161984 main.go:141] libmachine: found compatible host: buildroot
I0903 23:35:44.811102 161984 main.go:141] libmachine: Provisioning with buildroot...
I0903 23:35:44.811117 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetMachineName
I0903 23:35:44.811397 161984 buildroot.go:166] provisioning hostname "old-k8s-version-335468"
I0903 23:35:44.811435 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetMachineName
I0903 23:35:44.811684 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:44.814995 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.815430 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:44.815464 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.815628 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:44.815808 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.815979 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.816113 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:44.816275 161984 main.go:141] libmachine: Using SSH client type: native
I0903 23:35:44.816513 161984 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.61.80 22 <nil> <nil>}
I0903 23:35:44.816527 161984 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-335468 && echo "old-k8s-version-335468" | sudo tee /etc/hostname
I0903 23:35:44.955548 161984 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-335468
I0903 23:35:44.955576 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:44.959264 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.959711 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:44.959742 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:44.959989 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:44.960178 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.960405 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:44.960578 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:44.960830 161984 main.go:141] libmachine: Using SSH client type: native
I0903 23:35:44.961179 161984 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.61.80 22 <nil> <nil>}
I0903 23:35:44.961212 161984 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-335468' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-335468/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-335468' | sudo tee -a /etc/hosts;
fi
fi
I0903 23:35:45.092515 161984 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0903 23:35:45.092547 161984 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/21341-109162/.minikube CaCertPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21341-109162/.minikube}
I0903 23:35:45.092576 161984 buildroot.go:174] setting up certificates
I0903 23:35:45.092589 161984 provision.go:84] configureAuth start
I0903 23:35:45.092603 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetMachineName
I0903 23:35:45.092865 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetIP
I0903 23:35:45.095682 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:45.096012 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:45.096042 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:45.096145 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:45.098562 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:45.098838 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:45.098857 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:45.099038 161984 provision.go:143] copyHostCerts
I0903 23:35:45.099103 161984 exec_runner.go:144] found /home/jenkins/minikube-integration/21341-109162/.minikube/ca.pem, removing ...
I0903 23:35:45.099124 161984 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21341-109162/.minikube/ca.pem
I0903 23:35:45.099175 161984 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21341-109162/.minikube/ca.pem (1078 bytes)
I0903 23:35:45.099277 161984 exec_runner.go:144] found /home/jenkins/minikube-integration/21341-109162/.minikube/cert.pem, removing ...
I0903 23:35:45.099285 161984 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21341-109162/.minikube/cert.pem
I0903 23:35:45.099308 161984 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21341-109162/.minikube/cert.pem (1123 bytes)
I0903 23:35:45.099366 161984 exec_runner.go:144] found /home/jenkins/minikube-integration/21341-109162/.minikube/key.pem, removing ...
I0903 23:35:45.099372 161984 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21341-109162/.minikube/key.pem
I0903 23:35:45.099389 161984 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21341-109162/.minikube/key.pem (1675 bytes)
I0903 23:35:45.099436 161984 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-335468 san=[127.0.0.1 192.168.61.80 localhost minikube old-k8s-version-335468]
I0903 23:35:45.841582 161984 provision.go:177] copyRemoteCerts
I0903 23:35:45.841651 161984 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0903 23:35:45.841683 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:45.843959 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:45.844302 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:45.844345 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:45.844514 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:45.844723 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:45.844882 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:45.845021 161984 sshutil.go:53] new ssh client: &{IP:192.168.61.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa Username:docker}
I0903 23:35:45.932385 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0903 23:35:45.958833 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0903 23:35:45.985131 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0903 23:35:46.010921 161984 provision.go:87] duration metric: took 918.314039ms to configureAuth
I0903 23:35:46.010959 161984 buildroot.go:189] setting minikube options for container-runtime
I0903 23:35:46.011121 161984 config.go:182] Loaded profile config "old-k8s-version-335468": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0903 23:35:46.011198 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:46.014389 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.014788 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.014820 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.014975 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:46.015185 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.015342 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.015501 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:46.015694 161984 main.go:141] libmachine: Using SSH client type: native
I0903 23:35:46.016030 161984 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.61.80 22 <nil> <nil>}
I0903 23:35:46.016060 161984 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0903 23:35:46.256083 161984 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0903 23:35:46.256112 161984 main.go:141] libmachine: Checking connection to Docker...
I0903 23:35:46.256122 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetURL
I0903 23:35:46.257426 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | using libvirt version 6000000
I0903 23:35:46.260034 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.260375 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.260409 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.260600 161984 main.go:141] libmachine: Docker is up and running!
I0903 23:35:46.260610 161984 main.go:141] libmachine: Reticulating splines...
I0903 23:35:46.260618 161984 client.go:171] duration metric: took 28.112742156s to LocalClient.Create
I0903 23:35:46.260643 161984 start.go:167] duration metric: took 28.112806753s to libmachine.API.Create "old-k8s-version-335468"
I0903 23:35:46.260656 161984 start.go:293] postStartSetup for "old-k8s-version-335468" (driver="kvm2")
I0903 23:35:46.260668 161984 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0903 23:35:46.260687 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:46.260906 161984 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0903 23:35:46.260935 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:46.263256 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.263575 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.263600 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.263774 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:46.263974 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.264144 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:46.264276 161984 sshutil.go:53] new ssh client: &{IP:192.168.61.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa Username:docker}
I0903 23:35:46.353670 161984 ssh_runner.go:195] Run: cat /etc/os-release
I0903 23:35:46.358320 161984 info.go:137] Remote host: Buildroot 2025.02
I0903 23:35:46.358354 161984 filesync.go:126] Scanning /home/jenkins/minikube-integration/21341-109162/.minikube/addons for local assets ...
I0903 23:35:46.358472 161984 filesync.go:126] Scanning /home/jenkins/minikube-integration/21341-109162/.minikube/files for local assets ...
I0903 23:35:46.358551 161984 filesync.go:149] local asset: /home/jenkins/minikube-integration/21341-109162/.minikube/files/etc/ssl/certs/1132882.pem -> 1132882.pem in /etc/ssl/certs
I0903 23:35:46.358636 161984 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0903 23:35:46.370597 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/files/etc/ssl/certs/1132882.pem --> /etc/ssl/certs/1132882.pem (1708 bytes)
I0903 23:35:46.398305 161984 start.go:296] duration metric: took 137.630635ms for postStartSetup
I0903 23:35:46.398371 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetConfigRaw
I0903 23:35:46.398977 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetIP
I0903 23:35:46.401626 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.401992 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.402024 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.402270 161984 profile.go:143] Saving config to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/config.json ...
I0903 23:35:46.402474 161984 start.go:128] duration metric: took 28.276330151s to createHost
I0903 23:35:46.402504 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:46.405045 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.405408 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.405436 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.405603 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:46.405771 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.405902 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.406065 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:46.406218 161984 main.go:141] libmachine: Using SSH client type: native
I0903 23:35:46.406438 161984 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.61.80 22 <nil> <nil>}
I0903 23:35:46.406452 161984 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0903 23:35:46.522589 161984 main.go:141] libmachine: SSH cmd err, output: <nil>: 1756942546.494399912
I0903 23:35:46.522614 161984 fix.go:216] guest clock: 1756942546.494399912
I0903 23:35:46.522625 161984 fix.go:229] Guest: 2025-09-03 23:35:46.494399912 +0000 UTC Remote: 2025-09-03 23:35:46.402488166 +0000 UTC m=+28.406569168 (delta=91.911746ms)
I0903 23:35:46.522650 161984 fix.go:200] guest clock delta is within tolerance: 91.911746ms
I0903 23:35:46.522656 161984 start.go:83] releasing machines lock for "old-k8s-version-335468", held for 28.39658803s
I0903 23:35:46.522690 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:46.522945 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetIP
I0903 23:35:46.525924 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.526323 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.526354 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.526529 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:46.527061 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:46.527259 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .DriverName
I0903 23:35:46.527354 161984 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0903 23:35:46.527411 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:46.527525 161984 ssh_runner.go:195] Run: cat /version.json
I0903 23:35:46.527556 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHHostname
I0903 23:35:46.530228 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.530321 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.530671 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.530698 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.530725 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:46.530742 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:46.530880 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:46.530980 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHPort
I0903 23:35:46.531045 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.531118 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHKeyPath
I0903 23:35:46.531195 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:46.531255 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetSSHUsername
I0903 23:35:46.531342 161984 sshutil.go:53] new ssh client: &{IP:192.168.61.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa Username:docker}
I0903 23:35:46.531392 161984 sshutil.go:53] new ssh client: &{IP:192.168.61.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/old-k8s-version-335468/id_rsa Username:docker}
I0903 23:35:46.626959 161984 ssh_runner.go:195] Run: systemctl --version
I0903 23:35:46.655744 161984 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0903 23:35:46.815441 161984 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0903 23:35:46.822187 161984 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0903 23:35:46.822262 161984 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0903 23:35:46.841163 161984 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0903 23:35:46.841199 161984 start.go:495] detecting cgroup driver to use...
I0903 23:35:46.841272 161984 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0903 23:35:46.861640 161984 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0903 23:35:46.879410 161984 docker.go:218] disabling cri-docker service (if available) ...
I0903 23:35:46.879468 161984 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0903 23:35:46.895697 161984 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0903 23:35:46.912785 161984 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0903 23:35:47.071316 161984 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0903 23:35:47.232173 161984 docker.go:234] disabling docker service ...
I0903 23:35:47.232236 161984 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0903 23:35:47.248820 161984 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0903 23:35:47.264046 161984 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0903 23:35:47.478302 161984 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0903 23:35:47.625709 161984 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0903 23:35:47.648440 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0903 23:35:47.672766 161984 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0903 23:35:47.672835 161984 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:35:47.684719 161984 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0903 23:35:47.684799 161984 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:35:47.698464 161984 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:35:47.710027 161984 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:35:47.721503 161984 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0903 23:35:47.735689 161984 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0903 23:35:47.748060 161984 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 1
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0903 23:35:47.748125 161984 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0903 23:35:47.769411 161984 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0903 23:35:47.783760 161984 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0903 23:35:47.932519 161984 ssh_runner.go:195] Run: sudo systemctl restart crio
I0903 23:35:48.067373 161984 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0903 23:35:48.067445 161984 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0903 23:35:48.073099 161984 start.go:563] Will wait 60s for crictl version
I0903 23:35:48.073175 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:48.077248 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0903 23:35:48.116926 161984 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0903 23:35:48.117028 161984 ssh_runner.go:195] Run: crio --version
I0903 23:35:48.151226 161984 ssh_runner.go:195] Run: crio --version
I0903 23:35:48.184646 161984 out.go:179] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0903 23:35:48.185748 161984 main.go:141] libmachine: (old-k8s-version-335468) Calling .GetIP
I0903 23:35:48.188853 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:48.189235 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:6b:b9", ip: ""} in network mk-old-k8s-version-335468: {Iface:virbr3 ExpiryTime:2025-09-04 00:35:36 +0000 UTC Type:0 Mac:52:54:00:a2:6b:b9 Iaid: IPaddr:192.168.61.80 Prefix:24 Hostname:old-k8s-version-335468 Clientid:01:52:54:00:a2:6b:b9}
I0903 23:35:48.189268 161984 main.go:141] libmachine: (old-k8s-version-335468) DBG | domain old-k8s-version-335468 has defined IP address 192.168.61.80 and MAC address 52:54:00:a2:6b:b9 in network mk-old-k8s-version-335468
I0903 23:35:48.189523 161984 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0903 23:35:48.194168 161984 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0903 23:35:48.210749 161984 kubeadm.go:875] updating cluster {Name:old-k8s-version-335468 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/21147/minikube-v1.36.0-1753487480-21147-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-335468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.80 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0903 23:35:48.210888 161984 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0903 23:35:48.210941 161984 ssh_runner.go:195] Run: sudo crictl images --output json
I0903 23:35:48.254517 161984 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0903 23:35:48.254645 161984 ssh_runner.go:195] Run: which lz4
I0903 23:35:48.259258 161984 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0903 23:35:48.263941 161984 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0903 23:35:48.263978 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0903 23:35:49.997118 161984 crio.go:462] duration metric: took 1.737888543s to copy over tarball
I0903 23:35:49.997217 161984 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0903 23:35:52.228611 161984 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.231356681s)
I0903 23:35:52.228649 161984 crio.go:469] duration metric: took 2.231491053s to extract the tarball
I0903 23:35:52.228660 161984 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0903 23:35:52.277278 161984 ssh_runner.go:195] Run: sudo crictl images --output json
I0903 23:35:52.335808 161984 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0903 23:35:52.335833 161984 cache_images.go:89] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0903 23:35:52.335913 161984 image.go:138] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0903 23:35:52.335933 161984 image.go:138] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.335951 161984 image.go:138] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.335974 161984 image.go:138] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:52.335941 161984 image.go:138] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:52.335925 161984 image.go:138] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0903 23:35:52.336039 161984 image.go:138] retrieving image: registry.k8s.io/coredns:1.7.0
I0903 23:35:52.335992 161984 image.go:138] retrieving image: registry.k8s.io/pause:3.2
I0903 23:35:52.337889 161984 image.go:181] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:52.337995 161984 image.go:181] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:52.338167 161984 image.go:181] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0903 23:35:52.338308 161984 image.go:181] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.338448 161984 image.go:181] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0903 23:35:52.338456 161984 image.go:181] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.338567 161984 image.go:181] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0903 23:35:52.339017 161984 image.go:181] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0903 23:35:52.498700 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:52.499272 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.501972 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0903 23:35:52.503187 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.509248 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:52.519169 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0903 23:35:52.530844 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0903 23:35:52.639948 161984 cache_images.go:117] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0903 23:35:52.640004 161984 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:52.640065 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.654557 161984 cache_images.go:117] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0903 23:35:52.654604 161984 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.654658 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.693932 161984 cache_images.go:117] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0903 23:35:52.693968 161984 cache_images.go:117] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0903 23:35:52.693980 161984 cache_images.go:117] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0903 23:35:52.693988 161984 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0903 23:35:52.694001 161984 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:52.694001 161984 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.694039 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.694043 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.694111 161984 cache_images.go:117] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0903 23:35:52.694043 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.694138 161984 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0903 23:35:52.694173 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.694184 161984 cache_images.go:117] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0903 23:35:52.694207 161984 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0903 23:35:52.694216 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:52.694235 161984 ssh_runner.go:195] Run: which crictl
I0903 23:35:52.694255 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.707836 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.769116 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0903 23:35:52.769176 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0903 23:35:52.769254 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0903 23:35:52.769307 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:52.769350 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.769402 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:52.769441 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.908939 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0903 23:35:52.908962 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0903 23:35:52.928670 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0903 23:35:52.928670 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:52.928779 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0903 23:35:52.928802 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0903 23:35:52.928854 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0903 23:35:53.042460 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0903 23:35:53.042531 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0903 23:35:53.073125 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0903 23:35:53.078185 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0903 23:35:53.085357 161984 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0903 23:35:53.085401 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0903 23:35:53.085419 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0903 23:35:53.165579 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0903 23:35:53.165597 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0903 23:35:53.165680 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0903 23:35:53.165685 161984 cache_images.go:290] Loading image from: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0903 23:35:53.687766 161984 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0903 23:35:53.835237 161984 cache_images.go:93] duration metric: took 1.499383638s to LoadCachedImages
W0903 23:35:53.835353 161984 out.go:285] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/21341-109162/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0903 23:35:53.835373 161984 kubeadm.go:926] updating node { 192.168.61.80 8443 v1.20.0 crio true true} ...
I0903 23:35:53.835523 161984 kubeadm.go:938] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-335468 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.80
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-335468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0903 23:35:53.835626 161984 ssh_runner.go:195] Run: crio config
I0903 23:35:53.883543 161984 cni.go:84] Creating CNI manager for ""
I0903 23:35:53.883573 161984 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0903 23:35:53.883587 161984 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0903 23:35:53.883615 161984 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.80 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-335468 NodeName:old-k8s-version-335468 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.80"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.80 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0903 23:35:53.883732 161984 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.80
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-335468"
kubeletExtraArgs:
node-ip: 192.168.61.80
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.80"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0903 23:35:53.883800 161984 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0903 23:35:53.896232 161984 binaries.go:44] Found k8s binaries, skipping transfer
I0903 23:35:53.896335 161984 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0903 23:35:53.908526 161984 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0903 23:35:53.928837 161984 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0903 23:35:53.948156 161984 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0903 23:35:53.969691 161984 ssh_runner.go:195] Run: grep 192.168.61.80 control-plane.minikube.internal$ /etc/hosts
I0903 23:35:53.973826 161984 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.80 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0903 23:35:53.988574 161984 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0903 23:35:54.128696 161984 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0903 23:35:54.152029 161984 certs.go:68] Setting up /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468 for IP: 192.168.61.80
I0903 23:35:54.152051 161984 certs.go:194] generating shared ca certs ...
I0903 23:35:54.152073 161984 certs.go:226] acquiring lock for ca certs: {Name:mk06ceac58fd506484973632a7bd0b701183c2c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.152264 161984 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21341-109162/.minikube/ca.key
I0903 23:35:54.152325 161984 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21341-109162/.minikube/proxy-client-ca.key
I0903 23:35:54.152340 161984 certs.go:256] generating profile certs ...
I0903 23:35:54.152409 161984 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/client.key
I0903 23:35:54.152426 161984 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/client.crt with IP's: []
I0903 23:35:54.432126 161984 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/client.crt ...
I0903 23:35:54.432163 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/client.crt: {Name:mk97bcc2161054214f7351ac57a3df936aacf2f8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.432364 161984 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/client.key ...
I0903 23:35:54.432383 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/client.key: {Name:mk119bfb198a426ab0ddd737eabb72691c01118a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.432500 161984 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.key.f2828629
I0903 23:35:54.432521 161984 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.crt.f2828629 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.80]
I0903 23:35:54.579315 161984 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.crt.f2828629 ...
I0903 23:35:54.579356 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.crt.f2828629: {Name:mk45e0f97c308fef43eb67c07e49fcb7f01ef5ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.602800 161984 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.key.f2828629 ...
I0903 23:35:54.602845 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.key.f2828629: {Name:mkc4601cd80860574498e873f51cd053071b0ecc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.602988 161984 certs.go:381] copying /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.crt.f2828629 -> /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.crt
I0903 23:35:54.603094 161984 certs.go:385] copying /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.key.f2828629 -> /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.key
I0903 23:35:54.603177 161984 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.key
I0903 23:35:54.603200 161984 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.crt with IP's: []
I0903 23:35:54.939581 161984 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.crt ...
I0903 23:35:54.939619 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.crt: {Name:mk27140b43636e95bd5f07f645dee0380f0e7b97 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.939782 161984 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.key ...
I0903 23:35:54.939795 161984 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.key: {Name:mkb9ce088cbb72486f21fc6a8c8ead81cc2cfe15 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:35:54.939992 161984 certs.go:484] found cert: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/113288.pem (1338 bytes)
W0903 23:35:54.940032 161984 certs.go:480] ignoring /home/jenkins/minikube-integration/21341-109162/.minikube/certs/113288_empty.pem, impossibly tiny 0 bytes
I0903 23:35:54.940042 161984 certs.go:484] found cert: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca-key.pem (1675 bytes)
I0903 23:35:54.940062 161984 certs.go:484] found cert: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem (1078 bytes)
I0903 23:35:54.940089 161984 certs.go:484] found cert: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/cert.pem (1123 bytes)
I0903 23:35:54.940127 161984 certs.go:484] found cert: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/key.pem (1675 bytes)
I0903 23:35:54.940193 161984 certs.go:484] found cert: /home/jenkins/minikube-integration/21341-109162/.minikube/files/etc/ssl/certs/1132882.pem (1708 bytes)
I0903 23:35:54.940793 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0903 23:35:54.982024 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0903 23:35:55.034254 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0903 23:35:55.083354 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0903 23:35:55.127481 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0903 23:35:55.169437 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0903 23:35:55.210349 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0903 23:35:55.248016 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/old-k8s-version-335468/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0903 23:35:55.279738 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/files/etc/ssl/certs/1132882.pem --> /usr/share/ca-certificates/1132882.pem (1708 bytes)
I0903 23:35:55.317088 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0903 23:35:55.345849 161984 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/certs/113288.pem --> /usr/share/ca-certificates/113288.pem (1338 bytes)
I0903 23:35:55.379441 161984 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0903 23:35:55.402044 161984 ssh_runner.go:195] Run: openssl version
I0903 23:35:55.409029 161984 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1132882.pem && ln -fs /usr/share/ca-certificates/1132882.pem /etc/ssl/certs/1132882.pem"
I0903 23:35:55.422144 161984 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1132882.pem
I0903 23:35:55.427266 161984 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 3 22:36 /usr/share/ca-certificates/1132882.pem
I0903 23:35:55.427344 161984 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1132882.pem
I0903 23:35:55.434648 161984 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1132882.pem /etc/ssl/certs/3ec20f2e.0"
I0903 23:35:55.447663 161984 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0903 23:35:55.464802 161984 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0903 23:35:55.471696 161984 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 3 22:28 /usr/share/ca-certificates/minikubeCA.pem
I0903 23:35:55.471772 161984 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0903 23:35:55.481094 161984 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0903 23:35:55.498303 161984 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113288.pem && ln -fs /usr/share/ca-certificates/113288.pem /etc/ssl/certs/113288.pem"
I0903 23:35:55.515458 161984 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113288.pem
I0903 23:35:55.522357 161984 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 3 22:36 /usr/share/ca-certificates/113288.pem
I0903 23:35:55.522422 161984 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113288.pem
I0903 23:35:55.530082 161984 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/113288.pem /etc/ssl/certs/51391683.0"
I0903 23:35:55.544325 161984 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0903 23:35:55.551045 161984 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0903 23:35:55.551139 161984 kubeadm.go:392] StartCluster: {Name:old-k8s-version-335468 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/21147/minikube-v1.36.0-1753487480-21147-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-335468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.80 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bina
ryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0903 23:35:55.551248 161984 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0903 23:35:55.551341 161984 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0903 23:35:55.601863 161984 cri.go:89] found id: ""
I0903 23:35:55.601936 161984 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0903 23:35:55.617084 161984 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0903 23:35:55.629224 161984 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0903 23:35:55.644534 161984 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0903 23:35:55.644561 161984 kubeadm.go:157] found existing configuration files:
I0903 23:35:55.644657 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0903 23:35:55.658365 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0903 23:35:55.658436 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0903 23:35:55.670122 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0903 23:35:55.681005 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0903 23:35:55.681076 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0903 23:35:55.692222 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0903 23:35:55.705784 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0903 23:35:55.705866 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0903 23:35:55.719328 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0903 23:35:55.732750 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0903 23:35:55.732822 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0903 23:35:55.749641 161984 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0903 23:35:56.005804 161984 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0903 23:37:54.681456 161984 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0903 23:37:54.681650 161984 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0903 23:37:54.683536 161984 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0903 23:37:54.683603 161984 kubeadm.go:310] [preflight] Running pre-flight checks
I0903 23:37:54.683731 161984 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0903 23:37:54.683818 161984 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0903 23:37:54.683896 161984 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0903 23:37:54.683949 161984 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0903 23:37:54.685544 161984 out.go:252] - Generating certificates and keys ...
I0903 23:37:54.685614 161984 kubeadm.go:310] [certs] Using existing ca certificate authority
I0903 23:37:54.685694 161984 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0903 23:37:54.685770 161984 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0903 23:37:54.685824 161984 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0903 23:37:54.685877 161984 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0903 23:37:54.685925 161984 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0903 23:37:54.685971 161984 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0903 23:37:54.686084 161984 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-335468] and IPs [192.168.61.80 127.0.0.1 ::1]
I0903 23:37:54.686134 161984 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0903 23:37:54.686248 161984 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-335468] and IPs [192.168.61.80 127.0.0.1 ::1]
I0903 23:37:54.686338 161984 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0903 23:37:54.686430 161984 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0903 23:37:54.686500 161984 kubeadm.go:310] [certs] Generating "sa" key and public key
I0903 23:37:54.686546 161984 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0903 23:37:54.686594 161984 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0903 23:37:54.686640 161984 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0903 23:37:54.686695 161984 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0903 23:37:54.686739 161984 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0903 23:37:54.686866 161984 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0903 23:37:54.686952 161984 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0903 23:37:54.687011 161984 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0903 23:37:54.687115 161984 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0903 23:37:54.688392 161984 out.go:252] - Booting up control plane ...
I0903 23:37:54.688490 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0903 23:37:54.688592 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0903 23:37:54.688696 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0903 23:37:54.688796 161984 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0903 23:37:54.688973 161984 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0903 23:37:54.689039 161984 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0903 23:37:54.689135 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:37:54.689412 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:37:54.689491 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:37:54.689756 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:37:54.689830 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:37:54.689991 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:37:54.690052 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:37:54.690207 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:37:54.690281 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:37:54.690494 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:37:54.690512 161984 kubeadm.go:310]
I0903 23:37:54.690558 161984 kubeadm.go:310] Unfortunately, an error has occurred:
I0903 23:37:54.690594 161984 kubeadm.go:310] timed out waiting for the condition
I0903 23:37:54.690605 161984 kubeadm.go:310]
I0903 23:37:54.690634 161984 kubeadm.go:310] This error is likely caused by:
I0903 23:37:54.690664 161984 kubeadm.go:310] - The kubelet is not running
I0903 23:37:54.690768 161984 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0903 23:37:54.690780 161984 kubeadm.go:310]
I0903 23:37:54.690871 161984 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0903 23:37:54.690902 161984 kubeadm.go:310] - 'systemctl status kubelet'
I0903 23:37:54.690941 161984 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0903 23:37:54.690950 161984 kubeadm.go:310]
I0903 23:37:54.691037 161984 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0903 23:37:54.691103 161984 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0903 23:37:54.691109 161984 kubeadm.go:310]
I0903 23:37:54.691192 161984 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0903 23:37:54.691267 161984 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0903 23:37:54.691335 161984 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0903 23:37:54.691397 161984 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0903 23:37:54.691422 161984 kubeadm.go:310]
W0903 23:37:54.691524 161984 out.go:285] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-335468] and IPs [192.168.61.80 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-335468] and IPs [192.168.61.80 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-335468] and IPs [192.168.61.80 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-335468] and IPs [192.168.61.80 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0903 23:37:54.691562 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0903 23:37:56.968074 161984 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.276485344s)
I0903 23:37:56.968162 161984 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0903 23:37:56.983462 161984 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0903 23:37:56.994565 161984 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0903 23:37:56.994588 161984 kubeadm.go:157] found existing configuration files:
I0903 23:37:56.994630 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0903 23:37:57.004478 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0903 23:37:57.004542 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0903 23:37:57.015094 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0903 23:37:57.025478 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0903 23:37:57.025544 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0903 23:37:57.036975 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0903 23:37:57.046743 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0903 23:37:57.046797 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0903 23:37:57.057221 161984 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0903 23:37:57.067109 161984 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0903 23:37:57.067161 161984 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0903 23:37:57.077629 161984 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0903 23:37:57.320966 161984 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0903 23:39:53.350090 161984 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0903 23:39:53.350225 161984 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0903 23:39:53.352239 161984 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0903 23:39:53.352325 161984 kubeadm.go:310] [preflight] Running pre-flight checks
I0903 23:39:53.352429 161984 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0903 23:39:53.352559 161984 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0903 23:39:53.352700 161984 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0903 23:39:53.352785 161984 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0903 23:39:53.353884 161984 out.go:252] - Generating certificates and keys ...
I0903 23:39:53.354002 161984 kubeadm.go:310] [certs] Using existing ca certificate authority
I0903 23:39:53.354096 161984 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0903 23:39:53.354204 161984 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0903 23:39:53.354294 161984 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0903 23:39:53.354408 161984 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0903 23:39:53.354488 161984 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0903 23:39:53.354571 161984 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0903 23:39:53.354691 161984 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0903 23:39:53.354803 161984 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0903 23:39:53.354908 161984 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0903 23:39:53.354963 161984 kubeadm.go:310] [certs] Using the existing "sa" key
I0903 23:39:53.355043 161984 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0903 23:39:53.355116 161984 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0903 23:39:53.355189 161984 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0903 23:39:53.355279 161984 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0903 23:39:53.355378 161984 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0903 23:39:53.355503 161984 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0903 23:39:53.355595 161984 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0903 23:39:53.355639 161984 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0903 23:39:53.355708 161984 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0903 23:39:53.356804 161984 out.go:252] - Booting up control plane ...
I0903 23:39:53.356945 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0903 23:39:53.357090 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0903 23:39:53.357200 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0903 23:39:53.357322 161984 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0903 23:39:53.357557 161984 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0903 23:39:53.357628 161984 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0903 23:39:53.357717 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.357955 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.358039 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.358267 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.358357 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.358607 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.358690 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.358948 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.359032 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.359346 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.359365 161984 kubeadm.go:310]
I0903 23:39:53.359417 161984 kubeadm.go:310] Unfortunately, an error has occurred:
I0903 23:39:53.359470 161984 kubeadm.go:310] timed out waiting for the condition
I0903 23:39:53.359476 161984 kubeadm.go:310]
I0903 23:39:53.359539 161984 kubeadm.go:310] This error is likely caused by:
I0903 23:39:53.359578 161984 kubeadm.go:310] - The kubelet is not running
I0903 23:39:53.359718 161984 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0903 23:39:53.359727 161984 kubeadm.go:310]
I0903 23:39:53.359871 161984 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0903 23:39:53.359916 161984 kubeadm.go:310] - 'systemctl status kubelet'
I0903 23:39:53.359961 161984 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0903 23:39:53.359968 161984 kubeadm.go:310]
I0903 23:39:53.360175 161984 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0903 23:39:53.360307 161984 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0903 23:39:53.360316 161984 kubeadm.go:310]
I0903 23:39:53.360461 161984 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0903 23:39:53.360565 161984 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0903 23:39:53.360667 161984 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0903 23:39:53.360764 161984 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0903 23:39:53.360841 161984 kubeadm.go:394] duration metric: took 3m57.809707974s to StartCluster
I0903 23:39:53.360890 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0903 23:39:53.360954 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0903 23:39:53.361022 161984 kubeadm.go:310]
I0903 23:39:53.423382 161984 cri.go:89] found id: ""
I0903 23:39:53.423411 161984 logs.go:282] 0 containers: []
W0903 23:39:53.423422 161984 logs.go:284] No container was found matching "kube-apiserver"
I0903 23:39:53.423430 161984 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0903 23:39:53.423488 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0903 23:39:53.479608 161984 cri.go:89] found id: ""
I0903 23:39:53.479645 161984 logs.go:282] 0 containers: []
W0903 23:39:53.479659 161984 logs.go:284] No container was found matching "etcd"
I0903 23:39:53.479667 161984 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0903 23:39:53.479736 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0903 23:39:53.528071 161984 cri.go:89] found id: ""
I0903 23:39:53.528107 161984 logs.go:282] 0 containers: []
W0903 23:39:53.528121 161984 logs.go:284] No container was found matching "coredns"
I0903 23:39:53.528131 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0903 23:39:53.528202 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0903 23:39:53.573292 161984 cri.go:89] found id: ""
I0903 23:39:53.573335 161984 logs.go:282] 0 containers: []
W0903 23:39:53.573348 161984 logs.go:284] No container was found matching "kube-scheduler"
I0903 23:39:53.573361 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0903 23:39:53.573461 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0903 23:39:53.620296 161984 cri.go:89] found id: ""
I0903 23:39:53.620326 161984 logs.go:282] 0 containers: []
W0903 23:39:53.620334 161984 logs.go:284] No container was found matching "kube-proxy"
I0903 23:39:53.620340 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0903 23:39:53.620395 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0903 23:39:53.671465 161984 cri.go:89] found id: ""
I0903 23:39:53.671500 161984 logs.go:282] 0 containers: []
W0903 23:39:53.671512 161984 logs.go:284] No container was found matching "kube-controller-manager"
I0903 23:39:53.671521 161984 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0903 23:39:53.671600 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0903 23:39:53.726259 161984 cri.go:89] found id: ""
I0903 23:39:53.726297 161984 logs.go:282] 0 containers: []
W0903 23:39:53.726320 161984 logs.go:284] No container was found matching "kindnet"
I0903 23:39:53.726335 161984 logs.go:123] Gathering logs for kubelet ...
I0903 23:39:53.726350 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0903 23:39:53.803144 161984 logs.go:123] Gathering logs for dmesg ...
I0903 23:39:53.803236 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0903 23:39:53.825585 161984 logs.go:123] Gathering logs for describe nodes ...
I0903 23:39:53.825628 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0903 23:39:53.938313 161984 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0903 23:39:53.938350 161984 logs.go:123] Gathering logs for CRI-O ...
I0903 23:39:53.938368 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0903 23:39:54.079732 161984 logs.go:123] Gathering logs for container status ...
I0903 23:39:54.079785 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0903 23:39:54.144894 161984 out.go:434] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0903 23:39:54.144973 161984 out.go:285] *
*
W0903 23:39:54.145064 161984 out.go:285] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0903 23:39:54.145083 161984 out.go:285] *
*
W0903 23:39:54.147493 161984 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0903 23:39:54.150778 161984 out.go:203]
W0903 23:39:54.151952 161984 out.go:285] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0903 23:39:54.152049 161984 out.go:285] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0903 23:39:54.152109 161984 out.go:285] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0903 23:39:54.153719 161984 out.go:203]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-335468 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-335468 -n old-k8s-version-335468
helpers_test.go:247: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-335468 -n old-k8s-version-335468: exit status 6 (333.895807ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0903 23:39:54.569192 168858 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-335468" does not appear in /home/jenkins/minikube-integration/21341-109162/kubeconfig
** /stderr **
helpers_test.go:247: status error: exit status 6 (may be ok)
helpers_test.go:252: <<< TestStartStop/group/old-k8s-version/serial/FirstStart FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-335468 logs -n 25
E0903 23:39:54.713168 113288 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/custom-flannel-380966/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:260: TestStartStop/group/old-k8s-version/serial/FirstStart logs:
-- stdout --
==> Audit <==
┌─────────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ start │ -p embed-certs-088493 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.34.0 │ embed-certs-088493 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:37 UTC │
│ ssh │ -p enable-default-cni-380966 sudo systemctl status containerd --all --full --no-pager │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ │
│ ssh │ -p enable-default-cni-380966 sudo systemctl cat containerd --no-pager │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo cat /lib/systemd/system/containerd.service │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo cat /etc/containerd/config.toml │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo containerd config dump │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo systemctl status crio --all --full --no-pager │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo systemctl cat crio --no-pager │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \; │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ ssh │ -p enable-default-cni-380966 sudo crio config │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ delete │ -p enable-default-cni-380966 │ enable-default-cni-380966 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ delete │ -p disable-driver-mounts-005091 │ disable-driver-mounts-005091 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:36 UTC │
│ start │ -p default-k8s-diff-port-799704 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.34.0 │ default-k8s-diff-port-799704 │ jenkins │ v1.36.0 │ 03 Sep 25 23:36 UTC │ 03 Sep 25 23:37 UTC │
│ addons │ enable metrics-server -p no-preload-434043 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ no-preload-434043 │ jenkins │ v1.36.0 │ 03 Sep 25 23:37 UTC │ 03 Sep 25 23:37 UTC │
│ stop │ -p no-preload-434043 --alsologtostderr -v=3 │ no-preload-434043 │ jenkins │ v1.36.0 │ 03 Sep 25 23:37 UTC │ 03 Sep 25 23:38 UTC │
│ addons │ enable metrics-server -p embed-certs-088493 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ embed-certs-088493 │ jenkins │ v1.36.0 │ 03 Sep 25 23:37 UTC │ 03 Sep 25 23:37 UTC │
│ stop │ -p embed-certs-088493 --alsologtostderr -v=3 │ embed-certs-088493 │ jenkins │ v1.36.0 │ 03 Sep 25 23:37 UTC │ 03 Sep 25 23:39 UTC │
│ addons │ enable metrics-server -p default-k8s-diff-port-799704 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain │ default-k8s-diff-port-799704 │ jenkins │ v1.36.0 │ 03 Sep 25 23:37 UTC │ 03 Sep 25 23:37 UTC │
│ stop │ -p default-k8s-diff-port-799704 --alsologtostderr -v=3 │ default-k8s-diff-port-799704 │ jenkins │ v1.36.0 │ 03 Sep 25 23:37 UTC │ 03 Sep 25 23:39 UTC │
│ addons │ enable dashboard -p no-preload-434043 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ no-preload-434043 │ jenkins │ v1.36.0 │ 03 Sep 25 23:38 UTC │ 03 Sep 25 23:38 UTC │
│ start │ -p no-preload-434043 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.34.0 │ no-preload-434043 │ jenkins │ v1.36.0 │ 03 Sep 25 23:38 UTC │ 03 Sep 25 23:39 UTC │
│ addons │ enable dashboard -p embed-certs-088493 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ embed-certs-088493 │ jenkins │ v1.36.0 │ 03 Sep 25 23:39 UTC │ 03 Sep 25 23:39 UTC │
│ start │ -p embed-certs-088493 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.34.0 │ embed-certs-088493 │ jenkins │ v1.36.0 │ 03 Sep 25 23:39 UTC │ │
│ addons │ enable dashboard -p default-k8s-diff-port-799704 --images=MetricsScraper=registry.k8s.io/echoserver:1.4 │ default-k8s-diff-port-799704 │ jenkins │ v1.36.0 │ 03 Sep 25 23:39 UTC │ 03 Sep 25 23:39 UTC │
│ start │ -p default-k8s-diff-port-799704 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.34.0 │ default-k8s-diff-port-799704 │ jenkins │ v1.36.0 │ 03 Sep 25 23:39 UTC │ │
└─────────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/09/03 23:39:31
Running on machine: ubuntu-20-agent-9
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0903 23:39:31.271818 168525 out.go:360] Setting OutFile to fd 1 ...
I0903 23:39:31.272050 168525 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0903 23:39:31.272058 168525 out.go:374] Setting ErrFile to fd 2...
I0903 23:39:31.272062 168525 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0903 23:39:31.272279 168525 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21341-109162/.minikube/bin
I0903 23:39:31.272813 168525 out.go:368] Setting JSON to false
I0903 23:39:31.273874 168525 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":8515,"bootTime":1756934256,"procs":219,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1083-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0903 23:39:31.273940 168525 start.go:140] virtualization: kvm guest
I0903 23:39:31.275828 168525 out.go:179] * [default-k8s-diff-port-799704] minikube v1.36.0 on Ubuntu 20.04 (kvm/amd64)
I0903 23:39:31.277406 168525 notify.go:220] Checking for updates...
I0903 23:39:31.278829 168525 out.go:179] - MINIKUBE_LOCATION=21341
I0903 23:39:31.280177 168525 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0903 23:39:31.281537 168525 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21341-109162/kubeconfig
I0903 23:39:31.282646 168525 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21341-109162/.minikube
I0903 23:39:31.283774 168525 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I0903 23:39:31.284974 168525 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I0903 23:39:31.286724 168525 config.go:182] Loaded profile config "default-k8s-diff-port-799704": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0903 23:39:31.287351 168525 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:31.287440 168525 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:31.308970 168525 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45085
I0903 23:39:31.309860 168525 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:31.310730 168525 main.go:141] libmachine: Using API Version 1
I0903 23:39:31.310751 168525 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:31.311414 168525 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:31.311676 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:31.311969 168525 driver.go:421] Setting default libvirt URI to qemu:///system
I0903 23:39:31.312450 168525 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:31.312503 168525 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:31.333553 168525 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40457
I0903 23:39:31.334226 168525 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:31.334781 168525 main.go:141] libmachine: Using API Version 1
I0903 23:39:31.334799 168525 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:31.335144 168525 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:31.335265 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:31.388196 168525 out.go:179] * Using the kvm2 driver based on existing profile
I0903 23:39:31.389355 168525 start.go:304] selected driver: kvm2
I0903 23:39:31.389381 168525 start.go:918] validating driver "kvm2" against &{Name:default-k8s-diff-port-799704 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/21147/minikube-v1.36.0-1753487480-21147-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-799704 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.63 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] Listen
Address: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0903 23:39:31.389764 168525 start.go:929] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0903 23:39:31.391092 168525 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0903 23:39:31.391304 168525 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/21341-109162/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0903 23:39:31.418651 168525 install.go:137] /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2 version is 1.36.0
I0903 23:39:31.419224 168525 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0903 23:39:31.419280 168525 cni.go:84] Creating CNI manager for ""
I0903 23:39:31.419338 168525 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0903 23:39:31.419383 168525 start.go:348] cluster config:
{Name:default-k8s-diff-port-799704 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/21147/minikube-v1.36.0-1753487480-21147-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-799704 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.63 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration
:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0903 23:39:31.419512 168525 iso.go:125] acquiring lock: {Name:mk1032fbced3c9e76ba5a04480289e9f07d0eb9c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0903 23:39:31.421091 168525 out.go:179] * Starting "default-k8s-diff-port-799704" primary control-plane node in "default-k8s-diff-port-799704" cluster
I0903 23:39:31.422103 168525 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
I0903 23:39:31.422147 168525 preload.go:146] Found local preload: /home/jenkins/minikube-integration/21341-109162/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
I0903 23:39:31.422156 168525 cache.go:58] Caching tarball of preloaded images
I0903 23:39:31.422278 168525 preload.go:172] Found /home/jenkins/minikube-integration/21341-109162/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0903 23:39:31.422293 168525 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
I0903 23:39:31.422425 168525 profile.go:143] Saving config to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/default-k8s-diff-port-799704/config.json ...
I0903 23:39:31.422671 168525 start.go:360] acquireMachinesLock for default-k8s-diff-port-799704: {Name:mkcbe368d68a51a2a3c0eadc653c4df7d9736b4b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0903 23:39:31.422720 168525 start.go:364] duration metric: took 26.407µs to acquireMachinesLock for "default-k8s-diff-port-799704"
I0903 23:39:31.422741 168525 start.go:96] Skipping create...Using existing machine configuration
I0903 23:39:31.422748 168525 fix.go:54] fixHost starting:
I0903 23:39:31.423078 168525 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:31.423117 168525 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:31.441527 168525 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35531
I0903 23:39:31.442203 168525 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:31.442786 168525 main.go:141] libmachine: Using API Version 1
I0903 23:39:31.442812 168525 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:31.443215 168525 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:31.443398 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:31.443541 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetState
I0903 23:39:31.445456 168525 fix.go:112] recreateIfNeeded on default-k8s-diff-port-799704: state=Stopped err=<nil>
I0903 23:39:31.445508 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
W0903 23:39:31.449565 168525 fix.go:138] unexpected machine state, will restart: <nil>
I0903 23:39:30.924315 167951 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0903 23:39:30.924344 167951 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0903 23:39:30.924364 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHHostname
I0903 23:39:30.925334 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0903 23:39:30.925362 167951 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0903 23:39:30.925405 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHHostname
I0903 23:39:30.928751 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.929980 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.930221 167951 main.go:141] libmachine: (no-preload-434043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:6a:cb", ip: ""} in network mk-no-preload-434043: {Iface:virbr4 ExpiryTime:2025-09-04 00:38:55 +0000 UTC Type:0 Mac:52:54:00:18:6a:cb Iaid: IPaddr:192.168.72.145 Prefix:24 Hostname:no-preload-434043 Clientid:01:52:54:00:18:6a:cb}
I0903 23:39:30.930285 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined IP address 192.168.72.145 and MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.930682 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHPort
I0903 23:39:30.930861 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHKeyPath
I0903 23:39:30.931062 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHUsername
I0903 23:39:30.931098 167951 main.go:141] libmachine: (no-preload-434043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:6a:cb", ip: ""} in network mk-no-preload-434043: {Iface:virbr4 ExpiryTime:2025-09-04 00:38:55 +0000 UTC Type:0 Mac:52:54:00:18:6a:cb Iaid: IPaddr:192.168.72.145 Prefix:24 Hostname:no-preload-434043 Clientid:01:52:54:00:18:6a:cb}
I0903 23:39:30.931116 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined IP address 192.168.72.145 and MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.931175 167951 sshutil.go:53] new ssh client: &{IP:192.168.72.145 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/no-preload-434043/id_rsa Username:docker}
I0903 23:39:30.932066 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHPort
I0903 23:39:30.932251 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHKeyPath
I0903 23:39:30.932469 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHUsername
I0903 23:39:30.932671 167951 sshutil.go:53] new ssh client: &{IP:192.168.72.145 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/no-preload-434043/id_rsa Username:docker}
I0903 23:39:30.933250 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.933904 167951 main.go:141] libmachine: (no-preload-434043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:6a:cb", ip: ""} in network mk-no-preload-434043: {Iface:virbr4 ExpiryTime:2025-09-04 00:38:55 +0000 UTC Type:0 Mac:52:54:00:18:6a:cb Iaid: IPaddr:192.168.72.145 Prefix:24 Hostname:no-preload-434043 Clientid:01:52:54:00:18:6a:cb}
I0903 23:39:30.933932 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined IP address 192.168.72.145 and MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.937721 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHPort
I0903 23:39:30.938011 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHKeyPath
I0903 23:39:30.938313 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHUsername
I0903 23:39:30.938593 167951 sshutil.go:53] new ssh client: &{IP:192.168.72.145 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/no-preload-434043/id_rsa Username:docker}
I0903 23:39:30.942958 167951 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33017
I0903 23:39:30.943534 167951 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:30.944030 167951 main.go:141] libmachine: Using API Version 1
I0903 23:39:30.944053 167951 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:30.944469 167951 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:30.945591 167951 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:30.949659 167951 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:30.970235 167951 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43737
I0903 23:39:30.970997 167951 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:30.971694 167951 main.go:141] libmachine: Using API Version 1
I0903 23:39:30.971723 167951 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:30.972120 167951 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:30.972343 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetState
I0903 23:39:30.974525 167951 main.go:141] libmachine: (no-preload-434043) Calling .DriverName
I0903 23:39:30.974767 167951 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0903 23:39:30.974786 167951 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0903 23:39:30.974806 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHHostname
I0903 23:39:30.978640 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.979150 167951 main.go:141] libmachine: (no-preload-434043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:6a:cb", ip: ""} in network mk-no-preload-434043: {Iface:virbr4 ExpiryTime:2025-09-04 00:38:55 +0000 UTC Type:0 Mac:52:54:00:18:6a:cb Iaid: IPaddr:192.168.72.145 Prefix:24 Hostname:no-preload-434043 Clientid:01:52:54:00:18:6a:cb}
I0903 23:39:30.979183 167951 main.go:141] libmachine: (no-preload-434043) DBG | domain no-preload-434043 has defined IP address 192.168.72.145 and MAC address 52:54:00:18:6a:cb in network mk-no-preload-434043
I0903 23:39:30.979349 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHPort
I0903 23:39:30.979545 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHKeyPath
I0903 23:39:30.979734 167951 main.go:141] libmachine: (no-preload-434043) Calling .GetSSHUsername
I0903 23:39:30.979898 167951 sshutil.go:53] new ssh client: &{IP:192.168.72.145 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/no-preload-434043/id_rsa Username:docker}
I0903 23:39:31.130703 167951 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0903 23:39:31.167066 167951 node_ready.go:35] waiting up to 6m0s for node "no-preload-434043" to be "Ready" ...
I0903 23:39:31.174901 167951 node_ready.go:49] node "no-preload-434043" is "Ready"
I0903 23:39:31.174933 167951 node_ready.go:38] duration metric: took 7.827583ms for node "no-preload-434043" to be "Ready" ...
I0903 23:39:31.174948 167951 api_server.go:52] waiting for apiserver process to appear ...
I0903 23:39:31.174996 167951 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:31.209527 167951 api_server.go:72] duration metric: took 516.97608ms to wait for apiserver process to appear ...
I0903 23:39:31.209554 167951 api_server.go:88] waiting for apiserver healthz status ...
I0903 23:39:31.209577 167951 api_server.go:253] Checking apiserver healthz at https://192.168.72.145:8443/healthz ...
I0903 23:39:31.218555 167951 api_server.go:279] https://192.168.72.145:8443/healthz returned 200:
ok
I0903 23:39:31.221061 167951 api_server.go:141] control plane version: v1.34.0
I0903 23:39:31.221085 167951 api_server.go:131] duration metric: took 11.521702ms to wait for apiserver health ...
I0903 23:39:31.221095 167951 system_pods.go:43] waiting for kube-system pods to appear ...
I0903 23:39:31.228196 167951 system_pods.go:59] 8 kube-system pods found
I0903 23:39:31.228233 167951 system_pods.go:61] "coredns-66bc5c9577-z2s2p" [d39823a0-08dc-474c-bf6b-40d74bb06086] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0903 23:39:31.228243 167951 system_pods.go:61] "etcd-no-preload-434043" [cb3bdc9b-2cc5-48bf-af81-e466291b15ae] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0903 23:39:31.228253 167951 system_pods.go:61] "kube-apiserver-no-preload-434043" [bbc48910-bfce-4152-a0d9-213fab7b0e9d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0903 23:39:31.228262 167951 system_pods.go:61] "kube-controller-manager-no-preload-434043" [368d7eae-18f4-4a7c-9d38-5dba34a34a0d] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0903 23:39:31.228268 167951 system_pods.go:61] "kube-proxy-lf7rz" [d3a15894-b9c5-47b0-9486-4b2f0a646a66] Running
I0903 23:39:31.228279 167951 system_pods.go:61] "kube-scheduler-no-preload-434043" [01f11d9a-a42b-47df-93f8-7a6d34f05eaf] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0903 23:39:31.228287 167951 system_pods.go:61] "metrics-server-746fcd58dc-qn2mm" [e256b1d8-cce6-4144-aa59-a9a030f99eb9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0903 23:39:31.228301 167951 system_pods.go:61] "storage-provisioner" [52149bb2-d696-46fd-a4e6-15ccafdebf02] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0903 23:39:31.228313 167951 system_pods.go:74] duration metric: took 7.210776ms to wait for pod list to return data ...
I0903 23:39:31.228326 167951 default_sa.go:34] waiting for default service account to be created ...
I0903 23:39:31.234005 167951 default_sa.go:45] found service account: "default"
I0903 23:39:31.234030 167951 default_sa.go:55] duration metric: took 5.694551ms for default service account to be created ...
I0903 23:39:31.234042 167951 system_pods.go:116] waiting for k8s-apps to be running ...
I0903 23:39:31.239296 167951 system_pods.go:86] 8 kube-system pods found
I0903 23:39:31.239329 167951 system_pods.go:89] "coredns-66bc5c9577-z2s2p" [d39823a0-08dc-474c-bf6b-40d74bb06086] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0903 23:39:31.239340 167951 system_pods.go:89] "etcd-no-preload-434043" [cb3bdc9b-2cc5-48bf-af81-e466291b15ae] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0903 23:39:31.239351 167951 system_pods.go:89] "kube-apiserver-no-preload-434043" [bbc48910-bfce-4152-a0d9-213fab7b0e9d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0903 23:39:31.239362 167951 system_pods.go:89] "kube-controller-manager-no-preload-434043" [368d7eae-18f4-4a7c-9d38-5dba34a34a0d] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0903 23:39:31.239371 167951 system_pods.go:89] "kube-proxy-lf7rz" [d3a15894-b9c5-47b0-9486-4b2f0a646a66] Running
I0903 23:39:31.239384 167951 system_pods.go:89] "kube-scheduler-no-preload-434043" [01f11d9a-a42b-47df-93f8-7a6d34f05eaf] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0903 23:39:31.239394 167951 system_pods.go:89] "metrics-server-746fcd58dc-qn2mm" [e256b1d8-cce6-4144-aa59-a9a030f99eb9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0903 23:39:31.239405 167951 system_pods.go:89] "storage-provisioner" [52149bb2-d696-46fd-a4e6-15ccafdebf02] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0903 23:39:31.239413 167951 system_pods.go:126] duration metric: took 5.365177ms to wait for k8s-apps to be running ...
I0903 23:39:31.239425 167951 system_svc.go:44] waiting for kubelet service to be running ....
I0903 23:39:31.239473 167951 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0903 23:39:31.292169 167951 system_svc.go:56] duration metric: took 52.735418ms WaitForService to wait for kubelet
I0903 23:39:31.292202 167951 kubeadm.go:578] duration metric: took 599.654473ms to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0903 23:39:31.292225 167951 node_conditions.go:102] verifying NodePressure condition ...
I0903 23:39:31.298898 167951 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I0903 23:39:31.298922 167951 node_conditions.go:123] node cpu capacity is 2
I0903 23:39:31.298936 167951 node_conditions.go:105] duration metric: took 6.70535ms to run NodePressure ...
I0903 23:39:31.298952 167951 start.go:241] waiting for startup goroutines ...
I0903 23:39:31.319927 167951 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0903 23:39:31.319948 167951 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0903 23:39:31.325067 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0903 23:39:31.325090 167951 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0903 23:39:31.329142 167951 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0903 23:39:31.347147 167951 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0903 23:39:31.409588 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0903 23:39:31.409615 167951 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0903 23:39:31.411804 167951 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0903 23:39:31.411826 167951 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0903 23:39:31.497017 167951 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0903 23:39:31.497047 167951 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0903 23:39:31.505080 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0903 23:39:31.505110 167951 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0903 23:39:31.564683 167951 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0903 23:39:31.568463 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0903 23:39:31.568495 167951 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0903 23:39:31.636504 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-role.yaml
I0903 23:39:31.636548 167951 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0903 23:39:31.712523 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0903 23:39:31.712560 167951 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0903 23:39:31.768671 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0903 23:39:31.768718 167951 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0903 23:39:31.852511 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0903 23:39:31.852556 167951 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0903 23:39:31.933535 167951 addons.go:435] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0903 23:39:31.933572 167951 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0903 23:39:32.030695 167951 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0903 23:39:35.006492 167951 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.659296879s)
I0903 23:39:35.006576 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.006592 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.006963 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.006986 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.006998 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.007008 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.007538 167951 main.go:141] libmachine: (no-preload-434043) DBG | Closing plugin on server side
I0903 23:39:35.007589 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.007620 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.010661 167951 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.681478522s)
I0903 23:39:35.010699 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.010709 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.011031 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.011053 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.011063 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.011072 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.012729 167951 main.go:141] libmachine: (no-preload-434043) DBG | Closing plugin on server side
I0903 23:39:35.012763 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.012780 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.093772 167951 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (3.529031226s)
I0903 23:39:35.093830 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.093846 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.094207 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.094235 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.094246 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.094254 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.098319 167951 main.go:141] libmachine: (no-preload-434043) DBG | Closing plugin on server side
I0903 23:39:35.098337 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.098358 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.098371 167951 addons.go:479] Verifying addon metrics-server=true in "no-preload-434043"
I0903 23:39:35.098550 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.098568 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.098881 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.098898 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.294568 167951 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (3.263818135s)
I0903 23:39:35.294653 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.294676 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.295105 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.295130 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.295140 167951 main.go:141] libmachine: Making call to close driver server
I0903 23:39:35.295149 167951 main.go:141] libmachine: (no-preload-434043) Calling .Close
I0903 23:39:35.297127 167951 main.go:141] libmachine: (no-preload-434043) DBG | Closing plugin on server side
I0903 23:39:35.297151 167951 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:35.297172 167951 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:35.298897 167951 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-434043 addons enable metrics-server
I0903 23:39:35.300309 167951 out.go:179] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard
I0903 23:39:30.569160 168184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0903 23:39:30.585799 168184 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0903 23:39:30.590817 168184 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 3 22:28 /usr/share/ca-certificates/minikubeCA.pem
I0903 23:39:30.590881 168184 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0903 23:39:30.598100 168184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0903 23:39:30.611138 168184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113288.pem && ln -fs /usr/share/ca-certificates/113288.pem /etc/ssl/certs/113288.pem"
I0903 23:39:30.626975 168184 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113288.pem
I0903 23:39:30.631962 168184 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 3 22:36 /usr/share/ca-certificates/113288.pem
I0903 23:39:30.632013 168184 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113288.pem
I0903 23:39:30.639457 168184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/113288.pem /etc/ssl/certs/51391683.0"
I0903 23:39:30.652349 168184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1132882.pem && ln -fs /usr/share/ca-certificates/1132882.pem /etc/ssl/certs/1132882.pem"
I0903 23:39:30.669722 168184 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1132882.pem
I0903 23:39:30.676323 168184 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 3 22:36 /usr/share/ca-certificates/1132882.pem
I0903 23:39:30.676391 168184 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1132882.pem
I0903 23:39:30.684739 168184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1132882.pem /etc/ssl/certs/3ec20f2e.0"
I0903 23:39:30.698776 168184 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0903 23:39:30.705787 168184 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0903 23:39:30.715596 168184 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0903 23:39:30.723820 168184 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0903 23:39:30.734268 168184 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0903 23:39:30.751209 168184 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0903 23:39:30.769986 168184 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0903 23:39:30.779742 168184 kubeadm.go:392] StartCluster: {Name:embed-certs-088493 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/21147/minikube-v1.36.0-1753487480-21147-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.47-1756116447-21413@sha256:0420dcb4b989a4f3e21680d5952b2239e0fcff16c7f6520d036ddb10d7c257d9 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34
.0 ClusterName:embed-certs-088493 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.143 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeReq
uested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0903 23:39:30.779870 168184 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0903 23:39:30.779944 168184 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0903 23:39:30.826700 168184 cri.go:89] found id: ""
I0903 23:39:30.826791 168184 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0903 23:39:30.843146 168184 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0903 23:39:30.843174 168184 kubeadm.go:589] restartPrimaryControlPlane start ...
I0903 23:39:30.843233 168184 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0903 23:39:30.856578 168184 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0903 23:39:30.857287 168184 kubeconfig.go:47] verify endpoint returned: get endpoint: "embed-certs-088493" does not appear in /home/jenkins/minikube-integration/21341-109162/kubeconfig
I0903 23:39:30.857752 168184 kubeconfig.go:62] /home/jenkins/minikube-integration/21341-109162/kubeconfig needs updating (will repair): [kubeconfig missing "embed-certs-088493" cluster setting kubeconfig missing "embed-certs-088493" context setting]
I0903 23:39:30.858340 168184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/kubeconfig: {Name:mkb8e4377749caffe9aea4452a6b5de9f0dc7427 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:39:30.859693 168184 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0903 23:39:30.872955 168184 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.50.143
I0903 23:39:30.873001 168184 kubeadm.go:1152] stopping kube-system containers ...
I0903 23:39:30.873018 168184 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0903 23:39:30.873080 168184 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0903 23:39:30.937819 168184 cri.go:89] found id: ""
I0903 23:39:30.937898 168184 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0903 23:39:30.970391 168184 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0903 23:39:30.985618 168184 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0903 23:39:30.985641 168184 kubeadm.go:157] found existing configuration files:
I0903 23:39:30.985702 168184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0903 23:39:30.997473 168184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0903 23:39:30.997551 168184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0903 23:39:31.011825 168184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0903 23:39:31.026448 168184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0903 23:39:31.026510 168184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0903 23:39:31.039622 168184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0903 23:39:31.051294 168184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0903 23:39:31.051360 168184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0903 23:39:31.065244 168184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0903 23:39:31.077889 168184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0903 23:39:31.077952 168184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0903 23:39:31.093981 168184 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0903 23:39:31.108296 168184 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0903 23:39:31.176874 168184 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0903 23:39:32.823767 168184 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.646847779s)
I0903 23:39:32.823806 168184 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0903 23:39:33.102206 168184 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0903 23:39:33.185673 168184 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0903 23:39:33.256402 168184 api_server.go:52] waiting for apiserver process to appear ...
I0903 23:39:33.256504 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:33.757483 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:34.256629 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:34.756682 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:35.257560 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:31.451460 168525 out.go:252] * Restarting existing kvm2 VM for "default-k8s-diff-port-799704" ...
I0903 23:39:31.451487 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .Start
I0903 23:39:31.451677 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) starting domain...
I0903 23:39:31.451780 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) ensuring networks are active...
I0903 23:39:31.452685 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Ensuring network default is active
I0903 23:39:31.453151 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Ensuring network mk-default-k8s-diff-port-799704 is active
I0903 23:39:31.453750 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) getting domain XML...
I0903 23:39:31.454639 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) creating domain...
I0903 23:39:32.850704 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) waiting for IP...
I0903 23:39:32.851600 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:32.852214 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:32.852359 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:32.852203 168561 retry.go:31] will retry after 194.562879ms: waiting for domain to come up
I0903 23:39:33.049200 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:33.049910 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:33.049989 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:33.049872 168561 retry.go:31] will retry after 346.789216ms: waiting for domain to come up
I0903 23:39:33.398907 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:33.399505 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:33.399547 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:33.399469 168561 retry.go:31] will retry after 396.68152ms: waiting for domain to come up
I0903 23:39:33.798263 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:33.799050 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:33.799087 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:33.798998 168561 retry.go:31] will retry after 388.322823ms: waiting for domain to come up
I0903 23:39:34.188660 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:34.189376 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:34.189482 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:34.189334 168561 retry.go:31] will retry after 742.14172ms: waiting for domain to come up
I0903 23:39:34.932960 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:34.933626 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:34.933713 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:34.933579 168561 retry.go:31] will retry after 698.598056ms: waiting for domain to come up
I0903 23:39:35.634753 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:35.635481 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:35.635508 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:35.635369 168561 retry.go:31] will retry after 956.852118ms: waiting for domain to come up
I0903 23:39:35.301402 167951 addons.go:514] duration metric: took 4.608814093s for enable addons: enabled=[storage-provisioner metrics-server default-storageclass dashboard]
I0903 23:39:35.301452 167951 start.go:246] waiting for cluster config update ...
I0903 23:39:35.301470 167951 start.go:255] writing updated cluster config ...
I0903 23:39:35.301784 167951 ssh_runner.go:195] Run: rm -f paused
I0903 23:39:35.306947 167951 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I0903 23:39:35.311995 167951 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-z2s2p" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:35.322196 167951 pod_ready.go:94] pod "coredns-66bc5c9577-z2s2p" is "Ready"
I0903 23:39:35.322232 167951 pod_ready.go:86] duration metric: took 10.20611ms for pod "coredns-66bc5c9577-z2s2p" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:35.327157 167951 pod_ready.go:83] waiting for pod "etcd-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
W0903 23:39:37.336026 167951 pod_ready.go:104] pod "etcd-no-preload-434043" is not "Ready", error: <nil>
I0903 23:39:38.836063 167951 pod_ready.go:94] pod "etcd-no-preload-434043" is "Ready"
I0903 23:39:38.836099 167951 pod_ready.go:86] duration metric: took 3.508912099s for pod "etcd-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:38.844005 167951 pod_ready.go:83] waiting for pod "kube-apiserver-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:38.851465 167951 pod_ready.go:94] pod "kube-apiserver-no-preload-434043" is "Ready"
I0903 23:39:38.851496 167951 pod_ready.go:86] duration metric: took 7.457768ms for pod "kube-apiserver-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:38.853909 167951 pod_ready.go:83] waiting for pod "kube-controller-manager-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:38.859802 167951 pod_ready.go:94] pod "kube-controller-manager-no-preload-434043" is "Ready"
I0903 23:39:38.859824 167951 pod_ready.go:86] duration metric: took 5.889234ms for pod "kube-controller-manager-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:38.863186 167951 pod_ready.go:83] waiting for pod "kube-proxy-lf7rz" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:39.113115 167951 pod_ready.go:94] pod "kube-proxy-lf7rz" is "Ready"
I0903 23:39:39.113155 167951 pod_ready.go:86] duration metric: took 249.948168ms for pod "kube-proxy-lf7rz" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:39.315739 167951 pod_ready.go:83] waiting for pod "kube-scheduler-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:39.712333 167951 pod_ready.go:94] pod "kube-scheduler-no-preload-434043" is "Ready"
I0903 23:39:39.712376 167951 pod_ready.go:86] duration metric: took 396.599596ms for pod "kube-scheduler-no-preload-434043" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:39.712391 167951 pod_ready.go:40] duration metric: took 4.405411155s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I0903 23:39:39.778245 167951 start.go:617] kubectl: 1.33.2, cluster: 1.34.0 (minor skew: 1)
I0903 23:39:39.779595 167951 out.go:179] * Done! kubectl is now configured to use "no-preload-434043" cluster and "default" namespace by default
I0903 23:39:35.756635 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:35.795249 168184 api_server.go:72] duration metric: took 2.538848326s to wait for apiserver process to appear ...
I0903 23:39:35.795285 168184 api_server.go:88] waiting for apiserver healthz status ...
I0903 23:39:35.795314 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:38.583193 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0903 23:39:38.583228 168184 api_server.go:103] status: https://192.168.50.143:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0903 23:39:38.583252 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:38.685816 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0903 23:39:38.685847 168184 api_server.go:103] status: https://192.168.50.143:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0903 23:39:38.796197 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:38.802478 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0903 23:39:38.802514 168184 api_server.go:103] status: https://192.168.50.143:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0903 23:39:39.296152 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:39.304676 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0903 23:39:39.304709 168184 api_server.go:103] status: https://192.168.50.143:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0903 23:39:39.795900 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:39.808669 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0903 23:39:39.808701 168184 api_server.go:103] status: https://192.168.50.143:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-kubernetes-service-cidr-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-status-local-available-controller ok
[+]poststarthook/apiservice-status-remote-available-controller ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0903 23:39:40.296345 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:40.301248 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 200:
ok
I0903 23:39:40.308506 168184 api_server.go:141] control plane version: v1.34.0
I0903 23:39:40.308532 168184 api_server.go:131] duration metric: took 4.513239874s to wait for apiserver health ...
I0903 23:39:40.308544 168184 cni.go:84] Creating CNI manager for ""
I0903 23:39:40.308560 168184 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0903 23:39:40.310257 168184 out.go:179] * Configuring bridge CNI (Container Networking Interface) ...
I0903 23:39:40.311411 168184 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0903 23:39:40.324297 168184 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0903 23:39:40.359191 168184 system_pods.go:43] waiting for kube-system pods to appear ...
I0903 23:39:40.365887 168184 system_pods.go:59] 8 kube-system pods found
I0903 23:39:40.365935 168184 system_pods.go:61] "coredns-66bc5c9577-hg9bb" [f8c43287-ec9a-48ad-b799-e5bb4b30b817] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0903 23:39:40.365948 168184 system_pods.go:61] "etcd-embed-certs-088493" [0917f6cc-6edc-4812-81c3-15f318021f57] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0903 23:39:40.365960 168184 system_pods.go:61] "kube-apiserver-embed-certs-088493" [5324d5b1-225a-4bab-8624-807c65f7737f] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0903 23:39:40.365970 168184 system_pods.go:61] "kube-controller-manager-embed-certs-088493" [c15fb12e-7f6b-4bfe-977c-97d35447e245] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0903 23:39:40.365979 168184 system_pods.go:61] "kube-proxy-pgtpd" [083b9318-0780-4c96-8991-7534443b6159] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0903 23:39:40.365994 168184 system_pods.go:61] "kube-scheduler-embed-certs-088493" [41c8bd25-dbb6-4d53-8642-d6f837c5c859] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0903 23:39:40.366002 168184 system_pods.go:61] "metrics-server-746fcd58dc-85qvg" [000bf568-f6a0-4621-899d-788283765155] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0903 23:39:40.366010 168184 system_pods.go:61] "storage-provisioner" [7c1d1800-66c1-42f5-87c5-675fd6610230] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0903 23:39:40.366018 168184 system_pods.go:74] duration metric: took 6.796748ms to wait for pod list to return data ...
I0903 23:39:40.366035 168184 node_conditions.go:102] verifying NodePressure condition ...
I0903 23:39:40.370198 168184 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I0903 23:39:40.370234 168184 node_conditions.go:123] node cpu capacity is 2
I0903 23:39:40.370251 168184 node_conditions.go:105] duration metric: took 4.209293ms to run NodePressure ...
I0903 23:39:40.370274 168184 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0903 23:39:40.700552 168184 kubeadm.go:720] waiting for restarted kubelet to initialise ...
I0903 23:39:40.707329 168184 kubeadm.go:735] kubelet initialised
I0903 23:39:40.707359 168184 kubeadm.go:736] duration metric: took 6.769898ms waiting for restarted kubelet to initialise ...
I0903 23:39:40.707380 168184 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0903 23:39:40.742387 168184 ops.go:34] apiserver oom_adj: -16
I0903 23:39:40.742423 168184 kubeadm.go:593] duration metric: took 9.899238858s to restartPrimaryControlPlane
I0903 23:39:40.742436 168184 kubeadm.go:394] duration metric: took 9.962706136s to StartCluster
I0903 23:39:40.742460 168184 settings.go:142] acquiring lock: {Name:mkb1ef9c34f4ee762bb1ce9c74e3b8a2e234a4c2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:39:40.742582 168184 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21341-109162/kubeconfig
I0903 23:39:40.744274 168184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21341-109162/kubeconfig: {Name:mkb8e4377749caffe9aea4452a6b5de9f0dc7427 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0903 23:39:40.744616 168184 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.50.143 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0903 23:39:40.744750 168184 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0903 23:39:40.744860 168184 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-088493"
I0903 23:39:40.744868 168184 config.go:182] Loaded profile config "embed-certs-088493": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0903 23:39:40.744881 168184 addons.go:238] Setting addon storage-provisioner=true in "embed-certs-088493"
W0903 23:39:40.744893 168184 addons.go:247] addon storage-provisioner should already be in state true
I0903 23:39:40.744922 168184 addons.go:69] Setting default-storageclass=true in profile "embed-certs-088493"
I0903 23:39:40.744933 168184 addons.go:69] Setting metrics-server=true in profile "embed-certs-088493"
I0903 23:39:40.744944 168184 addons.go:238] Setting addon metrics-server=true in "embed-certs-088493"
I0903 23:39:40.744944 168184 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-088493"
W0903 23:39:40.744954 168184 addons.go:247] addon metrics-server should already be in state true
I0903 23:39:40.744973 168184 host.go:66] Checking if "embed-certs-088493" exists ...
I0903 23:39:40.745459 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.745485 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.745506 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.745535 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.744924 168184 host.go:66] Checking if "embed-certs-088493" exists ...
I0903 23:39:40.745779 168184 addons.go:69] Setting dashboard=true in profile "embed-certs-088493"
I0903 23:39:40.745802 168184 addons.go:238] Setting addon dashboard=true in "embed-certs-088493"
W0903 23:39:40.745830 168184 addons.go:247] addon dashboard should already be in state true
I0903 23:39:40.745870 168184 host.go:66] Checking if "embed-certs-088493" exists ...
I0903 23:39:40.746262 168184 out.go:179] * Verifying Kubernetes components...
I0903 23:39:40.746282 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.746267 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.746391 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.746425 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.747698 168184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0903 23:39:40.767429 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35437
I0903 23:39:40.767449 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38997
I0903 23:39:40.767992 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.768030 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.768589 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.768620 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.768921 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.768944 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.769038 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.769266 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetState
I0903 23:39:40.769418 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.770014 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45587
I0903 23:39:40.770554 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.771097 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.771115 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.771582 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.772143 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.772190 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.773072 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.773117 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.773482 168184 addons.go:238] Setting addon default-storageclass=true in "embed-certs-088493"
W0903 23:39:40.773506 168184 addons.go:247] addon default-storageclass should already be in state true
I0903 23:39:40.773541 168184 host.go:66] Checking if "embed-certs-088493" exists ...
I0903 23:39:40.773952 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.773999 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.774960 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36051
I0903 23:39:40.775401 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.775921 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.775942 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.776349 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.776900 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.776938 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.793573 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42823
I0903 23:39:40.794210 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.794795 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.794822 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.794889 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37443
I0903 23:39:40.795389 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.795443 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.795827 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.795843 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.796051 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetState
I0903 23:39:40.796242 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.796398 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetState
I0903 23:39:40.798691 168184 main.go:141] libmachine: (embed-certs-088493) Calling .DriverName
I0903 23:39:40.799273 168184 main.go:141] libmachine: (embed-certs-088493) Calling .DriverName
I0903 23:39:40.800606 168184 out.go:179] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0903 23:39:40.800622 168184 out.go:179] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0903 23:39:40.801751 168184 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0903 23:39:40.801768 168184 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0903 23:39:40.801852 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHHostname
I0903 23:39:40.803035 168184 out.go:179] - Using image registry.k8s.io/echoserver:1.4
I0903 23:39:40.804238 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0903 23:39:40.804257 168184 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0903 23:39:40.804278 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHHostname
I0903 23:39:40.804408 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39483
I0903 23:39:40.804948 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.806065 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.806185 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.806214 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.806622 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.807366 168184 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/21341-109162/.minikube/bin/docker-machine-driver-kvm2
I0903 23:39:40.807410 168184 main.go:141] libmachine: Launching plugin server for driver kvm2
I0903 23:39:40.807634 168184 main.go:141] libmachine: (embed-certs-088493) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:49:bd:07", ip: ""} in network mk-embed-certs-088493: {Iface:virbr2 ExpiryTime:2025-09-04 00:39:17 +0000 UTC Type:0 Mac:52:54:00:49:bd:07 Iaid: IPaddr:192.168.50.143 Prefix:24 Hostname:embed-certs-088493 Clientid:01:52:54:00:49:bd:07}
I0903 23:39:40.807666 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined IP address 192.168.50.143 and MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.808118 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.808378 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHPort
I0903 23:39:40.808540 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHKeyPath
I0903 23:39:40.808652 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHUsername
I0903 23:39:40.808753 168184 sshutil.go:53] new ssh client: &{IP:192.168.50.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/embed-certs-088493/id_rsa Username:docker}
I0903 23:39:40.813952 168184 main.go:141] libmachine: (embed-certs-088493) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:49:bd:07", ip: ""} in network mk-embed-certs-088493: {Iface:virbr2 ExpiryTime:2025-09-04 00:39:17 +0000 UTC Type:0 Mac:52:54:00:49:bd:07 Iaid: IPaddr:192.168.50.143 Prefix:24 Hostname:embed-certs-088493 Clientid:01:52:54:00:49:bd:07}
I0903 23:39:40.813983 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined IP address 192.168.50.143 and MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.814174 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHPort
I0903 23:39:40.814360 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHKeyPath
I0903 23:39:40.815752 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHUsername
I0903 23:39:40.815909 168184 sshutil.go:53] new ssh client: &{IP:192.168.50.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/embed-certs-088493/id_rsa Username:docker}
I0903 23:39:40.824248 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42633
I0903 23:39:40.824946 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.825622 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.825648 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.826219 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.826431 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetState
I0903 23:39:40.828287 168184 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45625
I0903 23:39:40.828447 168184 main.go:141] libmachine: (embed-certs-088493) Calling .DriverName
I0903 23:39:40.828934 168184 main.go:141] libmachine: () Calling .GetVersion
I0903 23:39:40.829313 168184 main.go:141] libmachine: Using API Version 1
I0903 23:39:40.829328 168184 main.go:141] libmachine: () Calling .SetConfigRaw
I0903 23:39:40.829707 168184 main.go:141] libmachine: () Calling .GetMachineName
I0903 23:39:40.829930 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetState
I0903 23:39:40.830176 168184 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0903 23:39:36.593552 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:36.594179 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:36.594207 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:36.594112 168561 retry.go:31] will retry after 1.356760931s: waiting for domain to come up
I0903 23:39:37.952896 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:37.953568 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:37.953607 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:37.953473 168561 retry.go:31] will retry after 1.294359259s: waiting for domain to come up
I0903 23:39:39.249609 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:39.250217 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:39.250262 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:39.250156 168561 retry.go:31] will retry after 1.639365303s: waiting for domain to come up
I0903 23:39:40.891606 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:40.892251 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:40.892279 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:40.892154 168561 retry.go:31] will retry after 2.142708119s: waiting for domain to come up
I0903 23:39:40.831548 168184 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0903 23:39:40.831567 168184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0903 23:39:40.831594 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHHostname
I0903 23:39:40.831860 168184 main.go:141] libmachine: (embed-certs-088493) Calling .DriverName
I0903 23:39:40.833031 168184 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0903 23:39:40.833048 168184 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0903 23:39:40.833066 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHHostname
I0903 23:39:40.835589 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.836095 168184 main.go:141] libmachine: (embed-certs-088493) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:49:bd:07", ip: ""} in network mk-embed-certs-088493: {Iface:virbr2 ExpiryTime:2025-09-04 00:39:17 +0000 UTC Type:0 Mac:52:54:00:49:bd:07 Iaid: IPaddr:192.168.50.143 Prefix:24 Hostname:embed-certs-088493 Clientid:01:52:54:00:49:bd:07}
I0903 23:39:40.836120 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined IP address 192.168.50.143 and MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.836634 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.836881 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHPort
I0903 23:39:40.837063 168184 main.go:141] libmachine: (embed-certs-088493) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:49:bd:07", ip: ""} in network mk-embed-certs-088493: {Iface:virbr2 ExpiryTime:2025-09-04 00:39:17 +0000 UTC Type:0 Mac:52:54:00:49:bd:07 Iaid: IPaddr:192.168.50.143 Prefix:24 Hostname:embed-certs-088493 Clientid:01:52:54:00:49:bd:07}
I0903 23:39:40.837087 168184 main.go:141] libmachine: (embed-certs-088493) DBG | domain embed-certs-088493 has defined IP address 192.168.50.143 and MAC address 52:54:00:49:bd:07 in network mk-embed-certs-088493
I0903 23:39:40.837348 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHPort
I0903 23:39:40.838498 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHKeyPath
I0903 23:39:40.838667 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHUsername
I0903 23:39:40.838816 168184 sshutil.go:53] new ssh client: &{IP:192.168.50.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/embed-certs-088493/id_rsa Username:docker}
I0903 23:39:40.843815 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHKeyPath
I0903 23:39:40.844047 168184 main.go:141] libmachine: (embed-certs-088493) Calling .GetSSHUsername
I0903 23:39:40.844370 168184 sshutil.go:53] new ssh client: &{IP:192.168.50.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/embed-certs-088493/id_rsa Username:docker}
I0903 23:39:41.113695 168184 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0903 23:39:41.140527 168184 node_ready.go:35] waiting up to 6m0s for node "embed-certs-088493" to be "Ready" ...
I0903 23:39:41.252354 168184 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0903 23:39:41.252385 168184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0903 23:39:41.306321 168184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0903 23:39:41.310664 168184 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0903 23:39:41.310766 168184 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0903 23:39:41.341460 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0903 23:39:41.341572 168184 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0903 23:39:41.348238 168184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0903 23:39:41.399239 168184 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0903 23:39:41.399275 168184 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0903 23:39:41.412810 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0903 23:39:41.412848 168184 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0903 23:39:41.489435 168184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0903 23:39:41.538185 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0903 23:39:41.538223 168184 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0903 23:39:41.592563 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0903 23:39:41.592594 168184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0903 23:39:41.676605 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-role.yaml
I0903 23:39:41.676644 168184 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0903 23:39:41.728419 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0903 23:39:41.728455 168184 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0903 23:39:41.766195 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0903 23:39:41.766297 168184 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0903 23:39:41.819460 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0903 23:39:41.819504 168184 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0903 23:39:41.870107 168184 addons.go:435] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0903 23:39:41.870149 168184 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0903 23:39:41.918698 168184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0903 23:39:42.966984 168184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.660540637s)
I0903 23:39:42.967054 168184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.618774457s)
I0903 23:39:42.967081 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:42.967098 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:42.967101 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:42.967114 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:42.967189 168184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.477716601s)
I0903 23:39:42.967236 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:42.967261 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:42.969478 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:42.969480 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:42.969503 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:42.969506 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:42.969513 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:42.969523 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:42.969513 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:42.969546 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:42.969559 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:42.969588 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:42.969601 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:42.969611 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:42.969628 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:42.969708 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:42.969726 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:42.971080 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:42.971088 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:42.971098 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:42.971104 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:42.971084 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:42.971185 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:42.971197 168184 addons.go:479] Verifying addon metrics-server=true in "embed-certs-088493"
I0903 23:39:42.971403 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:42.971416 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:43.018871 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:43.018900 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:43.019306 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:43.019354 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:43.019366 168184 main.go:141] libmachine: Making call to close connection to plugin binary
W0903 23:39:43.162588 168184 node_ready.go:57] node "embed-certs-088493" has "Ready":"False" status (will retry)
I0903 23:39:43.258660 168184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.339847622s)
I0903 23:39:43.258727 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:43.258741 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:43.259077 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:43.259137 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:43.259145 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:43.259162 168184 main.go:141] libmachine: Making call to close driver server
I0903 23:39:43.259279 168184 main.go:141] libmachine: (embed-certs-088493) Calling .Close
I0903 23:39:43.259595 168184 main.go:141] libmachine: (embed-certs-088493) DBG | Closing plugin on server side
I0903 23:39:43.259615 168184 main.go:141] libmachine: Successfully made call to close driver server
I0903 23:39:43.259623 168184 main.go:141] libmachine: Making call to close connection to plugin binary
I0903 23:39:43.260848 168184 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p embed-certs-088493 addons enable metrics-server
I0903 23:39:43.261929 168184 out.go:179] * Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
I0903 23:39:43.262942 168184 addons.go:514] duration metric: took 2.518204365s for enable addons: enabled=[metrics-server storage-provisioner default-storageclass dashboard]
I0903 23:39:43.036707 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:43.037307 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:43.037341 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:43.037251 168561 retry.go:31] will retry after 2.378633942s: waiting for domain to come up
I0903 23:39:45.418699 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:45.419270 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | unable to find current IP address of domain default-k8s-diff-port-799704 in network mk-default-k8s-diff-port-799704
I0903 23:39:45.419294 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | I0903 23:39:45.419170 168561 retry.go:31] will retry after 4.350956655s: waiting for domain to come up
W0903 23:39:45.644356 168184 node_ready.go:57] node "embed-certs-088493" has "Ready":"False" status (will retry)
W0903 23:39:47.702029 168184 node_ready.go:57] node "embed-certs-088493" has "Ready":"False" status (will retry)
I0903 23:39:49.646957 168184 node_ready.go:49] node "embed-certs-088493" is "Ready"
I0903 23:39:49.646992 168184 node_ready.go:38] duration metric: took 8.506385518s for node "embed-certs-088493" to be "Ready" ...
I0903 23:39:49.647010 168184 api_server.go:52] waiting for apiserver process to appear ...
I0903 23:39:49.647071 168184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0903 23:39:49.674344 168184 api_server.go:72] duration metric: took 8.92968556s to wait for apiserver process to appear ...
I0903 23:39:49.674379 168184 api_server.go:88] waiting for apiserver healthz status ...
I0903 23:39:49.674406 168184 api_server.go:253] Checking apiserver healthz at https://192.168.50.143:8443/healthz ...
I0903 23:39:49.683534 168184 api_server.go:279] https://192.168.50.143:8443/healthz returned 200:
ok
I0903 23:39:49.684659 168184 api_server.go:141] control plane version: v1.34.0
I0903 23:39:49.684684 168184 api_server.go:131] duration metric: took 10.295954ms to wait for apiserver health ...
I0903 23:39:49.684697 168184 system_pods.go:43] waiting for kube-system pods to appear ...
I0903 23:39:49.689273 168184 system_pods.go:59] 8 kube-system pods found
I0903 23:39:49.689307 168184 system_pods.go:61] "coredns-66bc5c9577-hg9bb" [f8c43287-ec9a-48ad-b799-e5bb4b30b817] Running
I0903 23:39:49.689322 168184 system_pods.go:61] "etcd-embed-certs-088493" [0917f6cc-6edc-4812-81c3-15f318021f57] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0903 23:39:49.689331 168184 system_pods.go:61] "kube-apiserver-embed-certs-088493" [5324d5b1-225a-4bab-8624-807c65f7737f] Running
I0903 23:39:49.689343 168184 system_pods.go:61] "kube-controller-manager-embed-certs-088493" [c15fb12e-7f6b-4bfe-977c-97d35447e245] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0903 23:39:49.689353 168184 system_pods.go:61] "kube-proxy-pgtpd" [083b9318-0780-4c96-8991-7534443b6159] Running
I0903 23:39:49.689371 168184 system_pods.go:61] "kube-scheduler-embed-certs-088493" [41c8bd25-dbb6-4d53-8642-d6f837c5c859] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0903 23:39:49.689380 168184 system_pods.go:61] "metrics-server-746fcd58dc-85qvg" [000bf568-f6a0-4621-899d-788283765155] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0903 23:39:49.689416 168184 system_pods.go:61] "storage-provisioner" [7c1d1800-66c1-42f5-87c5-675fd6610230] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0903 23:39:49.689425 168184 system_pods.go:74] duration metric: took 4.720826ms to wait for pod list to return data ...
I0903 23:39:49.689442 168184 default_sa.go:34] waiting for default service account to be created ...
I0903 23:39:49.693818 168184 default_sa.go:45] found service account: "default"
I0903 23:39:49.693835 168184 default_sa.go:55] duration metric: took 4.384486ms for default service account to be created ...
I0903 23:39:49.693843 168184 system_pods.go:116] waiting for k8s-apps to be running ...
I0903 23:39:49.697438 168184 system_pods.go:86] 8 kube-system pods found
I0903 23:39:49.697471 168184 system_pods.go:89] "coredns-66bc5c9577-hg9bb" [f8c43287-ec9a-48ad-b799-e5bb4b30b817] Running
I0903 23:39:49.697486 168184 system_pods.go:89] "etcd-embed-certs-088493" [0917f6cc-6edc-4812-81c3-15f318021f57] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0903 23:39:49.697493 168184 system_pods.go:89] "kube-apiserver-embed-certs-088493" [5324d5b1-225a-4bab-8624-807c65f7737f] Running
I0903 23:39:49.697509 168184 system_pods.go:89] "kube-controller-manager-embed-certs-088493" [c15fb12e-7f6b-4bfe-977c-97d35447e245] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0903 23:39:49.697519 168184 system_pods.go:89] "kube-proxy-pgtpd" [083b9318-0780-4c96-8991-7534443b6159] Running
I0903 23:39:49.697529 168184 system_pods.go:89] "kube-scheduler-embed-certs-088493" [41c8bd25-dbb6-4d53-8642-d6f837c5c859] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0903 23:39:49.697543 168184 system_pods.go:89] "metrics-server-746fcd58dc-85qvg" [000bf568-f6a0-4621-899d-788283765155] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0903 23:39:49.697557 168184 system_pods.go:89] "storage-provisioner" [7c1d1800-66c1-42f5-87c5-675fd6610230] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0903 23:39:49.697572 168184 system_pods.go:126] duration metric: took 3.722231ms to wait for k8s-apps to be running ...
I0903 23:39:49.697586 168184 system_svc.go:44] waiting for kubelet service to be running ....
I0903 23:39:49.697650 168184 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0903 23:39:49.722443 168184 system_svc.go:56] duration metric: took 24.84315ms WaitForService to wait for kubelet
I0903 23:39:49.722482 168184 kubeadm.go:578] duration metric: took 8.977829577s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0903 23:39:49.722519 168184 node_conditions.go:102] verifying NodePressure condition ...
I0903 23:39:49.728053 168184 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I0903 23:39:49.728077 168184 node_conditions.go:123] node cpu capacity is 2
I0903 23:39:49.728088 168184 node_conditions.go:105] duration metric: took 5.564387ms to run NodePressure ...
I0903 23:39:49.728101 168184 start.go:241] waiting for startup goroutines ...
I0903 23:39:49.728110 168184 start.go:246] waiting for cluster config update ...
I0903 23:39:49.728123 168184 start.go:255] writing updated cluster config ...
I0903 23:39:49.728441 168184 ssh_runner.go:195] Run: rm -f paused
I0903 23:39:49.735381 168184 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I0903 23:39:49.742029 168184 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-hg9bb" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:49.750961 168184 pod_ready.go:94] pod "coredns-66bc5c9577-hg9bb" is "Ready"
I0903 23:39:49.750990 168184 pod_ready.go:86] duration metric: took 8.940148ms for pod "coredns-66bc5c9577-hg9bb" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:49.753806 168184 pod_ready.go:83] waiting for pod "etcd-embed-certs-088493" in "kube-system" namespace to be "Ready" or be gone ...
I0903 23:39:49.772119 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.772626 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) found domain IP: 192.168.39.63
I0903 23:39:49.772661 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has current primary IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.772672 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) reserving static IP address...
I0903 23:39:49.773083 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-799704", mac: "52:54:00:a0:5b:2e", ip: "192.168.39.63"} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:49.773114 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | skip adding static IP to network mk-default-k8s-diff-port-799704 - found existing host DHCP lease matching {name: "default-k8s-diff-port-799704", mac: "52:54:00:a0:5b:2e", ip: "192.168.39.63"}
I0903 23:39:49.773130 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) reserved static IP address 192.168.39.63 for domain default-k8s-diff-port-799704
I0903 23:39:49.773143 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) waiting for SSH...
I0903 23:39:49.773158 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | Getting to WaitForSSH function...
I0903 23:39:49.775358 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.775784 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:49.775821 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.775914 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | Using SSH client type: external
I0903 23:39:49.775969 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | Using SSH private key: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/default-k8s-diff-port-799704/id_rsa (-rw-------)
I0903 23:39:49.776034 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.63 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/21341-109162/.minikube/machines/default-k8s-diff-port-799704/id_rsa -p 22] /usr/bin/ssh <nil>}
I0903 23:39:49.776052 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | About to run SSH command:
I0903 23:39:49.776061 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | exit 0
I0903 23:39:49.901906 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | SSH cmd err, output: <nil>:
I0903 23:39:49.902261 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetConfigRaw
I0903 23:39:49.902844 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetIP
I0903 23:39:49.905187 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.905557 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:49.905588 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.905853 168525 profile.go:143] Saving config to /home/jenkins/minikube-integration/21341-109162/.minikube/profiles/default-k8s-diff-port-799704/config.json ...
I0903 23:39:49.906117 168525 machine.go:93] provisionDockerMachine start ...
I0903 23:39:49.906164 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:49.906436 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:49.909118 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.909485 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:49.909517 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:49.909628 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:49.909805 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:49.909987 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:49.910151 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:49.910306 168525 main.go:141] libmachine: Using SSH client type: native
I0903 23:39:49.910527 168525 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.39.63 22 <nil> <nil>}
I0903 23:39:49.910537 168525 main.go:141] libmachine: About to run SSH command:
hostname
I0903 23:39:50.014640 168525 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0903 23:39:50.014669 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetMachineName
I0903 23:39:50.014904 168525 buildroot.go:166] provisioning hostname "default-k8s-diff-port-799704"
I0903 23:39:50.014929 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetMachineName
I0903 23:39:50.015114 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:50.018055 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.018422 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:50.018472 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.018636 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:50.018849 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.019076 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.019257 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:50.019426 168525 main.go:141] libmachine: Using SSH client type: native
I0903 23:39:50.019678 168525 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.39.63 22 <nil> <nil>}
I0903 23:39:50.019694 168525 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-799704 && echo "default-k8s-diff-port-799704" | sudo tee /etc/hostname
I0903 23:39:50.141537 168525 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-799704
I0903 23:39:50.141574 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:50.144682 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.145019 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:50.145049 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.145195 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:50.145418 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.145562 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.145700 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:50.145911 168525 main.go:141] libmachine: Using SSH client type: native
I0903 23:39:50.146180 168525 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.39.63 22 <nil> <nil>}
I0903 23:39:50.146199 168525 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-799704' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-799704/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-799704' | sudo tee -a /etc/hosts;
fi
fi
I0903 23:39:50.255397 168525 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0903 23:39:50.255427 168525 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/21341-109162/.minikube CaCertPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21341-109162/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21341-109162/.minikube}
I0903 23:39:50.255451 168525 buildroot.go:174] setting up certificates
I0903 23:39:50.255466 168525 provision.go:84] configureAuth start
I0903 23:39:50.255483 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetMachineName
I0903 23:39:50.255836 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetIP
I0903 23:39:50.259446 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.259884 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:50.259914 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.260088 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:50.262682 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.263060 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:50.263100 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.263203 168525 provision.go:143] copyHostCerts
I0903 23:39:50.263281 168525 exec_runner.go:144] found /home/jenkins/minikube-integration/21341-109162/.minikube/ca.pem, removing ...
I0903 23:39:50.263299 168525 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21341-109162/.minikube/ca.pem
I0903 23:39:50.263354 168525 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21341-109162/.minikube/ca.pem (1078 bytes)
I0903 23:39:50.263438 168525 exec_runner.go:144] found /home/jenkins/minikube-integration/21341-109162/.minikube/cert.pem, removing ...
I0903 23:39:50.263446 168525 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21341-109162/.minikube/cert.pem
I0903 23:39:50.263465 168525 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21341-109162/.minikube/cert.pem (1123 bytes)
I0903 23:39:50.263519 168525 exec_runner.go:144] found /home/jenkins/minikube-integration/21341-109162/.minikube/key.pem, removing ...
I0903 23:39:50.263526 168525 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21341-109162/.minikube/key.pem
I0903 23:39:50.263542 168525 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21341-109162/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21341-109162/.minikube/key.pem (1675 bytes)
I0903 23:39:50.263587 168525 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21341-109162/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-799704 san=[127.0.0.1 192.168.39.63 default-k8s-diff-port-799704 localhost minikube]
I0903 23:39:50.602313 168525 provision.go:177] copyRemoteCerts
I0903 23:39:50.602368 168525 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0903 23:39:50.602392 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:50.604930 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.605268 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:50.605301 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.605502 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:50.605701 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.605883 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:50.606030 168525 sshutil.go:53] new ssh client: &{IP:192.168.39.63 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/default-k8s-diff-port-799704/id_rsa Username:docker}
I0903 23:39:50.692788 168525 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0903 23:39:50.719278 168525 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0903 23:39:50.746292 168525 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0903 23:39:50.774559 168525 provision.go:87] duration metric: took 519.07244ms to configureAuth
I0903 23:39:50.774589 168525 buildroot.go:189] setting minikube options for container-runtime
I0903 23:39:50.774798 168525 config.go:182] Loaded profile config "default-k8s-diff-port-799704": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0903 23:39:50.774882 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:50.777459 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.777817 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:50.777847 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:50.778019 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:50.778203 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.778379 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:50.778490 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:50.778617 168525 main.go:141] libmachine: Using SSH client type: native
I0903 23:39:50.778835 168525 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.39.63 22 <nil> <nil>}
I0903 23:39:50.778855 168525 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0903 23:39:51.011695 168525 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0903 23:39:51.011726 168525 machine.go:96] duration metric: took 1.105578172s to provisionDockerMachine
I0903 23:39:51.011744 168525 start.go:293] postStartSetup for "default-k8s-diff-port-799704" (driver="kvm2")
I0903 23:39:51.011757 168525 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0903 23:39:51.011779 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:51.012153 168525 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0903 23:39:51.012191 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:51.015053 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.015411 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:51.015438 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.015633 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:51.015847 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:51.016003 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:51.016183 168525 sshutil.go:53] new ssh client: &{IP:192.168.39.63 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/default-k8s-diff-port-799704/id_rsa Username:docker}
I0903 23:39:51.106391 168525 ssh_runner.go:195] Run: cat /etc/os-release
I0903 23:39:51.111268 168525 info.go:137] Remote host: Buildroot 2025.02
I0903 23:39:51.111302 168525 filesync.go:126] Scanning /home/jenkins/minikube-integration/21341-109162/.minikube/addons for local assets ...
I0903 23:39:51.111378 168525 filesync.go:126] Scanning /home/jenkins/minikube-integration/21341-109162/.minikube/files for local assets ...
I0903 23:39:51.111475 168525 filesync.go:149] local asset: /home/jenkins/minikube-integration/21341-109162/.minikube/files/etc/ssl/certs/1132882.pem -> 1132882.pem in /etc/ssl/certs
I0903 23:39:51.111606 168525 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0903 23:39:51.124981 168525 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21341-109162/.minikube/files/etc/ssl/certs/1132882.pem --> /etc/ssl/certs/1132882.pem (1708 bytes)
I0903 23:39:51.157053 168525 start.go:296] duration metric: took 145.28983ms for postStartSetup
I0903 23:39:51.157106 168525 fix.go:56] duration metric: took 19.734351982s for fixHost
I0903 23:39:51.157130 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:51.159836 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.160235 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:51.160300 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.160437 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:51.160644 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:51.160820 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:51.161007 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:51.161249 168525 main.go:141] libmachine: Using SSH client type: native
I0903 23:39:51.161542 168525 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83a420] 0x83d120 <nil> [] 0s} 192.168.39.63 22 <nil> <nil>}
I0903 23:39:51.161568 168525 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0903 23:39:51.267613 168525 main.go:141] libmachine: SSH cmd err, output: <nil>: 1756942791.225994565
I0903 23:39:51.267649 168525 fix.go:216] guest clock: 1756942791.225994565
I0903 23:39:51.267659 168525 fix.go:229] Guest: 2025-09-03 23:39:51.225994565 +0000 UTC Remote: 2025-09-03 23:39:51.1571123 +0000 UTC m=+19.923532049 (delta=68.882265ms)
I0903 23:39:51.267680 168525 fix.go:200] guest clock delta is within tolerance: 68.882265ms
I0903 23:39:51.267685 168525 start.go:83] releasing machines lock for "default-k8s-diff-port-799704", held for 19.844953372s
I0903 23:39:51.267705 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:51.267968 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetIP
I0903 23:39:51.271046 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.271416 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:51.271440 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.271654 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:51.272313 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:51.272572 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .DriverName
I0903 23:39:51.272657 168525 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0903 23:39:51.272709 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:51.272800 168525 ssh_runner.go:195] Run: cat /version.json
I0903 23:39:51.272831 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHHostname
I0903 23:39:51.275925 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.276358 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:51.276389 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.276409 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.276565 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:51.276733 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:51.276885 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a0:5b:2e", ip: ""} in network mk-default-k8s-diff-port-799704: {Iface:virbr1 ExpiryTime:2025-09-04 00:39:43 +0000 UTC Type:0 Mac:52:54:00:a0:5b:2e Iaid: IPaddr:192.168.39.63 Prefix:24 Hostname:default-k8s-diff-port-799704 Clientid:01:52:54:00:a0:5b:2e}
I0903 23:39:51.276908 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) DBG | domain default-k8s-diff-port-799704 has defined IP address 192.168.39.63 and MAC address 52:54:00:a0:5b:2e in network mk-default-k8s-diff-port-799704
I0903 23:39:51.276918 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:51.277054 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHPort
I0903 23:39:51.277112 168525 sshutil.go:53] new ssh client: &{IP:192.168.39.63 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/default-k8s-diff-port-799704/id_rsa Username:docker}
I0903 23:39:51.277187 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHKeyPath
I0903 23:39:51.277335 168525 main.go:141] libmachine: (default-k8s-diff-port-799704) Calling .GetSSHUsername
I0903 23:39:51.277486 168525 sshutil.go:53] new ssh client: &{IP:192.168.39.63 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/21341-109162/.minikube/machines/default-k8s-diff-port-799704/id_rsa Username:docker}
I0903 23:39:51.379057 168525 ssh_runner.go:195] Run: systemctl --version
I0903 23:39:51.384960 168525 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0903 23:39:51.529307 168525 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0903 23:39:51.537936 168525 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0903 23:39:51.538011 168525 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0903 23:39:51.558368 168525 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0903 23:39:51.558394 168525 start.go:495] detecting cgroup driver to use...
I0903 23:39:51.558466 168525 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0903 23:39:51.578951 168525 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0903 23:39:51.596694 168525 docker.go:218] disabling cri-docker service (if available) ...
I0903 23:39:51.596752 168525 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0903 23:39:51.613345 168525 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0903 23:39:51.627714 168525 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0903 23:39:51.771138 168525 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0903 23:39:51.904861 168525 docker.go:234] disabling docker service ...
I0903 23:39:51.904942 168525 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0903 23:39:51.921699 168525 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0903 23:39:51.935975 168525 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0903 23:39:52.148548 168525 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0903 23:39:52.296698 168525 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0903 23:39:52.312273 168525 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0903 23:39:52.336148 168525 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I0903 23:39:52.336224 168525 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.348966 168525 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0903 23:39:52.349044 168525 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.362982 168525 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.379362 168525 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.391934 168525 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0903 23:39:52.409486 168525 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.422712 168525 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.442694 168525 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0903 23:39:52.454945 168525 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0903 23:39:52.465176 168525 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 1
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0903 23:39:52.465229 168525 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0903 23:39:52.484711 168525 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0903 23:39:52.497721 168525 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0903 23:39:52.656667 168525 ssh_runner.go:195] Run: sudo systemctl restart crio
I0903 23:39:52.772929 168525 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0903 23:39:52.773004 168525 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0903 23:39:52.778525 168525 start.go:563] Will wait 60s for crictl version
I0903 23:39:52.778587 168525 ssh_runner.go:195] Run: which crictl
I0903 23:39:52.782973 168525 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0903 23:39:52.831724 168525 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0903 23:39:52.831911 168525 ssh_runner.go:195] Run: crio --version
I0903 23:39:52.862674 168525 ssh_runner.go:195] Run: crio --version
I0903 23:39:52.892236 168525 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.29.1 ...
I0903 23:39:53.350090 161984 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0903 23:39:53.350225 161984 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0903 23:39:53.352239 161984 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0903 23:39:53.352325 161984 kubeadm.go:310] [preflight] Running pre-flight checks
I0903 23:39:53.352429 161984 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0903 23:39:53.352559 161984 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0903 23:39:53.352700 161984 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0903 23:39:53.352785 161984 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0903 23:39:53.353884 161984 out.go:252] - Generating certificates and keys ...
I0903 23:39:53.354002 161984 kubeadm.go:310] [certs] Using existing ca certificate authority
I0903 23:39:53.354096 161984 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0903 23:39:53.354204 161984 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0903 23:39:53.354294 161984 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0903 23:39:53.354408 161984 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0903 23:39:53.354488 161984 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0903 23:39:53.354571 161984 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0903 23:39:53.354691 161984 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0903 23:39:53.354803 161984 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0903 23:39:53.354908 161984 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0903 23:39:53.354963 161984 kubeadm.go:310] [certs] Using the existing "sa" key
I0903 23:39:53.355043 161984 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0903 23:39:53.355116 161984 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0903 23:39:53.355189 161984 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0903 23:39:53.355279 161984 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0903 23:39:53.355378 161984 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0903 23:39:53.355503 161984 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0903 23:39:53.355595 161984 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0903 23:39:53.355639 161984 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0903 23:39:53.355708 161984 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0903 23:39:53.356804 161984 out.go:252] - Booting up control plane ...
I0903 23:39:53.356945 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0903 23:39:53.357090 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0903 23:39:53.357200 161984 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0903 23:39:53.357322 161984 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0903 23:39:53.357557 161984 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0903 23:39:53.357628 161984 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0903 23:39:53.357717 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.357955 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.358039 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.358267 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.358357 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.358607 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.358690 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.358948 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.359032 161984 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0903 23:39:53.359346 161984 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0903 23:39:53.359365 161984 kubeadm.go:310]
I0903 23:39:53.359417 161984 kubeadm.go:310] Unfortunately, an error has occurred:
I0903 23:39:53.359470 161984 kubeadm.go:310] timed out waiting for the condition
I0903 23:39:53.359476 161984 kubeadm.go:310]
I0903 23:39:53.359539 161984 kubeadm.go:310] This error is likely caused by:
I0903 23:39:53.359578 161984 kubeadm.go:310] - The kubelet is not running
I0903 23:39:53.359718 161984 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0903 23:39:53.359727 161984 kubeadm.go:310]
I0903 23:39:53.359871 161984 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0903 23:39:53.359916 161984 kubeadm.go:310] - 'systemctl status kubelet'
I0903 23:39:53.359961 161984 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0903 23:39:53.359968 161984 kubeadm.go:310]
I0903 23:39:53.360175 161984 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0903 23:39:53.360307 161984 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0903 23:39:53.360316 161984 kubeadm.go:310]
I0903 23:39:53.360461 161984 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0903 23:39:53.360565 161984 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0903 23:39:53.360667 161984 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0903 23:39:53.360764 161984 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0903 23:39:53.360841 161984 kubeadm.go:394] duration metric: took 3m57.809707974s to StartCluster
I0903 23:39:53.360890 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0903 23:39:53.360954 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0903 23:39:53.361022 161984 kubeadm.go:310]
I0903 23:39:53.423382 161984 cri.go:89] found id: ""
I0903 23:39:53.423411 161984 logs.go:282] 0 containers: []
W0903 23:39:53.423422 161984 logs.go:284] No container was found matching "kube-apiserver"
I0903 23:39:53.423430 161984 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0903 23:39:53.423488 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0903 23:39:53.479608 161984 cri.go:89] found id: ""
I0903 23:39:53.479645 161984 logs.go:282] 0 containers: []
W0903 23:39:53.479659 161984 logs.go:284] No container was found matching "etcd"
I0903 23:39:53.479667 161984 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0903 23:39:53.479736 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0903 23:39:53.528071 161984 cri.go:89] found id: ""
I0903 23:39:53.528107 161984 logs.go:282] 0 containers: []
W0903 23:39:53.528121 161984 logs.go:284] No container was found matching "coredns"
I0903 23:39:53.528131 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0903 23:39:53.528202 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0903 23:39:53.573292 161984 cri.go:89] found id: ""
I0903 23:39:53.573335 161984 logs.go:282] 0 containers: []
W0903 23:39:53.573348 161984 logs.go:284] No container was found matching "kube-scheduler"
I0903 23:39:53.573361 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0903 23:39:53.573461 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0903 23:39:53.620296 161984 cri.go:89] found id: ""
I0903 23:39:53.620326 161984 logs.go:282] 0 containers: []
W0903 23:39:53.620334 161984 logs.go:284] No container was found matching "kube-proxy"
I0903 23:39:53.620340 161984 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0903 23:39:53.620395 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0903 23:39:53.671465 161984 cri.go:89] found id: ""
I0903 23:39:53.671500 161984 logs.go:282] 0 containers: []
W0903 23:39:53.671512 161984 logs.go:284] No container was found matching "kube-controller-manager"
I0903 23:39:53.671521 161984 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0903 23:39:53.671600 161984 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0903 23:39:53.726259 161984 cri.go:89] found id: ""
I0903 23:39:53.726297 161984 logs.go:282] 0 containers: []
W0903 23:39:53.726320 161984 logs.go:284] No container was found matching "kindnet"
I0903 23:39:53.726335 161984 logs.go:123] Gathering logs for kubelet ...
I0903 23:39:53.726350 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0903 23:39:53.803144 161984 logs.go:123] Gathering logs for dmesg ...
I0903 23:39:53.803236 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0903 23:39:53.825585 161984 logs.go:123] Gathering logs for describe nodes ...
I0903 23:39:53.825628 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0903 23:39:53.938313 161984 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0903 23:39:53.938350 161984 logs.go:123] Gathering logs for CRI-O ...
I0903 23:39:53.938368 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0903 23:39:54.079732 161984 logs.go:123] Gathering logs for container status ...
I0903 23:39:54.079785 161984 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0903 23:39:54.144894 161984 out.go:434] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0903 23:39:54.144973 161984 out.go:285] *
W0903 23:39:54.145064 161984 out.go:285] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0903 23:39:54.145083 161984 out.go:285] *
W0903 23:39:54.147493 161984 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0903 23:39:54.150778 161984 out.go:203]
W0903 23:39:54.151952 161984 out.go:285] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0903 23:39:54.152049 161984 out.go:285] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0903 23:39:54.152109 161984 out.go:285] * Related issue: https://github.com/kubernetes/minikube/issues/4172
I0903 23:39:54.153719 161984 out.go:203]
==> CRI-O <==
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.058604459Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1756942795058584466,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:112689,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=a12178cb-90ea-4e38-b117-f2e6e72e93c2 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.059240325Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=a9a129b1-c47a-4d0d-97b7-820330c83193 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.059443002Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=a9a129b1-c47a-4d0d-97b7-820330c83193 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.059867661Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{},}" file="otel-collector/interceptors.go:74" id=a9a129b1-c47a-4d0d-97b7-820330c83193 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.113708348Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=08144207-f75e-4e97-836b-84d4acdddb15 name=/runtime.v1.RuntimeService/Version
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.113872212Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=08144207-f75e-4e97-836b-84d4acdddb15 name=/runtime.v1.RuntimeService/Version
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.118598528Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=644b4532-68bd-4df6-97b1-f873546aca43 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.119312903Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1756942795119278279,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:112689,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=644b4532-68bd-4df6-97b1-f873546aca43 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.120185716Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=0e48b4ec-2bc0-467d-9342-f2f20091db88 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.120283096Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=0e48b4ec-2bc0-467d-9342-f2f20091db88 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.120351568Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{},}" file="otel-collector/interceptors.go:74" id=0e48b4ec-2bc0-467d-9342-f2f20091db88 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.181493695Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=c5a1305c-e5c9-4c90-b3b9-625587d98592 name=/runtime.v1.RuntimeService/Version
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.181731164Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=c5a1305c-e5c9-4c90-b3b9-625587d98592 name=/runtime.v1.RuntimeService/Version
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.184162665Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=fb35ca20-fcb7-4b68-8b31-ae83f3caae33 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.185105102Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1756942795185077276,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:112689,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=fb35ca20-fcb7-4b68-8b31-ae83f3caae33 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.185808895Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=f845aa1b-db00-47b4-8a31-13bc27544eb2 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.185907295Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=f845aa1b-db00-47b4-8a31-13bc27544eb2 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.185961613Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{},}" file="otel-collector/interceptors.go:74" id=f845aa1b-db00-47b4-8a31-13bc27544eb2 name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.231357843Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=6257ddf8-47c2-4ef1-a49b-b07a078bf104 name=/runtime.v1.RuntimeService/Version
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.231502377Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=6257ddf8-47c2-4ef1-a49b-b07a078bf104 name=/runtime.v1.RuntimeService/Version
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.233504345Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=0f1680eb-9db1-460d-a53d-84ef1fb65639 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.233964167Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1756942795233941352,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:112689,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=0f1680eb-9db1-460d-a53d-84ef1fb65639 name=/runtime.v1.ImageService/ImageFsInfo
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.236034688Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=61c442a8-c3ef-4aea-aff2-481fec4869dd name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.236115459Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=61c442a8-c3ef-4aea-aff2-481fec4869dd name=/runtime.v1.RuntimeService/ListContainers
Sep 03 23:39:55 old-k8s-version-335468 crio[824]: time="2025-09-03 23:39:55.236153329Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{},}" file="otel-collector/interceptors.go:74" id=61c442a8-c3ef-4aea-aff2-481fec4869dd name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
==> describe nodes <==
command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
==> dmesg <==
[Sep 3 23:35] Booted with the nomodeset parameter. Only the system framebuffer will be available
[ +0.000010] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ +0.000046] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +0.017584] (rpcbind)[118]: rpcbind.service: Referenced but unset environment variable evaluates to an empty string: RPCBIND_OPTIONS
[ +1.215007] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000022] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +0.089265] kauditd_printk_skb: 1 callbacks suppressed
[ +0.110682] kauditd_printk_skb: 46 callbacks suppressed
[ +0.144101] kauditd_printk_skb: 18 callbacks suppressed
[Sep 3 23:36] kauditd_printk_skb: 18 callbacks suppressed
==> kernel <==
23:39:55 up 4 min, 0 users, load average: 0.02, 0.11, 0.06
Linux old-k8s-version-335468 6.6.95 #1 SMP PREEMPT_DYNAMIC Sat Jul 26 03:21:57 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2025.02"
==> kubelet <==
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: goroutine 151 [select]:
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: net.(*netFD).connect.func2(0x4f7fe40, 0xc000c77ec0, 0xc000cbe580, 0xc000ddee40, 0xc000ddede0)
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /usr/local/go/src/net/fd_unix.go:118 +0xc5
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: created by net.(*netFD).connect
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /usr/local/go/src/net/fd_unix.go:117 +0x234
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: goroutine 152 [syscall]:
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: syscall.Syscall6(0xe8, 0xe, 0xc000a8fb6c, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0, 0x0)
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /usr/local/go/src/syscall/asm_linux_amd64.s:41 +0x5
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: k8s.io/kubernetes/vendor/golang.org/x/sys/unix.EpollWait(0xe, 0xc000a8fb6c, 0x7, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0)
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:76 +0x72
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: k8s.io/kubernetes/vendor/github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc000ce8360, 0x0, 0x0, 0x0)
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: k8s.io/kubernetes/vendor/github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc000c1b130)
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x206
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: created by k8s.io/kubernetes/vendor/github.com/fsnotify/fsnotify.NewWatcher
Sep 03 23:39:54 old-k8s-version-335468 kubelet[1943]: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/fsnotify/fsnotify/inotify.go:59 +0x1a8
Sep 03 23:39:54 old-k8s-version-335468 systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Sep 03 23:39:54 old-k8s-version-335468 systemd[1]: kubelet.service: Failed with result 'exit-code'.
Sep 03 23:39:55 old-k8s-version-335468 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 20.
Sep 03 23:39:55 old-k8s-version-335468 systemd[1]: Started kubelet: The Kubernetes Node Agent.
Sep 03 23:39:55 old-k8s-version-335468 kubelet[2054]: I0903 23:39:55.262199 2054 server.go:416] Version: v1.20.0
Sep 03 23:39:55 old-k8s-version-335468 kubelet[2054]: I0903 23:39:55.262843 2054 server.go:837] Client rotation is on, will bootstrap in background
Sep 03 23:39:55 old-k8s-version-335468 kubelet[2054]: I0903 23:39:55.266238 2054 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Sep 03 23:39:55 old-k8s-version-335468 kubelet[2054]: W0903 23:39:55.268135 2054 manager.go:159] Cannot detect current cgroup on cgroup v2
Sep 03 23:39:55 old-k8s-version-335468 kubelet[2054]: I0903 23:39:55.268587 2054 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/minikube/certs/ca.crt
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-335468 -n old-k8s-version-335468
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-335468 -n old-k8s-version-335468: exit status 6 (521.031017ms)
-- stdout --
Stopped
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0903 23:39:56.034772 168917 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-335468" does not appear in /home/jenkins/minikube-integration/21341-109162/kubeconfig
** /stderr **
helpers_test.go:262: status error: exit status 6 (may be ok)
helpers_test.go:264: "old-k8s-version-335468" apiserver is not running, skipping kubectl commands (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (278.11s)