=== RUN   TestAddons/Setup

addons_test.go:110: (dbg) Run:  out/minikube-linux-amd64 start -p addons-033173 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:110: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-033173 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: signal: killed (39m59.955717016s)

-- stdout --

	* [addons-033173] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19370

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19370-323890/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-323890/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-033173" primary control-plane node in "addons-033173" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image docker.io/marcnuri/yakd:0.0.5

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	  - Using image docker.io/registry:2.8.3

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	  - Using image ghcr.io/helm/tiller:v2.17.0

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.1

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	  - Using image docker.io/busybox:stable

	* Verifying ingress addon...

	* Verifying registry addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-033173 service yakd-dashboard -n yakd-dashboard

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	* Verifying csi-hostpath-driver addon...

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-033173 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: storage-provisioner, nvidia-device-plugin, metrics-server, ingress-dns, inspektor-gadget, helm-tiller, cloud-spanner, yakd, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

-- /stdout --

** stderr ** 

	I0803 23:03:13.031478  331973 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:03:13.031599  331973 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:03:13.031605  331973 out.go:304] Setting ErrFile to fd 2...

	I0803 23:03:13.031612  331973 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:03:13.031841  331973 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:03:13.032480  331973 out.go:298] Setting JSON to false

	I0803 23:03:13.033460  331973 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":27941,"bootTime":1722698252,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0803 23:03:13.033551  331973 start.go:139] virtualization: kvm guest

	I0803 23:03:13.035553  331973 out.go:177] * [addons-033173] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0803 23:03:13.037094  331973 out.go:177]   - MINIKUBE_LOCATION=19370

	I0803 23:03:13.037124  331973 notify.go:220] Checking for updates...

	I0803 23:03:13.039632  331973 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0803 23:03:13.041213  331973 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:03:13.042685  331973 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:03:13.044157  331973 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0803 23:03:13.045566  331973 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0803 23:03:13.046965  331973 driver.go:392] Setting default libvirt URI to qemu:///system

	I0803 23:03:13.080839  331973 out.go:177] * Using the kvm2 driver based on user configuration

	I0803 23:03:13.082141  331973 start.go:297] selected driver: kvm2

	I0803 23:03:13.082160  331973 start.go:901] validating driver "kvm2" against <nil>

	I0803 23:03:13.082177  331973 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0803 23:03:13.083111  331973 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0803 23:03:13.083186  331973 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19370-323890/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0803 23:03:13.099313  331973 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0803 23:03:13.099377  331973 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0803 23:03:13.099622  331973 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:03:13.099652  331973 cni.go:84] Creating CNI manager for ""

	I0803 23:03:13.099660  331973 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0803 23:03:13.099673  331973 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0803 23:03:13.099731  331973 start.go:340] cluster config:

	{Name:addons-033173 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-033173 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:03:13.099850  331973 iso.go:125] acquiring lock: {Name:mke18ad45a0f8e7ec51adacd21c7952f17bf0357 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0803 23:03:13.101932  331973 out.go:177] * Starting "addons-033173" primary control-plane node in "addons-033173" cluster

	I0803 23:03:13.103249  331973 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:03:13.103296  331973 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4

	I0803 23:03:13.103307  331973 cache.go:56] Caching tarball of preloaded images

	I0803 23:03:13.103407  331973 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:03:13.103418  331973 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:03:13.103772  331973 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/config.json ...

	I0803 23:03:13.103805  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/config.json: {Name:mk77935e700cc1ade8f2199427f496b09033ce80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:13.103961  331973 start.go:360] acquireMachinesLock for addons-033173: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:03:13.104007  331973 start.go:364] duration metric: took 32.827µs to acquireMachinesLock for "addons-033173"

	I0803 23:03:13.104025  331973 start.go:93] Provisioning new machine with config: &{Name:addons-033173 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.30.3 ClusterName:addons-033173 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:03:13.104096  331973 start.go:125] createHost starting for "" (driver="kvm2")

	I0803 23:03:13.105598  331973 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0803 23:03:13.105769  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:03:13.105820  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:03:13.121404  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39333

	I0803 23:03:13.121916  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:03:13.122583  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:03:13.122605  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:03:13.123058  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:03:13.123283  331973 main.go:141] libmachine: (addons-033173) Calling .GetMachineName

	I0803 23:03:13.123489  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:13.123670  331973 start.go:159] libmachine.API.Create for "addons-033173" (driver="kvm2")

	I0803 23:03:13.123706  331973 client.go:168] LocalClient.Create starting

	I0803 23:03:13.123765  331973 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:03:13.229125  331973 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:03:13.311472  331973 main.go:141] libmachine: Running pre-create checks...

	I0803 23:03:13.311499  331973 main.go:141] libmachine: (addons-033173) Calling .PreCreateCheck

	I0803 23:03:13.312151  331973 main.go:141] libmachine: (addons-033173) Calling .GetConfigRaw

	I0803 23:03:13.312645  331973 main.go:141] libmachine: Creating machine...

	I0803 23:03:13.312661  331973 main.go:141] libmachine: (addons-033173) Calling .Create

	I0803 23:03:13.312880  331973 main.go:141] libmachine: (addons-033173) Creating KVM machine...

	I0803 23:03:13.314316  331973 main.go:141] libmachine: (addons-033173) DBG | found existing default KVM network

	I0803 23:03:13.315134  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:13.314915  331995 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ad0}

	I0803 23:03:13.315154  331973 main.go:141] libmachine: (addons-033173) DBG | created network xml: 

	I0803 23:03:13.315169  331973 main.go:141] libmachine: (addons-033173) DBG | <network>

	I0803 23:03:13.315177  331973 main.go:141] libmachine: (addons-033173) DBG |   <name>mk-addons-033173</name>

	I0803 23:03:13.315189  331973 main.go:141] libmachine: (addons-033173) DBG |   <dns enable='no'/>

	I0803 23:03:13.315197  331973 main.go:141] libmachine: (addons-033173) DBG |   

	I0803 23:03:13.315210  331973 main.go:141] libmachine: (addons-033173) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0803 23:03:13.315221  331973 main.go:141] libmachine: (addons-033173) DBG |     <dhcp>

	I0803 23:03:13.315267  331973 main.go:141] libmachine: (addons-033173) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0803 23:03:13.315291  331973 main.go:141] libmachine: (addons-033173) DBG |     </dhcp>

	I0803 23:03:13.315302  331973 main.go:141] libmachine: (addons-033173) DBG |   </ip>

	I0803 23:03:13.315334  331973 main.go:141] libmachine: (addons-033173) DBG |   

	I0803 23:03:13.315348  331973 main.go:141] libmachine: (addons-033173) DBG | </network>

	I0803 23:03:13.315355  331973 main.go:141] libmachine: (addons-033173) DBG | 

	I0803 23:03:13.320816  331973 main.go:141] libmachine: (addons-033173) DBG | trying to create private KVM network mk-addons-033173 192.168.39.0/24...

	I0803 23:03:13.392901  331973 main.go:141] libmachine: (addons-033173) DBG | private KVM network mk-addons-033173 192.168.39.0/24 created

	I0803 23:03:13.392961  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:13.392849  331995 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:03:13.392996  331973 main.go:141] libmachine: (addons-033173) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173 ...

	I0803 23:03:13.393026  331973 main.go:141] libmachine: (addons-033173) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:03:13.393088  331973 main.go:141] libmachine: (addons-033173) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:03:13.649475  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:13.649314  331995 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa...

	I0803 23:03:13.893196  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:13.893016  331995 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/addons-033173.rawdisk...

	I0803 23:03:13.893234  331973 main.go:141] libmachine: (addons-033173) DBG | Writing magic tar header

	I0803 23:03:13.893250  331973 main.go:141] libmachine: (addons-033173) DBG | Writing SSH key tar header

	I0803 23:03:13.893263  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:13.893136  331995 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173 ...

	I0803 23:03:13.893277  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173

	I0803 23:03:13.893286  331973 main.go:141] libmachine: (addons-033173) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173 (perms=drwx------)

	I0803 23:03:13.893293  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:03:13.893301  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:03:13.893306  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:03:13.893314  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:03:13.893319  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:03:13.893327  331973 main.go:141] libmachine: (addons-033173) DBG | Checking permissions on dir: /home

	I0803 23:03:13.893334  331973 main.go:141] libmachine: (addons-033173) DBG | Skipping /home - not owner

	I0803 23:03:13.893372  331973 main.go:141] libmachine: (addons-033173) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:03:13.893410  331973 main.go:141] libmachine: (addons-033173) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:03:13.893421  331973 main.go:141] libmachine: (addons-033173) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:03:13.893432  331973 main.go:141] libmachine: (addons-033173) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:03:13.893439  331973 main.go:141] libmachine: (addons-033173) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:03:13.893447  331973 main.go:141] libmachine: (addons-033173) Creating domain...

	I0803 23:03:13.894619  331973 main.go:141] libmachine: (addons-033173) define libvirt domain using xml: 

	I0803 23:03:13.894648  331973 main.go:141] libmachine: (addons-033173) <domain type='kvm'>

	I0803 23:03:13.894667  331973 main.go:141] libmachine: (addons-033173)   <name>addons-033173</name>

	I0803 23:03:13.894681  331973 main.go:141] libmachine: (addons-033173)   <memory unit='MiB'>4000</memory>

	I0803 23:03:13.894691  331973 main.go:141] libmachine: (addons-033173)   <vcpu>2</vcpu>

	I0803 23:03:13.894695  331973 main.go:141] libmachine: (addons-033173)   <features>

	I0803 23:03:13.894701  331973 main.go:141] libmachine: (addons-033173)     <acpi/>

	I0803 23:03:13.894705  331973 main.go:141] libmachine: (addons-033173)     <apic/>

	I0803 23:03:13.894710  331973 main.go:141] libmachine: (addons-033173)     <pae/>

	I0803 23:03:13.894717  331973 main.go:141] libmachine: (addons-033173)     

	I0803 23:03:13.894722  331973 main.go:141] libmachine: (addons-033173)   </features>

	I0803 23:03:13.894740  331973 main.go:141] libmachine: (addons-033173)   <cpu mode='host-passthrough'>

	I0803 23:03:13.894752  331973 main.go:141] libmachine: (addons-033173)   

	I0803 23:03:13.894773  331973 main.go:141] libmachine: (addons-033173)   </cpu>

	I0803 23:03:13.894783  331973 main.go:141] libmachine: (addons-033173)   <os>

	I0803 23:03:13.894791  331973 main.go:141] libmachine: (addons-033173)     <type>hvm</type>

	I0803 23:03:13.894800  331973 main.go:141] libmachine: (addons-033173)     <boot dev='cdrom'/>

	I0803 23:03:13.894804  331973 main.go:141] libmachine: (addons-033173)     <boot dev='hd'/>

	I0803 23:03:13.894816  331973 main.go:141] libmachine: (addons-033173)     <bootmenu enable='no'/>

	I0803 23:03:13.894825  331973 main.go:141] libmachine: (addons-033173)   </os>

	I0803 23:03:13.894834  331973 main.go:141] libmachine: (addons-033173)   <devices>

	I0803 23:03:13.894849  331973 main.go:141] libmachine: (addons-033173)     <disk type='file' device='cdrom'>

	I0803 23:03:13.894862  331973 main.go:141] libmachine: (addons-033173)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/boot2docker.iso'/>

	I0803 23:03:13.894874  331973 main.go:141] libmachine: (addons-033173)       <target dev='hdc' bus='scsi'/>

	I0803 23:03:13.894884  331973 main.go:141] libmachine: (addons-033173)       <readonly/>

	I0803 23:03:13.894893  331973 main.go:141] libmachine: (addons-033173)     </disk>

	I0803 23:03:13.894901  331973 main.go:141] libmachine: (addons-033173)     <disk type='file' device='disk'>

	I0803 23:03:13.894912  331973 main.go:141] libmachine: (addons-033173)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:03:13.894928  331973 main.go:141] libmachine: (addons-033173)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/addons-033173.rawdisk'/>

	I0803 23:03:13.894939  331973 main.go:141] libmachine: (addons-033173)       <target dev='hda' bus='virtio'/>

	I0803 23:03:13.894947  331973 main.go:141] libmachine: (addons-033173)     </disk>

	I0803 23:03:13.894957  331973 main.go:141] libmachine: (addons-033173)     <interface type='network'>

	I0803 23:03:13.894966  331973 main.go:141] libmachine: (addons-033173)       <source network='mk-addons-033173'/>

	I0803 23:03:13.894976  331973 main.go:141] libmachine: (addons-033173)       <model type='virtio'/>

	I0803 23:03:13.894984  331973 main.go:141] libmachine: (addons-033173)     </interface>

	I0803 23:03:13.894992  331973 main.go:141] libmachine: (addons-033173)     <interface type='network'>

	I0803 23:03:13.895001  331973 main.go:141] libmachine: (addons-033173)       <source network='default'/>

	I0803 23:03:13.895012  331973 main.go:141] libmachine: (addons-033173)       <model type='virtio'/>

	I0803 23:03:13.895030  331973 main.go:141] libmachine: (addons-033173)     </interface>

	I0803 23:03:13.895040  331973 main.go:141] libmachine: (addons-033173)     <serial type='pty'>

	I0803 23:03:13.895051  331973 main.go:141] libmachine: (addons-033173)       <target port='0'/>

	I0803 23:03:13.895060  331973 main.go:141] libmachine: (addons-033173)     </serial>

	I0803 23:03:13.895072  331973 main.go:141] libmachine: (addons-033173)     <console type='pty'>

	I0803 23:03:13.895085  331973 main.go:141] libmachine: (addons-033173)       <target type='serial' port='0'/>

	I0803 23:03:13.895096  331973 main.go:141] libmachine: (addons-033173)     </console>

	I0803 23:03:13.895108  331973 main.go:141] libmachine: (addons-033173)     <rng model='virtio'>

	I0803 23:03:13.895121  331973 main.go:141] libmachine: (addons-033173)       <backend model='random'>/dev/random</backend>

	I0803 23:03:13.895130  331973 main.go:141] libmachine: (addons-033173)     </rng>

	I0803 23:03:13.895138  331973 main.go:141] libmachine: (addons-033173)     

	I0803 23:03:13.895147  331973 main.go:141] libmachine: (addons-033173)     

	I0803 23:03:13.895155  331973 main.go:141] libmachine: (addons-033173)   </devices>

	I0803 23:03:13.895163  331973 main.go:141] libmachine: (addons-033173) </domain>

	I0803 23:03:13.895171  331973 main.go:141] libmachine: (addons-033173) 

	I0803 23:03:13.899926  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:83:41:34 in network default

	I0803 23:03:13.900564  331973 main.go:141] libmachine: (addons-033173) Ensuring networks are active...

	I0803 23:03:13.900587  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:13.901306  331973 main.go:141] libmachine: (addons-033173) Ensuring network default is active

	I0803 23:03:13.901663  331973 main.go:141] libmachine: (addons-033173) Ensuring network mk-addons-033173 is active

	I0803 23:03:13.902241  331973 main.go:141] libmachine: (addons-033173) Getting domain xml...

	I0803 23:03:13.903015  331973 main.go:141] libmachine: (addons-033173) Creating domain...

	I0803 23:03:15.117949  331973 main.go:141] libmachine: (addons-033173) Waiting to get IP...

	I0803 23:03:15.118671  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:15.119065  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:15.119100  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:15.119054  331995 retry.go:31] will retry after 248.031155ms: waiting for machine to come up

	I0803 23:03:15.368694  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:15.369148  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:15.369178  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:15.369088  331995 retry.go:31] will retry after 352.952651ms: waiting for machine to come up

	I0803 23:03:15.723749  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:15.724139  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:15.724167  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:15.724088  331995 retry.go:31] will retry after 347.757434ms: waiting for machine to come up

	I0803 23:03:16.073827  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:16.074266  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:16.074295  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:16.074217  331995 retry.go:31] will retry after 407.702757ms: waiting for machine to come up

	I0803 23:03:16.484019  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:16.484467  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:16.484528  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:16.484433  331995 retry.go:31] will retry after 634.618076ms: waiting for machine to come up

	I0803 23:03:17.120319  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:17.120809  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:17.120840  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:17.120746  331995 retry.go:31] will retry after 664.264074ms: waiting for machine to come up

	I0803 23:03:17.786704  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:17.787424  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:17.787457  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:17.787348  331995 retry.go:31] will retry after 1.152641891s: waiting for machine to come up

	I0803 23:03:18.941322  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:18.941803  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:18.941830  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:18.941758  331995 retry.go:31] will retry after 1.01564361s: waiting for machine to come up

	I0803 23:03:19.959073  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:19.959544  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:19.959575  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:19.959477  331995 retry.go:31] will retry after 1.628485704s: waiting for machine to come up

	I0803 23:03:21.590490  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:21.591011  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:21.591036  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:21.590958  331995 retry.go:31] will retry after 2.012438941s: waiting for machine to come up

	I0803 23:03:23.605446  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:23.605913  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:23.605939  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:23.605874  331995 retry.go:31] will retry after 2.54955195s: waiting for machine to come up

	I0803 23:03:26.158501  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:26.158923  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:26.158955  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:26.158860  331995 retry.go:31] will retry after 2.509870991s: waiting for machine to come up

	I0803 23:03:28.670049  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:28.670525  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:28.670555  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:28.670471  331995 retry.go:31] will retry after 3.650888556s: waiting for machine to come up

	I0803 23:03:32.325284  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:32.325605  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find current IP address of domain addons-033173 in network mk-addons-033173

	I0803 23:03:32.325629  331973 main.go:141] libmachine: (addons-033173) DBG | I0803 23:03:32.325555  331995 retry.go:31] will retry after 4.690136019s: waiting for machine to come up

	I0803 23:03:37.020370  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.020862  331973 main.go:141] libmachine: (addons-033173) Found IP for machine: 192.168.39.243

	I0803 23:03:37.020890  331973 main.go:141] libmachine: (addons-033173) Reserving static IP address...

	I0803 23:03:37.020924  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has current primary IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.021265  331973 main.go:141] libmachine: (addons-033173) DBG | unable to find host DHCP lease matching {name: "addons-033173", mac: "52:54:00:3e:69:02", ip: "192.168.39.243"} in network mk-addons-033173

	I0803 23:03:37.100858  331973 main.go:141] libmachine: (addons-033173) DBG | Getting to WaitForSSH function...

	I0803 23:03:37.100887  331973 main.go:141] libmachine: (addons-033173) Reserved static IP address: 192.168.39.243

	I0803 23:03:37.100901  331973 main.go:141] libmachine: (addons-033173) Waiting for SSH to be available...

	I0803 23:03:37.103899  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.104432  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:minikube Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.104459  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.104574  331973 main.go:141] libmachine: (addons-033173) DBG | Using SSH client type: external

	I0803 23:03:37.104601  331973 main.go:141] libmachine: (addons-033173) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa (-rw-------)

	I0803 23:03:37.104644  331973 main.go:141] libmachine: (addons-033173) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.243 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:03:37.104661  331973 main.go:141] libmachine: (addons-033173) DBG | About to run SSH command:

	I0803 23:03:37.104675  331973 main.go:141] libmachine: (addons-033173) DBG | exit 0

	I0803 23:03:37.233989  331973 main.go:141] libmachine: (addons-033173) DBG | SSH cmd err, output: <nil>: 

	I0803 23:03:37.234269  331973 main.go:141] libmachine: (addons-033173) KVM machine creation complete!

	I0803 23:03:37.234666  331973 main.go:141] libmachine: (addons-033173) Calling .GetConfigRaw

	I0803 23:03:37.235246  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:37.235507  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:37.235748  331973 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:03:37.235766  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:03:37.237360  331973 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:03:37.237378  331973 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:03:37.237386  331973 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:03:37.237396  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:37.239920  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.240237  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.240257  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.240411  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:37.240614  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.240767  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.240895  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:37.241060  331973 main.go:141] libmachine: Using SSH client type: native

	I0803 23:03:37.241262  331973 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.243 22 <nil> <nil>}

	I0803 23:03:37.241273  331973 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:03:37.352950  331973 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:03:37.352977  331973 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:03:37.352985  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:37.356041  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.356460  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.356508  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.356666  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:37.356870  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.357030  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.357184  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:37.357365  331973 main.go:141] libmachine: Using SSH client type: native

	I0803 23:03:37.357604  331973 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.243 22 <nil> <nil>}

	I0803 23:03:37.357620  331973 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:03:37.470823  331973 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:03:37.470957  331973 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:03:37.470973  331973 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:03:37.470984  331973 main.go:141] libmachine: (addons-033173) Calling .GetMachineName

	I0803 23:03:37.471263  331973 buildroot.go:166] provisioning hostname "addons-033173"

	I0803 23:03:37.471299  331973 main.go:141] libmachine: (addons-033173) Calling .GetMachineName

	I0803 23:03:37.471549  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:37.474284  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.474642  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.474667  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.474836  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:37.475019  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.475179  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.475315  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:37.475472  331973 main.go:141] libmachine: Using SSH client type: native

	I0803 23:03:37.475660  331973 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.243 22 <nil> <nil>}

	I0803 23:03:37.475672  331973 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-033173 && echo "addons-033173" | sudo tee /etc/hostname

	I0803 23:03:37.600377  331973 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-033173

	I0803 23:03:37.600409  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:37.603205  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.603490  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.603521  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.603691  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:37.603897  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.604064  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.604198  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:37.604375  331973 main.go:141] libmachine: Using SSH client type: native

	I0803 23:03:37.604587  331973 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.243 22 <nil> <nil>}

	I0803 23:03:37.604603  331973 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-033173' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-033173/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-033173' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:03:37.727023  331973 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:03:37.727060  331973 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:03:37.727098  331973 buildroot.go:174] setting up certificates

	I0803 23:03:37.727113  331973 provision.go:84] configureAuth start

	I0803 23:03:37.727131  331973 main.go:141] libmachine: (addons-033173) Calling .GetMachineName

	I0803 23:03:37.727461  331973 main.go:141] libmachine: (addons-033173) Calling .GetIP

	I0803 23:03:37.730415  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.730843  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.730876  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.731013  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:37.733038  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.733316  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.733344  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.733470  331973 provision.go:143] copyHostCerts

	I0803 23:03:37.733573  331973 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:03:37.733701  331973 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:03:37.733768  331973 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:03:37.733826  331973 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.addons-033173 san=[127.0.0.1 192.168.39.243 addons-033173 localhost minikube]

	I0803 23:03:37.871163  331973 provision.go:177] copyRemoteCerts

	I0803 23:03:37.871236  331973 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:03:37.871278  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:37.874177  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.874484  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:37.874514  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:37.874707  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:37.874929  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:37.875121  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:37.875391  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:03:37.964477  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:03:37.993685  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0803 23:03:38.021957  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0803 23:03:38.050644  331973 provision.go:87] duration metric: took 323.512847ms to configureAuth

	I0803 23:03:38.050680  331973 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:03:38.050904  331973 config.go:182] Loaded profile config "addons-033173": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:03:38.051081  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:38.054187  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.054565  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.054589  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.054775  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:38.054966  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.055141  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.055264  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:38.055401  331973 main.go:141] libmachine: Using SSH client type: native

	I0803 23:03:38.055582  331973 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.243 22 <nil> <nil>}

	I0803 23:03:38.055597  331973 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:03:38.351739  331973 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:03:38.351787  331973 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:03:38.351796  331973 main.go:141] libmachine: (addons-033173) Calling .GetURL

	I0803 23:03:38.353077  331973 main.go:141] libmachine: (addons-033173) DBG | Using libvirt version 6000000

	I0803 23:03:38.356079  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.356504  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.356536  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.356690  331973 main.go:141] libmachine: Docker is up and running!

	I0803 23:03:38.356707  331973 main.go:141] libmachine: Reticulating splines...

	I0803 23:03:38.356716  331973 client.go:171] duration metric: took 25.23299847s to LocalClient.Create

	I0803 23:03:38.356745  331973 start.go:167] duration metric: took 25.233075562s to libmachine.API.Create "addons-033173"

	I0803 23:03:38.356757  331973 start.go:293] postStartSetup for "addons-033173" (driver="kvm2")

	I0803 23:03:38.356768  331973 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:03:38.356786  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:38.357050  331973 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:03:38.357072  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:38.359215  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.359530  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.359561  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.359689  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:38.359869  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.360013  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:38.360113  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:03:38.448653  331973 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:03:38.453183  331973 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:03:38.453220  331973 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:03:38.453317  331973 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:03:38.453348  331973 start.go:296] duration metric: took 96.585916ms for postStartSetup

	I0803 23:03:38.453399  331973 main.go:141] libmachine: (addons-033173) Calling .GetConfigRaw

	I0803 23:03:38.453996  331973 main.go:141] libmachine: (addons-033173) Calling .GetIP

	I0803 23:03:38.456632  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.456953  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.456985  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.457227  331973 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/config.json ...

	I0803 23:03:38.457408  331973 start.go:128] duration metric: took 25.353300947s to createHost

	I0803 23:03:38.457431  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:38.459762  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.460114  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.460138  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.460330  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:38.460533  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.460687  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.460827  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:38.460976  331973 main.go:141] libmachine: Using SSH client type: native

	I0803 23:03:38.461133  331973 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.243 22 <nil> <nil>}

	I0803 23:03:38.461143  331973 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0803 23:03:38.574570  331973 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722726218.550705359

	I0803 23:03:38.574596  331973 fix.go:216] guest clock: 1722726218.550705359

	I0803 23:03:38.574605  331973 fix.go:229] Guest: 2024-08-03 23:03:38.550705359 +0000 UTC Remote: 2024-08-03 23:03:38.457419484 +0000 UTC m=+25.463736524 (delta=93.285875ms)

	I0803 23:03:38.574627  331973 fix.go:200] guest clock delta is within tolerance: 93.285875ms

	I0803 23:03:38.574632  331973 start.go:83] releasing machines lock for "addons-033173", held for 25.470615624s

	I0803 23:03:38.574656  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:38.574963  331973 main.go:141] libmachine: (addons-033173) Calling .GetIP

	I0803 23:03:38.577720  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.578126  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.578147  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.578315  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:38.578834  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:38.579021  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:03:38.579139  331973 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:03:38.579192  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:38.579207  331973 ssh_runner.go:195] Run: cat /version.json

	I0803 23:03:38.579227  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:03:38.581698  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.581993  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.582081  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.582111  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.582329  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:38.582346  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:38.582351  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:38.582527  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:03:38.582546  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.582678  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:38.582681  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:03:38.582861  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:03:38.582871  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:03:38.583028  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:03:38.681464  331973 ssh_runner.go:195] Run: systemctl --version

	I0803 23:03:38.687870  331973 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:03:38.853778  331973 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:03:38.860568  331973 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:03:38.860794  331973 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:03:38.877312  331973 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:03:38.877338  331973 start.go:495] detecting cgroup driver to use...

	I0803 23:03:38.877416  331973 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:03:38.893465  331973 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:03:38.907992  331973 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:03:38.908054  331973 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:03:38.921985  331973 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:03:38.935926  331973 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:03:39.045602  331973 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:03:39.203745  331973 docker.go:233] disabling docker service ...

	I0803 23:03:39.203832  331973 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:03:39.218885  331973 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:03:39.231884  331973 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:03:39.354197  331973 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:03:39.479932  331973 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:03:39.494460  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:03:39.513941  331973 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:03:39.514010  331973 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.524960  331973 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:03:39.525037  331973 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.536418  331973 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.547384  331973 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.558798  331973 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:03:39.570002  331973 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.581200  331973 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.599701  331973 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:03:39.610703  331973 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:03:39.620573  331973 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:03:39.620637  331973 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:03:39.634423  331973 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:03:39.644673  331973 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:03:39.764470  331973 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:03:39.903177  331973 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:03:39.903280  331973 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:03:39.908598  331973 start.go:563] Will wait 60s for crictl version

	I0803 23:03:39.908686  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:03:39.912426  331973 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:03:39.952642  331973 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:03:39.952763  331973 ssh_runner.go:195] Run: crio --version

	I0803 23:03:39.980274  331973 ssh_runner.go:195] Run: crio --version

	I0803 23:03:40.010805  331973 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:03:40.012103  331973 main.go:141] libmachine: (addons-033173) Calling .GetIP

	I0803 23:03:40.014901  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:40.015226  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:03:40.015251  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:03:40.015446  331973 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:03:40.019717  331973 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:03:40.032287  331973 kubeadm.go:883] updating cluster {Name:addons-033173 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.

3 ClusterName:addons-033173 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.243 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT

ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0803 23:03:40.032437  331973 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:03:40.032509  331973 ssh_runner.go:195] Run: sudo crictl images --output json

	I0803 23:03:40.072275  331973 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.3". assuming images are not preloaded.

	I0803 23:03:40.072376  331973 ssh_runner.go:195] Run: which lz4

	I0803 23:03:40.076453  331973 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0803 23:03:40.080837  331973 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0803 23:03:40.080880  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (406200976 bytes)

	I0803 23:03:41.530811  331973 crio.go:462] duration metric: took 1.454396109s to copy over tarball

	I0803 23:03:41.530903  331973 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0803 23:03:43.773333  331973 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.242388131s)

	I0803 23:03:43.773367  331973 crio.go:469] duration metric: took 2.242518672s to extract the tarball

	I0803 23:03:43.773378  331973 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0803 23:03:43.816237  331973 ssh_runner.go:195] Run: sudo crictl images --output json

	I0803 23:03:43.860082  331973 crio.go:514] all images are preloaded for cri-o runtime.

	I0803 23:03:43.860115  331973 cache_images.go:84] Images are preloaded, skipping loading

	I0803 23:03:43.860126  331973 kubeadm.go:934] updating node { 192.168.39.243 8443 v1.30.3 crio true true} ...

	I0803 23:03:43.860264  331973 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-033173 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.243

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:addons-033173 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:03:43.860336  331973 ssh_runner.go:195] Run: crio config

	I0803 23:03:43.904817  331973 cni.go:84] Creating CNI manager for ""

	I0803 23:03:43.904842  331973 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0803 23:03:43.904855  331973 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0803 23:03:43.904887  331973 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.243 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-033173 NodeName:addons-033173 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.243"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.243 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k

ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0803 23:03:43.905050  331973 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.243

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-033173"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.243

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.243"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0803 23:03:43.905128  331973 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:03:43.915467  331973 binaries.go:44] Found k8s binaries, skipping transfer

	I0803 23:03:43.915575  331973 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0803 23:03:43.925652  331973 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0803 23:03:43.942586  331973 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:03:43.959335  331973 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2157 bytes)

	I0803 23:03:43.976337  331973 ssh_runner.go:195] Run: grep 192.168.39.243	control-plane.minikube.internal$ /etc/hosts

	I0803 23:03:43.980369  331973 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.243	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:03:43.993765  331973 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:03:44.118063  331973 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:03:44.136297  331973 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173 for IP: 192.168.39.243

	I0803 23:03:44.136333  331973 certs.go:194] generating shared ca certs ...

	I0803 23:03:44.136376  331973 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.136580  331973 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:03:44.198052  331973 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt ...

	I0803 23:03:44.198087  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt: {Name:mk7080f46d6f9d3e419b626dbb32f8a0b4118bf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.198290  331973 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key ...

	I0803 23:03:44.198308  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key: {Name:mk610c12ad2bd22f297dfc538d1b53b124cb527c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.198417  331973 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:03:44.405211  331973 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt ...

	I0803 23:03:44.405246  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt: {Name:mkb3f88ac1974d3eb95a825cd9fba2caa49d55ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.405450  331973 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key ...

	I0803 23:03:44.405468  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key: {Name:mk0c4429b799e55ba169809f7b00eccc9309faa9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.405596  331973 certs.go:256] generating profile certs ...

	I0803 23:03:44.405690  331973 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/client.key

	I0803 23:03:44.405710  331973 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/client.crt with IP's: []

	I0803 23:03:44.485138  331973 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/client.crt ...

	I0803 23:03:44.485180  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/client.crt: {Name:mk92fbd9fc7d956c300cad61b95e3b27033a18d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.485371  331973 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/client.key ...

	I0803 23:03:44.485387  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/client.key: {Name:mk81f6717ad3f7179ccf8eda214953a3baa235ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.485483  331973 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.key.99ea163b

	I0803 23:03:44.485530  331973 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.crt.99ea163b with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.243]

	I0803 23:03:44.966273  331973 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.crt.99ea163b ...

	I0803 23:03:44.966313  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.crt.99ea163b: {Name:mkdd23f093841537a4b198d7591c5ea147912949 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.966501  331973 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.key.99ea163b ...

	I0803 23:03:44.966516  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.key.99ea163b: {Name:mk349e1fe64f4b0df237b7b0f84fb4848913c050 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:44.966590  331973 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.crt.99ea163b -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.crt

	I0803 23:03:44.966662  331973 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.key.99ea163b -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.key

	I0803 23:03:44.966707  331973 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.key

	I0803 23:03:44.966725  331973 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.crt with IP's: []

	I0803 23:03:45.100692  331973 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.crt ...

	I0803 23:03:45.100741  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.crt: {Name:mk6ca4d819a8096a921fadb327f8a8f37b6eef1f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:45.100926  331973 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.key ...

	I0803 23:03:45.100940  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.key: {Name:mk7b0442d9ae1017ad21cd99846f923d6c152306 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:03:45.101122  331973 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:03:45.101158  331973 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:03:45.101181  331973 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:03:45.101204  331973 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:03:45.101882  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:03:45.135744  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:03:45.160406  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:03:45.188884  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:03:45.217233  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0803 23:03:45.243784  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0803 23:03:45.273195  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:03:45.304208  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/addons-033173/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0803 23:03:45.335452  331973 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:03:45.363124  331973 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0803 23:03:45.381826  331973 ssh_runner.go:195] Run: openssl version

	I0803 23:03:45.387838  331973 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:03:45.399633  331973 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:03:45.406087  331973 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:03:45.406168  331973 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:03:45.413056  331973 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:03:45.428969  331973 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:03:45.434630  331973 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:03:45.434707  331973 kubeadm.go:392] StartCluster: {Name:addons-033173 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 C

lusterName:addons-033173 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.243 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:03:45.434814  331973 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0803 23:03:45.434869  331973 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0803 23:03:45.474250  331973 cri.go:89] found id: ""

	I0803 23:03:45.474332  331973 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0803 23:03:45.484490  331973 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0803 23:03:45.494993  331973 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0803 23:03:45.504994  331973 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0803 23:03:45.505023  331973 kubeadm.go:157] found existing configuration files:

	I0803 23:03:45.505081  331973 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0803 23:03:45.514832  331973 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0803 23:03:45.514922  331973 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0803 23:03:45.525194  331973 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0803 23:03:45.535257  331973 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0803 23:03:45.535320  331973 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0803 23:03:45.545816  331973 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0803 23:03:45.555432  331973 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0803 23:03:45.555498  331973 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0803 23:03:45.565394  331973 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0803 23:03:45.574855  331973 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0803 23:03:45.574918  331973 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0803 23:03:45.584536  331973 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0803 23:03:45.645533  331973 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3

	I0803 23:03:45.645611  331973 kubeadm.go:310] [preflight] Running pre-flight checks

	I0803 23:03:45.807357  331973 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0803 23:03:45.807509  331973 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0803 23:03:45.807681  331973 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0803 23:03:46.041415  331973 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0803 23:03:46.133830  331973 out.go:204]   - Generating certificates and keys ...

	I0803 23:03:46.133974  331973 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0803 23:03:46.134051  331973 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0803 23:03:46.138740  331973 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0803 23:03:46.598753  331973 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0803 23:03:46.735642  331973 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0803 23:03:46.833418  331973 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0803 23:03:46.972557  331973 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0803 23:03:46.974615  331973 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-033173 localhost] and IPs [192.168.39.243 127.0.0.1 ::1]

	I0803 23:03:47.111835  331973 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0803 23:03:47.112061  331973 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-033173 localhost] and IPs [192.168.39.243 127.0.0.1 ::1]

	I0803 23:03:47.521005  331973 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0803 23:03:47.602062  331973 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0803 23:03:47.785843  331973 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0803 23:03:47.785913  331973 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0803 23:03:47.930230  331973 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0803 23:03:48.150864  331973 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0803 23:03:48.210957  331973 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0803 23:03:48.315723  331973 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0803 23:03:48.417388  331973 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0803 23:03:48.418068  331973 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0803 23:03:48.420524  331973 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0803 23:03:48.422285  331973 out.go:204]   - Booting up control plane ...

	I0803 23:03:48.422373  331973 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0803 23:03:48.422458  331973 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0803 23:03:48.422539  331973 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0803 23:03:48.441893  331973 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0803 23:03:48.442718  331973 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0803 23:03:48.442798  331973 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0803 23:03:48.578226  331973 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0803 23:03:48.578346  331973 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0803 23:03:49.078387  331973 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 500.947146ms

	I0803 23:03:49.078537  331973 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0803 23:03:54.078099  331973 kubeadm.go:310] [api-check] The API server is healthy after 5.001172246s

	I0803 23:03:54.098065  331973 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0803 23:03:54.121764  331973 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0803 23:03:54.158554  331973 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0803 23:03:54.158826  331973 kubeadm.go:310] [mark-control-plane] Marking the node addons-033173 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0803 23:03:54.178146  331973 kubeadm.go:310] [bootstrap-token] Using token: 9fckoe.tz3h3dosl4ain5mz

	I0803 23:03:54.179551  331973 out.go:204]   - Configuring RBAC rules ...

	I0803 23:03:54.179692  331973 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0803 23:03:54.192030  331973 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0803 23:03:54.202877  331973 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0803 23:03:54.211824  331973 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0803 23:03:54.215777  331973 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0803 23:03:54.219956  331973 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0803 23:03:54.483470  331973 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0803 23:03:54.977098  331973 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0803 23:03:55.485937  331973 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0803 23:03:55.485964  331973 kubeadm.go:310] 

	I0803 23:03:55.486032  331973 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0803 23:03:55.486074  331973 kubeadm.go:310] 

	I0803 23:03:55.486197  331973 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0803 23:03:55.486209  331973 kubeadm.go:310] 

	I0803 23:03:55.486255  331973 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0803 23:03:55.486327  331973 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0803 23:03:55.486395  331973 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0803 23:03:55.486405  331973 kubeadm.go:310] 

	I0803 23:03:55.486446  331973 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0803 23:03:55.486452  331973 kubeadm.go:310] 

	I0803 23:03:55.486488  331973 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0803 23:03:55.486494  331973 kubeadm.go:310] 

	I0803 23:03:55.486570  331973 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0803 23:03:55.486668  331973 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0803 23:03:55.486773  331973 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0803 23:03:55.486783  331973 kubeadm.go:310] 

	I0803 23:03:55.486889  331973 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0803 23:03:55.486990  331973 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0803 23:03:55.487001  331973 kubeadm.go:310] 

	I0803 23:03:55.487110  331973 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 9fckoe.tz3h3dosl4ain5mz \

	I0803 23:03:55.487255  331973 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c \

	I0803 23:03:55.487287  331973 kubeadm.go:310] 	--control-plane 

	I0803 23:03:55.487296  331973 kubeadm.go:310] 

	I0803 23:03:55.487413  331973 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0803 23:03:55.487425  331973 kubeadm.go:310] 

	I0803 23:03:55.487557  331973 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 9fckoe.tz3h3dosl4ain5mz \

	I0803 23:03:55.487703  331973 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c 

	I0803 23:03:55.487866  331973 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0803 23:03:55.487900  331973 cni.go:84] Creating CNI manager for ""

	I0803 23:03:55.487927  331973 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0803 23:03:55.489623  331973 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0803 23:03:55.490640  331973 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0803 23:03:55.506635  331973 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0803 23:03:55.526503  331973 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0803 23:03:55.526684  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:55.526693  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-033173 minikube.k8s.io/updated_at=2024_08_03T23_03_55_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=addons-033173 minikube.k8s.io/primary=true

	I0803 23:03:55.566145  331973 ops.go:34] apiserver oom_adj: -16

	I0803 23:03:55.675889  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:56.176170  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:56.676669  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:57.176937  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:57.676213  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:58.176546  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:58.676741  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:59.176801  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:03:59.675943  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:00.176038  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:00.675913  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:01.176995  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:01.676224  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:02.176503  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:02.676290  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:03.176337  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:03.676480  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:04.176336  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:04.676923  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:05.176053  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:05.676555  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:06.176832  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:06.675969  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:07.176856  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:07.676124  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:08.176990  331973 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:04:08.286706  331973 kubeadm.go:1113] duration metric: took 12.760112558s to wait for elevateKubeSystemPrivileges

	I0803 23:04:08.286754  331973 kubeadm.go:394] duration metric: took 22.852055643s to StartCluster

	I0803 23:04:08.286782  331973 settings.go:142] acquiring lock: {Name:mk918fd72253bf33e8bae308fd36ed8b1c353763 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:04:08.286949  331973 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:04:08.287461  331973 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/kubeconfig: {Name:mkd789cdd11c6330d283dbc76129ed198eb15398 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:04:08.287747  331973 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.39.243 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:04:08.287772  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0803 23:04:08.287875  331973 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0803 23:04:08.288002  331973 config.go:182] Loaded profile config "addons-033173": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:04:08.288019  331973 addons.go:69] Setting inspektor-gadget=true in profile "addons-033173"

	I0803 23:04:08.288032  331973 addons.go:69] Setting default-storageclass=true in profile "addons-033173"

	I0803 23:04:08.288023  331973 addons.go:69] Setting ingress-dns=true in profile "addons-033173"

	I0803 23:04:08.288010  331973 addons.go:69] Setting yakd=true in profile "addons-033173"

	I0803 23:04:08.288060  331973 addons.go:69] Setting metrics-server=true in profile "addons-033173"

	I0803 23:04:08.288065  331973 addons.go:234] Setting addon ingress-dns=true in "addons-033173"

	I0803 23:04:08.288057  331973 addons.go:69] Setting cloud-spanner=true in profile "addons-033173"

	I0803 23:04:08.288070  331973 addons.go:69] Setting helm-tiller=true in profile "addons-033173"

	I0803 23:04:08.288084  331973 addons.go:234] Setting addon metrics-server=true in "addons-033173"

	I0803 23:04:08.288102  331973 addons.go:234] Setting addon helm-tiller=true in "addons-033173"

	I0803 23:04:08.288136  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288156  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288062  331973 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-033173"

	I0803 23:04:08.288083  331973 addons.go:234] Setting addon yakd=true in "addons-033173"

	I0803 23:04:08.288223  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288136  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288090  331973 addons.go:69] Setting storage-provisioner=true in profile "addons-033173"

	I0803 23:04:08.288561  331973 addons.go:234] Setting addon storage-provisioner=true in "addons-033173"

	I0803 23:04:08.288056  331973 addons.go:234] Setting addon inspektor-gadget=true in "addons-033173"

	I0803 23:04:08.288589  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288596  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.288599  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.288612  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288619  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288636  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288671  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.288697  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.288708  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.288720  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288712  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288080  331973 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-033173"

	I0803 23:04:08.288860  331973 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-033173"

	I0803 23:04:08.288901  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.288948  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.288996  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.289001  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.289022  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288097  331973 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-033173"

	I0803 23:04:08.288727  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288098  331973 addons.go:69] Setting registry=true in profile "addons-033173"

	I0803 23:04:08.289231  331973 addons.go:234] Setting addon registry=true in "addons-033173"

	I0803 23:04:08.289271  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.289412  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.289457  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.289675  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.289705  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.288104  331973 addons.go:69] Setting ingress=true in profile "addons-033173"

	I0803 23:04:08.289909  331973 addons.go:234] Setting addon ingress=true in "addons-033173"

	I0803 23:04:08.289956  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.290320  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.290346  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.297680  331973 out.go:177] * Verifying Kubernetes components...

	I0803 23:04:08.288111  331973 addons.go:69] Setting volcano=true in profile "addons-033173"

	I0803 23:04:08.298442  331973 addons.go:234] Setting addon volcano=true in "addons-033173"

	I0803 23:04:08.288112  331973 addons.go:69] Setting volumesnapshots=true in profile "addons-033173"

	I0803 23:04:08.298505  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.298541  331973 addons.go:234] Setting addon volumesnapshots=true in "addons-033173"

	I0803 23:04:08.288105  331973 addons.go:69] Setting gcp-auth=true in profile "addons-033173"

	I0803 23:04:08.298586  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.298589  331973 mustload.go:65] Loading cluster: addons-033173

	I0803 23:04:08.288117  331973 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-033173"

	I0803 23:04:08.298917  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.298931  331973 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-033173"

	I0803 23:04:08.298969  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.299089  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.299128  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.289127  331973 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-033173"

	I0803 23:04:08.299304  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.299351  331973 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:04:08.288100  331973 addons.go:234] Setting addon cloud-spanner=true in "addons-033173"

	I0803 23:04:08.299530  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.299853  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.299882  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.300004  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.300107  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.311784  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39523

	I0803 23:04:08.312266  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.312810  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.312834  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.313211  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.313826  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.313862  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.315856  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35927

	I0803 23:04:08.316415  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.316921  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.316946  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.317294  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.318032  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.318086  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.319945  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37085

	I0803 23:04:08.320614  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.321257  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.321286  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.321681  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.322237  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.322266  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.323995  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39965

	I0803 23:04:08.324576  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.325137  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.325154  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.325601  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.325712  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44099

	I0803 23:04:08.326570  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.326595  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.326752  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.326854  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46695

	I0803 23:04:08.327268  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.327291  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.327616  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.329813  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.329857  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.330086  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.330262  331973 config.go:182] Loaded profile config "addons-033173": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:04:08.330610  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.330650  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.330983  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39391

	I0803 23:04:08.331072  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33465

	I0803 23:04:08.331140  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33459

	I0803 23:04:08.331293  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.332104  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.332215  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.332271  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.332325  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.341470  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.341499  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.341707  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.341720  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.341846  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.341857  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.341980  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.341991  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.342692  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.342745  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.342757  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.342800  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.343615  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.343646  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.343841  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32801

	I0803 23:04:08.343927  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.343967  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.344182  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.344448  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.344494  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.344693  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.345226  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.345245  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.345671  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.345937  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.348388  331973 addons.go:234] Setting addon default-storageclass=true in "addons-033173"

	I0803 23:04:08.348435  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.348794  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.348828  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.350540  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.351793  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35719

	I0803 23:04:08.351996  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35499

	I0803 23:04:08.352317  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.352515  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.352622  331973 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0

	I0803 23:04:08.353102  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.353124  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.353858  331973 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0803 23:04:08.353876  331973 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0803 23:04:08.353897  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.353934  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.353947  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.354123  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.354320  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.354460  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.354585  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.356782  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.357495  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.358366  331973 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0803 23:04:08.358371  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.358823  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.358849  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.359193  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.359399  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.359577  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.359711  331973 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0803 23:04:08.359730  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0803 23:04:08.359751  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.359745  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.359812  331973 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0803 23:04:08.360771  331973 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0803 23:04:08.360787  331973 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0803 23:04:08.360804  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.363470  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.364382  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.364424  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.364439  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.364439  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.364766  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.364854  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.364932  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.364939  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.365135  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.365449  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.365682  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.365843  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.366056  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.368526  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39401

	I0803 23:04:08.369053  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.369576  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.369601  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.369964  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.370095  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.371268  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36755

	I0803 23:04:08.371954  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.372293  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.372699  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.372742  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.373070  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.373090  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.373472  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.374182  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.374209  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.377257  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32917

	I0803 23:04:08.377838  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.378466  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.378490  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.378891  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.382767  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.382797  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.384000  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41833

	I0803 23:04:08.384603  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.385244  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.385262  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.385712  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.386353  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.386394  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.387799  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40971

	I0803 23:04:08.387945  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38685

	I0803 23:04:08.388512  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.389117  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.389135  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.389603  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.390225  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.390264  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.391435  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38809

	I0803 23:04:08.392031  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.392111  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39337

	I0803 23:04:08.392618  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.392826  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.392848  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.393214  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.393351  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.393361  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.393694  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.393708  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.393884  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.394589  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.394612  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.394670  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.396173  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.396457  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39177

	I0803 23:04:08.396916  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.397603  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.397660  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.397699  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.398347  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.398545  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.398563  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.398950  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.399165  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.400251  331973 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0803 23:04:08.400310  331973 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0803 23:04:08.401597  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35483

	I0803 23:04:08.401731  331973 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0803 23:04:08.401739  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.401749  331973 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0803 23:04:08.401772  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.401966  331973 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0803 23:04:08.401988  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0803 23:04:08.402003  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.404098  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34011

	I0803 23:04:08.404261  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.404420  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38687

	I0803 23:04:08.405348  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.405370  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.405514  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.405920  331973 out.go:177]   - Using image docker.io/registry:2.8.3

	I0803 23:04:08.406890  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.406892  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.406982  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.406945  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.406985  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.407048  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.407523  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.407544  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.407603  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.407640  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.407836  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.408048  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.408141  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.408349  331973 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0803 23:04:08.408902  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36493

	I0803 23:04:08.409353  331973 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0803 23:04:08.409372  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0803 23:04:08.409391  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.409401  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.409573  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.409586  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.409729  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.410286  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.410302  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.410713  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.410907  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.411771  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.411956  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.412926  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.412972  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.413532  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.414193  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.414216  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.414733  331973 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0803 23:04:08.415528  331973 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-033173"

	I0803 23:04:08.415576  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:08.415932  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.415955  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.416234  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.416264  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.416266  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.416280  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.416231  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.416446  331973 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0803 23:04:08.416460  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0803 23:04:08.416481  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.416499  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.416540  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.416659  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.416705  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.416814  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.417107  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.419878  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.420364  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.420400  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.420622  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.420857  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.421033  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.421170  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.429631  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35471

	I0803 23:04:08.429848  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38149

	I0803 23:04:08.430189  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.430212  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.430912  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.430945  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.430912  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.431002  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.431285  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34955

	I0803 23:04:08.431475  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.431922  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.431957  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.432524  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.432549  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.432832  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46429

	I0803 23:04:08.433335  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.433577  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.433755  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.433880  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.434085  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.434108  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.434143  331973 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0803 23:04:08.434165  331973 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0803 23:04:08.434185  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.434452  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.434774  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.435284  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.435668  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.437115  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.437676  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.438445  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.438647  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.438974  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.438980  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:08.438995  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:08.438995  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.439043  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.439070  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37769

	I0803 23:04:08.440413  331973 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22

	I0803 23:04:08.440697  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:08.440705  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39251

	I0803 23:04:08.440733  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:08.440748  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:08.440757  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:08.440764  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:08.440817  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.440966  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.441039  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.441159  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.441641  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:08.441655  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	W0803 23:04:08.441736  331973 out.go:239] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	I0803 23:04:08.441872  331973 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0803 23:04:08.441889  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0803 23:04:08.441908  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.443107  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0803 23:04:08.443551  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.444123  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.444151  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.444672  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39973

	I0803 23:04:08.444830  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.445025  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.445098  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.445365  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0803 23:04:08.445749  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44177

	I0803 23:04:08.445830  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.445846  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.445865  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.445995  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.446013  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.446100  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.446121  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.446221  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.446305  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.446323  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.446350  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.446495  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.446522  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.446679  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.446745  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.446963  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.447560  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.447641  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.447671  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0803 23:04:08.448187  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.448526  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.448819  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.449234  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:08.449272  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:08.449321  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.449706  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0803 23:04:08.449708  331973 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.1

	I0803 23:04:08.449768  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0803 23:04:08.451663  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0803 23:04:08.451680  331973 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0803 23:04:08.451694  331973 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0803 23:04:08.451694  331973 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0803 23:04:08.451714  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.451767  331973 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0803 23:04:08.451777  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0803 23:04:08.451791  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.453844  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0803 23:04:08.454838  331973 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0803 23:04:08.455356  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.455747  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.455820  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0803 23:04:08.455782  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.455937  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.455969  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.456201  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.456325  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.456379  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.456435  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.456466  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.456820  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.456872  331973 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1

	I0803 23:04:08.456987  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.457361  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.457492  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.458496  331973 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0803 23:04:08.458513  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0803 23:04:08.458531  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.458974  331973 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0803 23:04:08.460292  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0803 23:04:08.460311  331973 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0803 23:04:08.460328  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.462009  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.462409  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.462430  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.462613  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.462808  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.462974  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.463126  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.464492  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.464985  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.465005  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.465196  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.465373  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.465545  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.465694  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:08.485383  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34555

	I0803 23:04:08.485838  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:08.486349  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:08.486375  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:08.486749  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:08.486971  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:08.488688  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:08.490561  331973 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0803 23:04:08.492182  331973 out.go:177]   - Using image docker.io/busybox:stable

	I0803 23:04:08.493384  331973 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0803 23:04:08.493400  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0803 23:04:08.493422  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:08.496729  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.497088  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:08.497120  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:08.497339  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:08.497565  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:08.497747  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:08.497931  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	W0803 23:04:08.498739  331973 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:40962->192.168.39.243:22: read: connection reset by peer

	I0803 23:04:08.498766  331973 retry.go:31] will retry after 166.922898ms: ssh: handshake failed: read tcp 192.168.39.1:40962->192.168.39.243:22: read: connection reset by peer

	I0803 23:04:08.798850  331973 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0803 23:04:08.798877  331973 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0803 23:04:08.911702  331973 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0803 23:04:08.911733  331973 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0803 23:04:08.946427  331973 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0803 23:04:08.946450  331973 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0803 23:04:08.949298  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0803 23:04:08.983281  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0803 23:04:09.007129  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0803 23:04:09.010387  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0803 23:04:09.010410  331973 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0803 23:04:09.013292  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0803 23:04:09.053813  331973 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:04:09.053847  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0803 23:04:09.088685  331973 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0803 23:04:09.088729  331973 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0803 23:04:09.111140  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0803 23:04:09.113689  331973 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0803 23:04:09.113718  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0803 23:04:09.119841  331973 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0803 23:04:09.119870  331973 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0803 23:04:09.137636  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0803 23:04:09.142405  331973 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0803 23:04:09.142422  331973 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0803 23:04:09.173778  331973 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0803 23:04:09.173821  331973 ssh_runner.go:362] scp helm-tiller/helm-tiller-rbac.yaml --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0803 23:04:09.231357  331973 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0803 23:04:09.231380  331973 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0803 23:04:09.266516  331973 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0803 23:04:09.266547  331973 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0803 23:04:09.278290  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0803 23:04:09.341595  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0803 23:04:09.341640  331973 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0803 23:04:09.361218  331973 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0803 23:04:09.361241  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0803 23:04:09.371589  331973 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0803 23:04:09.371618  331973 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0803 23:04:09.380114  331973 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0803 23:04:09.380140  331973 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0803 23:04:09.397016  331973 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0803 23:04:09.397040  331973 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0803 23:04:09.476037  331973 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0803 23:04:09.476066  331973 ssh_runner.go:362] scp helm-tiller/helm-tiller-svc.yaml --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0803 23:04:09.524787  331973 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0803 23:04:09.524814  331973 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0803 23:04:09.557584  331973 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0803 23:04:09.557615  331973 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0803 23:04:09.625318  331973 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0803 23:04:09.625344  331973 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0803 23:04:09.645050  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0803 23:04:09.645077  331973 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0803 23:04:09.672452  331973 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0803 23:04:09.672481  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0803 23:04:09.682770  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0803 23:04:09.695339  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0803 23:04:09.695373  331973 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0803 23:04:09.727537  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0803 23:04:09.739361  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0803 23:04:09.772060  331973 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0803 23:04:09.772090  331973 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0803 23:04:09.868283  331973 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0803 23:04:09.868310  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0803 23:04:09.974919  331973 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0803 23:04:09.974949  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0803 23:04:10.018394  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0803 23:04:10.028374  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0803 23:04:10.028407  331973 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0803 23:04:10.133920  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0803 23:04:10.316066  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0803 23:04:10.498481  331973 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0803 23:04:10.498525  331973 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0803 23:04:10.893849  331973 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0803 23:04:10.893878  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0803 23:04:11.200074  331973 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0803 23:04:11.200109  331973 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0803 23:04:11.580295  331973 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0803 23:04:11.580319  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0803 23:04:11.855361  331973 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0803 23:04:11.855386  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0803 23:04:12.182343  331973 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0803 23:04:12.182373  331973 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0803 23:04:12.435657  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0803 23:04:13.527855  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.5785159s)

	I0803 23:04:13.527894  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.544576924s)

	I0803 23:04:13.527930  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:13.527937  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:13.527948  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:13.527950  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:13.528254  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:13.528252  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:13.528351  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:13.528358  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:13.528322  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:13.528375  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:13.528376  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:13.528384  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:13.528387  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:13.528449  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:13.528599  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:13.528714  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:13.528720  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:13.528695  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:13.528734  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:13.528698  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:15.432786  331973 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0803 23:04:15.432830  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:15.436223  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:15.436671  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:15.436702  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:15.436937  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:15.437177  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:15.437352  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:15.437539  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:16.038465  331973 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0803 23:04:16.202113  331973 addons.go:234] Setting addon gcp-auth=true in "addons-033173"

	I0803 23:04:16.202175  331973 host.go:66] Checking if "addons-033173" exists ...

	I0803 23:04:16.202596  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:16.202631  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:16.218666  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38399

	I0803 23:04:16.219152  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:16.219686  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:16.219712  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:16.220025  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:16.220488  331973 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:04:16.220514  331973 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:04:16.235945  331973 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33447

	I0803 23:04:16.236454  331973 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:04:16.236948  331973 main.go:141] libmachine: Using API Version  1

	I0803 23:04:16.236975  331973 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:04:16.237406  331973 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:04:16.237634  331973 main.go:141] libmachine: (addons-033173) Calling .GetState

	I0803 23:04:16.239613  331973 main.go:141] libmachine: (addons-033173) Calling .DriverName

	I0803 23:04:16.239880  331973 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0803 23:04:16.239913  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHHostname

	I0803 23:04:16.242491  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:16.242943  331973 main.go:141] libmachine: (addons-033173) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:69:02", ip: ""} in network mk-addons-033173: {Iface:virbr1 ExpiryTime:2024-08-04 00:03:28 +0000 UTC Type:0 Mac:52:54:00:3e:69:02 Iaid: IPaddr:192.168.39.243 Prefix:24 Hostname:addons-033173 Clientid:01:52:54:00:3e:69:02}

	I0803 23:04:16.242970  331973 main.go:141] libmachine: (addons-033173) DBG | domain addons-033173 has defined IP address 192.168.39.243 and MAC address 52:54:00:3e:69:02 in network mk-addons-033173

	I0803 23:04:16.243158  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHPort

	I0803 23:04:16.243355  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHKeyPath

	I0803 23:04:16.243509  331973 main.go:141] libmachine: (addons-033173) Calling .GetSSHUsername

	I0803 23:04:16.243627  331973 sshutil.go:53] new ssh client: &{IP:192.168.39.243 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/addons-033173/id_rsa Username:docker}

	I0803 23:04:17.355012  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.347838247s)

	I0803 23:04:17.355076  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355088  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355096  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (8.341777003s)

	I0803 23:04:17.355137  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355146  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355236  331973 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (8.301387318s)

	I0803 23:04:17.355293  331973 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (8.301421302s)

	I0803 23:04:17.355328  331973 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0803 23:04:17.355372  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.217712553s)

	I0803 23:04:17.355375  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.355394  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.355405  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355408  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355414  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355419  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355506  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.077188642s)

	I0803 23:04:17.355527  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355536  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355600  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.672802039s)

	I0803 23:04:17.355616  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355626  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355707  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (7.628140654s)

	I0803 23:04:17.355727  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355736  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355834  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.616441627s)

	I0803 23:04:17.355850  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355858  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355927  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.337502277s)

	I0803 23:04:17.355944  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.355952  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.356070  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.222117103s)

	W0803 23:04:17.356111  331973 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0803 23:04:17.356132  331973 retry.go:31] will retry after 299.615722ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0803 23:04:17.356216  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.040115199s)

	I0803 23:04:17.356237  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.356246  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.356262  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.356280  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.356288  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.356296  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.356305  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.356307  331973 node_ready.go:35] waiting up to 6m0s for node "addons-033173" to be "Ready" ...

	I0803 23:04:17.356330  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.356337  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.356344  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.356350  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.355335  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.244164128s)

	I0803 23:04:17.356417  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.356429  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.356656  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.356704  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.356712  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.356720  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.356728  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.356777  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.356798  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.356805  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.356813  331973 addons.go:475] Verifying addon ingress=true in "addons-033173"

	I0803 23:04:17.356945  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.357000  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.357016  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.357039  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.357046  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.357054  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.357061  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.357117  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.357138  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.357145  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.357153  331973 addons.go:475] Verifying addon metrics-server=true in "addons-033173"

	I0803 23:04:17.357195  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.357209  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.358668  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.358707  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.358715  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.358724  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.358734  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.359077  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.359109  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.359116  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.359284  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.359306  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.359312  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.359320  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.359326  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.359378  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.359398  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.359404  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.359411  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.359419  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.359456  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.359475  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.359482  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.359489  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.359495  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.359540  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.359557  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.359563  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.360024  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.360054  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.360060  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.361455  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.361491  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.361499  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.361524  331973 addons.go:475] Verifying addon registry=true in "addons-033173"

	I0803 23:04:17.362055  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.362069  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.362087  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.362101  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.356914  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.362158  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.362170  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.362843  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.363183  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.363200  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.363213  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.363241  331973 out.go:177] * Verifying ingress addon...

	I0803 23:04:17.364024  331973 out.go:177] * Verifying registry addon...

	I0803 23:04:17.364024  331973 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-033173 service yakd-dashboard -n yakd-dashboard

	I0803 23:04:17.366087  331973 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0803 23:04:17.366908  331973 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0803 23:04:17.383356  331973 node_ready.go:49] node "addons-033173" has status "Ready":"True"

	I0803 23:04:17.383395  331973 node_ready.go:38] duration metric: took 27.057243ms for node "addons-033173" to be "Ready" ...

	I0803 23:04:17.383405  331973 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:04:17.384633  331973 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0803 23:04:17.384666  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:17.445086  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.445118  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.445458  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.445476  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	W0803 23:04:17.445598  331973 out.go:239] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I0803 23:04:17.449643  331973 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-449gj" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.465398  331973 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0803 23:04:17.465426  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:17.475091  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:17.475120  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:17.475488  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:17.475519  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:17.475538  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:17.534504  331973 pod_ready.go:92] pod "coredns-7db6d8ff4d-449gj" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:17.534540  331973 pod_ready.go:81] duration metric: took 84.859591ms for pod "coredns-7db6d8ff4d-449gj" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.534556  331973 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-fklk2" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.579220  331973 pod_ready.go:92] pod "coredns-7db6d8ff4d-fklk2" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:17.579259  331973 pod_ready.go:81] duration metric: took 44.691548ms for pod "coredns-7db6d8ff4d-fklk2" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.579274  331973 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.613479  331973 pod_ready.go:92] pod "etcd-addons-033173" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:17.613525  331973 pod_ready.go:81] duration metric: took 34.242323ms for pod "etcd-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.613544  331973 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.642021  331973 pod_ready.go:92] pod "kube-apiserver-addons-033173" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:17.642047  331973 pod_ready.go:81] duration metric: took 28.493115ms for pod "kube-apiserver-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.642060  331973 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.656384  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0803 23:04:17.760153  331973 pod_ready.go:92] pod "kube-controller-manager-addons-033173" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:17.760183  331973 pod_ready.go:81] duration metric: took 118.114276ms for pod "kube-controller-manager-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.760198  331973 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tgt6z" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:17.860098  331973 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-033173" context rescaled to 1 replicas

	I0803 23:04:17.872541  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:17.874005  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:18.167483  331973 pod_ready.go:92] pod "kube-proxy-tgt6z" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:18.167512  331973 pod_ready.go:81] duration metric: took 407.307001ms for pod "kube-proxy-tgt6z" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:18.167523  331973 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:18.370361  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:18.371581  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:18.560271  331973 pod_ready.go:92] pod "kube-scheduler-addons-033173" in "kube-system" namespace has status "Ready":"True"

	I0803 23:04:18.560300  331973 pod_ready.go:81] duration metric: took 392.769879ms for pod "kube-scheduler-addons-033173" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:18.560311  331973 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace to be "Ready" ...

	I0803 23:04:18.875622  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:18.875992  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:19.383985  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:19.386723  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:19.925093  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:19.925348  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:20.210427  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.774715146s)

	I0803 23:04:20.210467  331973 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.970558232s)

	I0803 23:04:20.210495  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:20.210511  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:20.210585  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.554158666s)

	I0803 23:04:20.210699  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:20.210717  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:20.210827  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:20.210841  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:20.210854  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:20.210864  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:20.210872  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:20.211093  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:20.211109  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:20.211119  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:20.211130  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:20.212888  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:20.212902  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:20.212902  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:20.212917  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:20.212921  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:20.212923  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:20.212929  331973 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-033173"

	I0803 23:04:20.219477  331973 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0803 23:04:20.219492  331973 out.go:177] * Verifying csi-hostpath-driver addon...

	I0803 23:04:20.221098  331973 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0803 23:04:20.221863  331973 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0803 23:04:20.222496  331973 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0803 23:04:20.222517  331973 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0803 23:04:20.251158  331973 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0803 23:04:20.251189  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:20.294700  331973 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0803 23:04:20.294727  331973 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0803 23:04:20.345733  331973 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0803 23:04:20.345764  331973 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0803 23:04:20.371560  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:20.373250  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:20.393491  331973 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0803 23:04:20.568011  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:20.728621  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:20.884293  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:20.884310  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:21.232753  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:21.376610  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:21.382498  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:21.771497  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:21.775912  331973 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.382366338s)

	I0803 23:04:21.775992  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:21.776016  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:21.776494  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:21.776515  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:21.776526  331973 main.go:141] libmachine: Making call to close driver server

	I0803 23:04:21.776534  331973 main.go:141] libmachine: (addons-033173) Calling .Close

	I0803 23:04:21.776883  331973 main.go:141] libmachine: (addons-033173) DBG | Closing plugin on server side

	I0803 23:04:21.776938  331973 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:04:21.776956  331973 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:04:21.778272  331973 addons.go:475] Verifying addon gcp-auth=true in "addons-033173"

	I0803 23:04:21.779979  331973 out.go:177] * Verifying gcp-auth addon...

	I0803 23:04:21.782361  331973 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0803 23:04:21.807264  331973 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0803 23:04:21.807288  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:21.875479  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:21.876306  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:22.228186  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:22.286645  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:22.373426  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:22.376041  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:22.727463  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:22.785665  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:22.870589  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:22.872606  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:23.067740  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:23.227577  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:23.286478  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:23.371672  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:23.375887  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:23.728370  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:23.786503  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:23.872927  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:23.875232  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:24.227052  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:24.286986  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:24.373220  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:24.375591  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:24.728239  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:24.786895  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:24.871771  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:24.872393  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:25.068607  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:25.561051  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:25.567681  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:25.568963  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:25.569113  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:25.730893  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:25.786540  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:25.871075  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:25.871879  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:26.228461  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:26.285799  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:26.372594  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:26.373340  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:26.728459  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:26.787447  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:26.871267  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:26.873111  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:27.227549  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:27.286151  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:27.371157  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:27.372299  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:27.567151  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:27.729617  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:27.787380  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:27.871034  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:27.871591  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:28.232322  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:28.289678  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:28.371451  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:28.373079  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:28.728550  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:28.785863  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:28.872755  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:28.873208  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:29.226649  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:29.285645  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:29.371318  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:29.375304  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:29.728442  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:29.786939  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:29.873073  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:29.873330  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:30.066687  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:30.227624  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:30.286536  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:30.371845  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:30.372144  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:30.997243  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:30.997529  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:31.000705  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:31.001031  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:31.228419  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:31.286813  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:31.371716  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:31.374110  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:31.727500  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:31.786112  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:31.873040  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:31.873489  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:32.069820  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:32.228414  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:32.286424  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:32.370277  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:32.375186  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:32.728741  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:32.786362  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:32.871775  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:32.872739  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:33.227681  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:33.286146  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:33.376451  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:33.376831  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:33.727777  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:33.787006  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:33.871065  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:33.878486  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:34.228267  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:34.287767  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:34.377025  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:34.380716  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:34.567579  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:34.727649  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:34.785876  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:34.871156  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:34.871927  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:35.227472  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:35.286609  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:35.375479  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:35.375682  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:35.728666  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:35.786562  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:35.872052  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:35.876311  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:36.227439  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:36.286627  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:36.370961  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:36.372364  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:36.569131  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:36.726955  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:36.786215  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:36.871751  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:36.871774  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:37.227666  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:37.288107  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:37.371870  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:37.374063  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:37.728095  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:37.786699  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:37.873221  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:37.873574  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:38.228121  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:38.289455  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:38.376596  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:38.376788  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:38.726851  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:38.786440  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:38.873053  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:38.877847  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:39.121629  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:39.228123  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:39.286033  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:39.371345  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:39.371617  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:39.727497  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:39.786215  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:39.873686  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:39.873828  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:40.227499  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:40.285716  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:40.370466  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:40.377551  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:40.728009  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:40.786037  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:40.872069  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:40.872306  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:41.228088  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:41.287699  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:41.372652  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:41.380186  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:41.568929  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:41.727868  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:41.786182  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:41.873032  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:41.873204  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:42.227804  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:42.286511  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:42.371096  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:42.373095  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:42.728059  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:42.785929  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:42.872492  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:42.872488  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:43.228010  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:43.286706  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:43.373338  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:43.377247  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:43.570584  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:43.731788  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:43.786399  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:43.875020  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:43.875374  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:44.410830  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:44.411044  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:44.411988  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:44.415101  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:44.727296  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:44.786698  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:44.871763  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:44.872672  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:45.228606  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:45.286434  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:45.373151  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:45.376852  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:45.727500  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:45.786302  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:45.872998  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:45.873153  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:46.066400  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:46.226961  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:46.286469  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:46.370586  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:46.372226  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:46.732325  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:46.787406  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:46.871766  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:46.872735  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:47.227634  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:47.286858  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:47.370592  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:47.372697  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:47.748082  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:47.802658  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:47.870971  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:47.873392  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:48.228694  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:48.290574  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:48.387495  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:48.389588  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:48.568103  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:48.727461  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:48.787033  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:48.874483  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:48.886941  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:49.479272  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:49.481737  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:49.482903  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:49.483696  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:49.727971  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:49.786203  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:49.872989  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:49.873673  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:50.229668  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:50.285807  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:50.376023  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:50.379316  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:50.570627  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:50.727999  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:50.786383  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:50.871144  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:50.874514  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:51.227851  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:51.287145  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:51.374461  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:51.374482  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:51.728099  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:51.786716  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:51.872243  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:51.872611  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:52.227509  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:52.285907  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:52.373629  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:52.374147  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:52.727709  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:52.786055  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:52.871271  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:52.872700  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:53.066765  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:53.227805  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:53.286156  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:53.372268  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:53.377760  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:53.728277  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:53.786492  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:53.870636  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:53.874060  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:54.227716  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:54.289301  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:54.372699  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:54.372698  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:54.728749  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:54.786965  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:54.872772  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:54.872828  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:55.068634  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:55.228443  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:55.286185  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:55.376363  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:55.376898  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:55.729463  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:55.788708  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:55.870718  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:55.875803  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:56.227413  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:56.286155  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:56.372947  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:56.373174  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:56.727902  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:56.787641  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:56.870678  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:56.872808  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:57.227513  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:57.285942  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:57.371924  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:57.372017  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:57.567408  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:57.727411  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:57.786619  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:57.870756  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:57.890225  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:58.227362  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:58.286347  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:58.373011  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:58.373425  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:58.727610  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:58.786180  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:58.872258  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:58.873358  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:59.227638  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:59.286269  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:59.375043  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:04:59.375125  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:59.568328  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:04:59.727278  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:04:59.786042  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:04:59.871956  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:04:59.872440  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:05:00.227215  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:00.288026  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:00.372046  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0803 23:05:00.376083  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:00.733080  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:00.786952  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:00.871023  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:00.871352  331973 kapi.go:107] duration metric: took 43.504444188s to wait for kubernetes.io/minikube-addons=registry ...

	I0803 23:05:01.228268  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:01.286433  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:01.372084  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:01.570764  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:01.730935  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:01.786721  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:02.168602  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:02.229205  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:02.286502  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:02.370466  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:02.728105  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:02.787009  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:02.871684  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:03.227328  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:03.288328  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:03.370992  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:03.729679  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:03.786103  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:03.870900  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:04.066269  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:04.226980  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:04.286530  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:04.370732  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:04.728927  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:04.786587  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:04.870502  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:05.228352  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:05.286796  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:05.371815  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:05.745475  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:05.796443  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:05.870176  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:06.066304  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:06.235132  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:06.286566  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:06.370553  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:06.727709  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:06.787720  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:06.870976  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:07.227878  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:07.324669  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:07.375320  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:07.727667  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:07.786107  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:07.870812  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:08.076324  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:08.227507  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:08.285854  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:08.371898  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:08.728417  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:08.786283  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:08.876847  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:09.425818  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:09.425846  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:09.426289  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:09.731028  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:09.794148  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:09.873921  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:10.227124  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:10.288681  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:10.370720  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:10.568704  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:10.729699  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:10.787922  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:10.873771  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:11.231370  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:11.287651  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:11.370269  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:11.728019  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:11.798017  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:11.871263  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:12.228354  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:12.285726  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:12.370377  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:12.571765  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:12.727671  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:12.786084  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:12.871262  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:13.227330  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:13.285522  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:13.370991  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:13.727370  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:13.785924  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:13.873460  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:14.229100  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:14.286817  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:14.370655  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:14.727506  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:14.786303  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:14.871522  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:15.066725  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:15.228050  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:15.286469  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:15.371027  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:15.881751  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:15.882138  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:15.887372  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:16.227696  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:16.285923  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:16.371072  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:16.728485  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:16.786587  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:16.870863  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:17.069918  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:17.228323  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:17.285873  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:17.371143  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:17.727940  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:17.786474  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:17.870549  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:18.229682  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0803 23:05:18.289096  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:18.371674  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:18.729101  331973 kapi.go:107] duration metric: took 58.507231282s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0803 23:05:18.786786  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:18.870821  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:19.286777  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:19.370971  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:19.566522  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:19.786265  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:19.871581  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:20.286963  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:20.370835  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:20.786501  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:20.871064  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:21.286486  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:21.369913  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:21.566688  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:21.785908  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:21.871750  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:22.287312  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:22.372704  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:22.787291  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:22.872885  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:23.287911  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:23.371425  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:23.567468  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:23.785931  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:23.870673  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:24.286189  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:24.370551  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:24.786851  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:24.871030  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:25.286648  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:25.370612  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:25.786327  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:25.870185  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:26.066409  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:26.287108  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:26.371041  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:26.785637  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:26.870928  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:27.286814  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:27.370585  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:27.887921  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:27.888703  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:28.069730  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:28.286634  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:28.371311  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:28.786384  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:28.873009  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:29.285488  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:29.370636  331973 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0803 23:05:29.785524  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:29.870515  331973 kapi.go:107] duration metric: took 1m12.504425546s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0803 23:05:30.070690  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:30.286651  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:30.786379  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:31.287251  331973 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0803 23:05:31.786368  331973 kapi.go:107] duration metric: took 1m10.004004799s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0803 23:05:31.787908  331973 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-033173 cluster.

	I0803 23:05:31.789252  331973 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0803 23:05:31.790450  331973 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0803 23:05:31.791591  331973 out.go:177] * Enabled addons: storage-provisioner, nvidia-device-plugin, metrics-server, ingress-dns, inspektor-gadget, helm-tiller, cloud-spanner, yakd, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

	I0803 23:05:31.792679  331973 addons.go:510] duration metric: took 1m23.504802811s for enable addons: enabled=[storage-provisioner nvidia-device-plugin metrics-server ingress-dns inspektor-gadget helm-tiller cloud-spanner yakd default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]

	I0803 23:05:32.568359  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:35.067065  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:37.067616  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:39.067858  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:41.567338  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:44.067248  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:46.070667  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:48.566424  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:50.567234  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:52.567473  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:55.067707  331973 pod_ready.go:102] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"False"

	I0803 23:05:56.068473  331973 pod_ready.go:92] pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace has status "Ready":"True"

	I0803 23:05:56.068497  331973 pod_ready.go:81] duration metric: took 1m37.50817924s for pod "metrics-server-c59844bb4-dwpwm" in "kube-system" namespace to be "Ready" ...

	I0803 23:05:56.068507  331973 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-8pff4" in "kube-system" namespace to be "Ready" ...

	I0803 23:05:56.074765  331973 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-8pff4" in "kube-system" namespace has status "Ready":"True"

	I0803 23:05:56.074790  331973 pod_ready.go:81] duration metric: took 6.275948ms for pod "nvidia-device-plugin-daemonset-8pff4" in "kube-system" namespace to be "Ready" ...

	I0803 23:05:56.074807  331973 pod_ready.go:38] duration metric: took 1m38.691390204s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:05:56.074828  331973 api_server.go:52] waiting for apiserver process to appear ...

	I0803 23:05:56.074877  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0803 23:05:56.074952  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0803 23:05:56.140184  331973 cri.go:89] found id: "99cd8af102599e274582a5b8d5dc785e239f1aeabc91c4797781318ef2427ed2"

	I0803 23:05:56.140207  331973 cri.go:89] found id: ""

	I0803 23:05:56.140216  331973 logs.go:276] 1 containers: [99cd8af102599e274582a5b8d5dc785e239f1aeabc91c4797781318ef2427ed2]

	I0803 23:05:56.140278  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:05:56.147196  331973 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0803 23:05:56.147269  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0803 23:05:56.187685  331973 cri.go:89] found id: "b8a4cf8941db83b559399a869f1e73bc20c0b73f7118b7dd715b4dc9ad2394c9"

	I0803 23:05:56.187720  331973 cri.go:89] found id: ""

	I0803 23:05:56.187728  331973 logs.go:276] 1 containers: [b8a4cf8941db83b559399a869f1e73bc20c0b73f7118b7dd715b4dc9ad2394c9]

	I0803 23:05:56.187796  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:05:56.192598  331973 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0803 23:05:56.192682  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0803 23:05:56.236882  331973 cri.go:89] found id: "ad5943411451d49b2c70562c1457cf6f2d6645ab21360d86649fa762e1b4a229"

	I0803 23:05:56.236912  331973 cri.go:89] found id: ""

	I0803 23:05:56.236923  331973 logs.go:276] 1 containers: [ad5943411451d49b2c70562c1457cf6f2d6645ab21360d86649fa762e1b4a229]

	I0803 23:05:56.236984  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:05:56.241185  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0803 23:05:56.241251  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0803 23:05:56.281871  331973 cri.go:89] found id: "3c5bf9abcdaf9e84147eba02e6f052cb0bfd42c1d8cafffc46a7ca2c151fe7a4"

	I0803 23:05:56.281897  331973 cri.go:89] found id: ""

	I0803 23:05:56.281907  331973 logs.go:276] 1 containers: [3c5bf9abcdaf9e84147eba02e6f052cb0bfd42c1d8cafffc46a7ca2c151fe7a4]

	I0803 23:05:56.281970  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:05:56.286514  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0803 23:05:56.286595  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0803 23:05:56.324124  331973 cri.go:89] found id: "d3e41eeab565723a5b99ad40d3a1c93a2e6be163c313483c872d90305196bfc1"

	I0803 23:05:56.324156  331973 cri.go:89] found id: ""

	I0803 23:05:56.324168  331973 logs.go:276] 1 containers: [d3e41eeab565723a5b99ad40d3a1c93a2e6be163c313483c872d90305196bfc1]

	I0803 23:05:56.324231  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:05:56.328433  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0803 23:05:56.328513  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0803 23:05:56.370890  331973 cri.go:89] found id: "926e17381f97111bcb5818f9abac36cb06b49250b0e09244f2a22c3a7e4409fc"

	I0803 23:05:56.370918  331973 cri.go:89] found id: ""

	I0803 23:05:56.370929  331973 logs.go:276] 1 containers: [926e17381f97111bcb5818f9abac36cb06b49250b0e09244f2a22c3a7e4409fc]

	I0803 23:05:56.370991  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:05:56.378562  331973 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0803 23:05:56.378654  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0803 23:05:56.417015  331973 cri.go:89] found id: ""

	I0803 23:05:56.417043  331973 logs.go:276] 0 containers: []

	W0803 23:05:56.417052  331973 logs.go:278] No container was found matching "kindnet"

	I0803 23:05:56.417061  331973 logs.go:123] Gathering logs for kubelet ...

	I0803 23:05:56.417076  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I0803 23:05:56.502539  331973 logs.go:123] Gathering logs for dmesg ...

	I0803 23:05:56.502586  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0803 23:05:56.518399  331973 logs.go:123] Gathering logs for describe nodes ...

	I0803 23:05:56.518436  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0803 23:05:56.727128  331973 logs.go:123] Gathering logs for etcd [b8a4cf8941db83b559399a869f1e73bc20c0b73f7118b7dd715b4dc9ad2394c9] ...

	I0803 23:05:56.727163  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8a4cf8941db83b559399a869f1e73bc20c0b73f7118b7dd715b4dc9ad2394c9"

	I0803 23:05:56.786293  331973 logs.go:123] Gathering logs for coredns [ad5943411451d49b2c70562c1457cf6f2d6645ab21360d86649fa762e1b4a229] ...

	I0803 23:05:56.786333  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ad5943411451d49b2c70562c1457cf6f2d6645ab21360d86649fa762e1b4a229"

	I0803 23:05:56.831585  331973 logs.go:123] Gathering logs for kube-controller-manager [926e17381f97111bcb5818f9abac36cb06b49250b0e09244f2a22c3a7e4409fc] ...

	I0803 23:05:56.831621  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 926e17381f97111bcb5818f9abac36cb06b49250b0e09244f2a22c3a7e4409fc"

	I0803 23:05:56.915756  331973 logs.go:123] Gathering logs for kube-apiserver [99cd8af102599e274582a5b8d5dc785e239f1aeabc91c4797781318ef2427ed2] ...

	I0803 23:05:56.915806  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99cd8af102599e274582a5b8d5dc785e239f1aeabc91c4797781318ef2427ed2"

	I0803 23:05:56.966478  331973 logs.go:123] Gathering logs for kube-scheduler [3c5bf9abcdaf9e84147eba02e6f052cb0bfd42c1d8cafffc46a7ca2c151fe7a4] ...

	I0803 23:05:56.966521  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c5bf9abcdaf9e84147eba02e6f052cb0bfd42c1d8cafffc46a7ca2c151fe7a4"

	I0803 23:05:57.011959  331973 logs.go:123] Gathering logs for kube-proxy [d3e41eeab565723a5b99ad40d3a1c93a2e6be163c313483c872d90305196bfc1] ...

	I0803 23:05:57.011998  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d3e41eeab565723a5b99ad40d3a1c93a2e6be163c313483c872d90305196bfc1"

	I0803 23:05:57.049630  331973 logs.go:123] Gathering logs for CRI-O ...

	I0803 23:05:57.049663  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I0803 23:05:58.114830  331973 logs.go:123] Gathering logs for container status ...

	I0803 23:05:58.114905  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0803 23:06:00.687346  331973 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:06:00.709224  331973 api_server.go:72] duration metric: took 1m52.421429525s to wait for apiserver process to appear ...

	I0803 23:06:00.709258  331973 api_server.go:88] waiting for apiserver healthz status ...

	I0803 23:06:00.709311  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0803 23:06:00.709388  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0803 23:06:00.750990  331973 cri.go:89] found id: "99cd8af102599e274582a5b8d5dc785e239f1aeabc91c4797781318ef2427ed2"

	I0803 23:06:00.751018  331973 cri.go:89] found id: ""

	I0803 23:06:00.751029  331973 logs.go:276] 1 containers: [99cd8af102599e274582a5b8d5dc785e239f1aeabc91c4797781318ef2427ed2]

	I0803 23:06:00.751087  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:06:00.755273  331973 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0803 23:06:00.755366  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0803 23:06:00.794769  331973 cri.go:89] found id: "b8a4cf8941db83b559399a869f1e73bc20c0b73f7118b7dd715b4dc9ad2394c9"

	I0803 23:06:00.794797  331973 cri.go:89] found id: ""

	I0803 23:06:00.794807  331973 logs.go:276] 1 containers: [b8a4cf8941db83b559399a869f1e73bc20c0b73f7118b7dd715b4dc9ad2394c9]

	I0803 23:06:00.794883  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:06:00.799272  331973 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0803 23:06:00.799337  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0803 23:06:00.842551  331973 cri.go:89] found id: "ad5943411451d49b2c70562c1457cf6f2d6645ab21360d86649fa762e1b4a229"

	I0803 23:06:00.842579  331973 cri.go:89] found id: ""

	I0803 23:06:00.842590  331973 logs.go:276] 1 containers: [ad5943411451d49b2c70562c1457cf6f2d6645ab21360d86649fa762e1b4a229]

	I0803 23:06:00.842654  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:06:00.848050  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0803 23:06:00.848123  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0803 23:06:00.915418  331973 cri.go:89] found id: "3c5bf9abcdaf9e84147eba02e6f052cb0bfd42c1d8cafffc46a7ca2c151fe7a4"

	I0803 23:06:00.915447  331973 cri.go:89] found id: ""

	I0803 23:06:00.915458  331973 logs.go:276] 1 containers: [3c5bf9abcdaf9e84147eba02e6f052cb0bfd42c1d8cafffc46a7ca2c151fe7a4]

	I0803 23:06:00.915519  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:06:00.920182  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0803 23:06:00.920247  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0803 23:06:00.959873  331973 cri.go:89] found id: "d3e41eeab565723a5b99ad40d3a1c93a2e6be163c313483c872d90305196bfc1"

	I0803 23:06:00.959911  331973 cri.go:89] found id: ""

	I0803 23:06:00.959922  331973 logs.go:276] 1 containers: [d3e41eeab565723a5b99ad40d3a1c93a2e6be163c313483c872d90305196bfc1]

	I0803 23:06:00.959984  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:06:00.964354  331973 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0803 23:06:00.964426  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0803 23:06:01.006874  331973 cri.go:89] found id: "926e17381f97111bcb5818f9abac36cb06b49250b0e09244f2a22c3a7e4409fc"

	I0803 23:06:01.006899  331973 cri.go:89] found id: ""

	I0803 23:06:01.006909  331973 logs.go:276] 1 containers: [926e17381f97111bcb5818f9abac36cb06b49250b0e09244f2a22c3a7e4409fc]

	I0803 23:06:01.006965  331973 ssh_runner.go:195] Run: which crictl

	I0803 23:06:01.011733  331973 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0803 23:06:01.011801  331973 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0803 23:06:01.052773  331973 cri.go:89] found id: ""

	I0803 23:06:01.052808  331973 logs.go:276] 0 containers: []

	W0803 23:06:01.052817  331973 logs.go:278] No container was found matching "kindnet"

	I0803 23:06:01.052828  331973 logs.go:123] Gathering logs for CRI-O ...

	I0803 23:06:01.052847  331973 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:112: out/minikube-linux-amd64 start -p addons-033173 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: signal: killed

--- FAIL: TestAddons/Setup (2400.06s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 node stop m02 -v=7 --alsologtostderr

E0803 23:53:05.380506  331097 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/functional-189533/client.crt: no such file or directory

E0803 23:53:46.341165  331097 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/functional-189533/client.crt: no such file or directory

ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.483835631s)

-- stdout --

	* Stopping node "ha-349588-m02"  ...

-- /stdout --

** stderr ** 

	I0803 23:52:55.885068  350157 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:52:55.885345  350157 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:52:55.885356  350157 out.go:304] Setting ErrFile to fd 2...

	I0803 23:52:55.885360  350157 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:52:55.885603  350157 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:52:55.885870  350157 mustload.go:65] Loading cluster: ha-349588

	I0803 23:52:55.886239  350157 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:52:55.886266  350157 stop.go:39] StopHost: ha-349588-m02

	I0803 23:52:55.886721  350157 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:52:55.886778  350157 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:52:55.902968  350157 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44063

	I0803 23:52:55.903464  350157 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:52:55.904115  350157 main.go:141] libmachine: Using API Version  1

	I0803 23:52:55.904146  350157 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:52:55.904499  350157 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:52:55.906791  350157 out.go:177] * Stopping node "ha-349588-m02"  ...

	I0803 23:52:55.908010  350157 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I0803 23:52:55.908040  350157 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:52:55.908298  350157 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I0803 23:52:55.908338  350157 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:52:55.911367  350157 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:52:55.911848  350157 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:52:55.911889  350157 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:52:55.912029  350157 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:52:55.912199  350157 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:52:55.912363  350157 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:52:55.912472  350157 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:52:55.997103  350157 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I0803 23:52:56.054339  350157 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I0803 23:52:56.114424  350157 main.go:141] libmachine: Stopping "ha-349588-m02"...

	I0803 23:52:56.114463  350157 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:52:56.116017  350157 main.go:141] libmachine: (ha-349588-m02) Calling .Stop

	I0803 23:52:56.119752  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 0/120

	I0803 23:52:57.121111  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 1/120

	I0803 23:52:58.122741  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 2/120

	I0803 23:52:59.124486  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 3/120

	I0803 23:53:00.126418  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 4/120

	I0803 23:53:01.128560  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 5/120

	I0803 23:53:02.130697  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 6/120

	I0803 23:53:03.131930  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 7/120

	I0803 23:53:04.133392  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 8/120

	I0803 23:53:05.134961  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 9/120

	I0803 23:53:06.136892  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 10/120

	I0803 23:53:07.138260  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 11/120

	I0803 23:53:08.140021  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 12/120

	I0803 23:53:09.141422  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 13/120

	I0803 23:53:10.143118  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 14/120

	I0803 23:53:11.144890  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 15/120

	I0803 23:53:12.146422  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 16/120

	I0803 23:53:13.148036  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 17/120

	I0803 23:53:14.149353  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 18/120

	I0803 23:53:15.151042  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 19/120

	I0803 23:53:16.153350  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 20/120

	I0803 23:53:17.154741  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 21/120

	I0803 23:53:18.156145  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 22/120

	I0803 23:53:19.158201  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 23/120

	I0803 23:53:20.160469  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 24/120

	I0803 23:53:21.162647  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 25/120

	I0803 23:53:22.164049  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 26/120

	I0803 23:53:23.165349  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 27/120

	I0803 23:53:24.166975  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 28/120

	I0803 23:53:25.168859  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 29/120

	I0803 23:53:26.171235  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 30/120

	I0803 23:53:27.172956  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 31/120

	I0803 23:53:28.174498  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 32/120

	I0803 23:53:29.176169  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 33/120

	I0803 23:53:30.177709  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 34/120

	I0803 23:53:31.179858  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 35/120

	I0803 23:53:32.181314  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 36/120

	I0803 23:53:33.182621  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 37/120

	I0803 23:53:34.184088  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 38/120

	I0803 23:53:35.185292  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 39/120

	I0803 23:53:36.187095  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 40/120

	I0803 23:53:37.188526  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 41/120

	I0803 23:53:38.190847  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 42/120

	I0803 23:53:39.193135  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 43/120

	I0803 23:53:40.194968  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 44/120

	I0803 23:53:41.196993  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 45/120

	I0803 23:53:42.198647  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 46/120

	I0803 23:53:43.200498  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 47/120

	I0803 23:53:44.202403  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 48/120

	I0803 23:53:45.204110  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 49/120

	I0803 23:53:46.205679  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 50/120

	I0803 23:53:47.206925  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 51/120

	I0803 23:53:48.208577  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 52/120

	I0803 23:53:49.210811  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 53/120

	I0803 23:53:50.212195  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 54/120

	I0803 23:53:51.214453  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 55/120

	I0803 23:53:52.216258  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 56/120

	I0803 23:53:53.217763  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 57/120

	I0803 23:53:54.220430  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 58/120

	I0803 23:53:55.221875  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 59/120

	I0803 23:53:56.224058  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 60/120

	I0803 23:53:57.225373  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 61/120

	I0803 23:53:58.226782  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 62/120

	I0803 23:53:59.228123  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 63/120

	I0803 23:54:00.229450  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 64/120

	I0803 23:54:01.231376  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 65/120

	I0803 23:54:02.233333  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 66/120

	I0803 23:54:03.235130  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 67/120

	I0803 23:54:04.236471  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 68/120

	I0803 23:54:05.237860  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 69/120

	I0803 23:54:06.239775  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 70/120

	I0803 23:54:07.241362  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 71/120

	I0803 23:54:08.243048  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 72/120

	I0803 23:54:09.244695  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 73/120

	I0803 23:54:10.246242  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 74/120

	I0803 23:54:11.248087  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 75/120

	I0803 23:54:12.250307  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 76/120

	I0803 23:54:13.251659  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 77/120

	I0803 23:54:14.253457  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 78/120

	I0803 23:54:15.254807  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 79/120

	I0803 23:54:16.256604  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 80/120

	I0803 23:54:17.258157  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 81/120

	I0803 23:54:18.259999  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 82/120

	I0803 23:54:19.261457  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 83/120

	I0803 23:54:20.263051  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 84/120

	I0803 23:54:21.264859  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 85/120

	I0803 23:54:22.266505  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 86/120

	I0803 23:54:23.268297  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 87/120

	I0803 23:54:24.269999  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 88/120

	I0803 23:54:25.272051  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 89/120

	I0803 23:54:26.274670  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 90/120

	I0803 23:54:27.276569  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 91/120

	I0803 23:54:28.278156  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 92/120

	I0803 23:54:29.280147  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 93/120

	I0803 23:54:30.281629  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 94/120

	I0803 23:54:31.282897  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 95/120

	I0803 23:54:32.284297  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 96/120

	I0803 23:54:33.286046  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 97/120

	I0803 23:54:34.288081  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 98/120

	I0803 23:54:35.289601  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 99/120

	I0803 23:54:36.291725  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 100/120

	I0803 23:54:37.293703  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 101/120

	I0803 23:54:38.295919  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 102/120

	I0803 23:54:39.297440  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 103/120

	I0803 23:54:40.298781  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 104/120

	I0803 23:54:41.300535  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 105/120

	I0803 23:54:42.302075  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 106/120

	I0803 23:54:43.303616  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 107/120

	I0803 23:54:44.305371  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 108/120

	I0803 23:54:45.306780  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 109/120

	I0803 23:54:46.308950  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 110/120

	I0803 23:54:47.310450  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 111/120

	I0803 23:54:48.312138  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 112/120

	I0803 23:54:49.313485  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 113/120

	I0803 23:54:50.314909  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 114/120

	I0803 23:54:51.316777  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 115/120

	I0803 23:54:52.318257  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 116/120

	I0803 23:54:53.320232  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 117/120

	I0803 23:54:54.322382  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 118/120

	I0803 23:54:55.323730  350157 main.go:141] libmachine: (ha-349588-m02) Waiting for machine to stop 119/120

	I0803 23:54:56.324285  350157 stop.go:66] stop err: unable to stop vm, current state "Running"

	W0803 23:54:56.324468  350157 out.go:239] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-349588 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:369: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

E0803 23:55:08.262104  331097 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/functional-189533/client.crt: no such file or directory

ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (19.140919097s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:54:56.372578  350614 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:54:56.372724  350614 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:54:56.372732  350614 out.go:304] Setting ErrFile to fd 2...

	I0803 23:54:56.372749  350614 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:54:56.372962  350614 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:54:56.373149  350614 out.go:298] Setting JSON to false

	I0803 23:54:56.373184  350614 mustload.go:65] Loading cluster: ha-349588

	I0803 23:54:56.373229  350614 notify.go:220] Checking for updates...

	I0803 23:54:56.373667  350614 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:54:56.373698  350614 status.go:255] checking status of ha-349588 ...

	I0803 23:54:56.374076  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:54:56.374146  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:54:56.391550  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40635

	I0803 23:54:56.392083  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:54:56.392712  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:54:56.392736  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:54:56.393135  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:54:56.393344  350614 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:54:56.395039  350614 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:54:56.395065  350614 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:54:56.395398  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:54:56.395453  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:54:56.412245  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34519

	I0803 23:54:56.412754  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:54:56.413237  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:54:56.413267  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:54:56.413679  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:54:56.413911  350614 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:54:56.417066  350614 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:54:56.417546  350614 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:54:56.417603  350614 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:54:56.417671  350614 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:54:56.417989  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:54:56.418023  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:54:56.435091  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46047

	I0803 23:54:56.435505  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:54:56.435994  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:54:56.436023  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:54:56.436340  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:54:56.436562  350614 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:54:56.436751  350614 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:54:56.436791  350614 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:54:56.439743  350614 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:54:56.440225  350614 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:54:56.440254  350614 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:54:56.440407  350614 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:54:56.440598  350614 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:54:56.440773  350614 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:54:56.440915  350614 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:54:56.524664  350614 ssh_runner.go:195] Run: systemctl --version

	I0803 23:54:56.533615  350614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:54:56.553720  350614 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:54:56.553760  350614 api_server.go:166] Checking apiserver status ...

	I0803 23:54:56.553815  350614 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:54:56.571305  350614 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:54:56.582313  350614 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:54:56.582375  350614 ssh_runner.go:195] Run: ls

	I0803 23:54:56.587242  350614 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:54:56.594203  350614 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:54:56.594236  350614 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:54:56.594250  350614 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:54:56.594274  350614 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:54:56.594599  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:54:56.594645  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:54:56.610640  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42519

	I0803 23:54:56.611129  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:54:56.611641  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:54:56.611684  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:54:56.612038  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:54:56.612241  350614 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:54:56.613884  350614 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:54:56.613904  350614 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:54:56.614225  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:54:56.614292  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:54:56.629630  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44699

	I0803 23:54:56.630214  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:54:56.630769  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:54:56.630797  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:54:56.631172  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:54:56.631393  350614 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:54:56.634484  350614 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:54:56.634975  350614 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:54:56.635004  350614 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:54:56.635151  350614 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:54:56.635472  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:54:56.635518  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:54:56.651595  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38553

	I0803 23:54:56.652111  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:54:56.652618  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:54:56.652638  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:54:56.652993  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:54:56.653185  350614 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:54:56.653410  350614 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:54:56.653433  350614 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:54:56.656415  350614 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:54:56.656853  350614 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:54:56.656880  350614 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:54:56.657057  350614 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:54:56.657243  350614 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:54:56.657453  350614 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:54:56.657621  350614 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:15.085831  350614 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:15.085971  350614 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:15.085996  350614 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:15.086004  350614 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:15.086054  350614 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:15.086065  350614 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:15.086422  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:15.086482  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:15.102075  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39053

	I0803 23:55:15.102581  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:15.103220  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:55:15.103244  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:15.103621  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:15.103843  350614 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:15.105708  350614 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:15.105725  350614 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:15.106035  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:15.106076  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:15.121252  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35353

	I0803 23:55:15.121810  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:15.122303  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:55:15.122326  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:15.122687  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:15.122899  350614 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:15.125694  350614 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:15.126168  350614 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:15.126188  350614 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:15.126376  350614 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:15.126827  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:15.126882  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:15.142618  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38549

	I0803 23:55:15.143162  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:15.143780  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:55:15.143805  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:15.144124  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:15.144327  350614 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:15.144532  350614 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:15.144554  350614 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:15.147494  350614 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:15.148003  350614 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:15.148035  350614 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:15.148163  350614 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:15.148376  350614 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:15.148650  350614 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:15.148814  350614 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:15.240584  350614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:15.260453  350614 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:15.260487  350614 api_server.go:166] Checking apiserver status ...

	I0803 23:55:15.260533  350614 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:15.278366  350614 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:15.289092  350614 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:15.289181  350614 ssh_runner.go:195] Run: ls

	I0803 23:55:15.294925  350614 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:15.299399  350614 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:15.299431  350614 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:15.299444  350614 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:15.299501  350614 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:15.299872  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:15.299913  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:15.315313  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46383

	I0803 23:55:15.315787  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:15.316329  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:55:15.316353  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:15.316668  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:15.316850  350614 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:15.318686  350614 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:15.318709  350614 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:15.319165  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:15.319224  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:15.334839  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44767

	I0803 23:55:15.335302  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:15.335753  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:55:15.335777  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:15.336132  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:15.336309  350614 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:15.339078  350614 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:15.339574  350614 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:15.339616  350614 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:15.339773  350614 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:15.340108  350614 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:15.340159  350614 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:15.355441  350614 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33187

	I0803 23:55:15.355938  350614 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:15.356480  350614 main.go:141] libmachine: Using API Version  1

	I0803 23:55:15.356508  350614 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:15.356839  350614 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:15.357049  350614 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:15.357238  350614 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:15.357260  350614 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:15.360109  350614 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:15.360538  350614 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:15.360564  350614 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:15.360701  350614 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:15.360901  350614 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:15.361055  350614 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:15.361209  350614 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:15.446722  350614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:15.464933  350614 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:372: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr" : exit status 3

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-349588 -n ha-349588

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-349588 logs -n 25: (1.484477774s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1280567125/001/cp-test_ha-349588-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588:/home/docker/cp-test_ha-349588-m03_ha-349588.txt                       |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588 sudo cat                                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m03_ha-349588.txt                                 |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m02:/home/docker/cp-test_ha-349588-m03_ha-349588-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m02 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m03_ha-349588-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04:/home/docker/cp-test_ha-349588-m03_ha-349588-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m04 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m03_ha-349588-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-349588 cp testdata/cp-test.txt                                                | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1280567125/001/cp-test_ha-349588-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588:/home/docker/cp-test_ha-349588-m04_ha-349588.txt                       |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588 sudo cat                                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m04_ha-349588.txt                                 |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m02:/home/docker/cp-test_ha-349588-m04_ha-349588-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m02 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m04_ha-349588-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03:/home/docker/cp-test_ha-349588-m04_ha-349588-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m03 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m04_ha-349588-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-349588 node stop m02 -v=7                                                     | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/03 23:48:09

	Running on machine: ubuntu-20-agent-13

	Binary: Built with gc go1.22.5 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0803 23:48:09.418625  346092 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:48:09.418752  346092 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:48:09.418762  346092 out.go:304] Setting ErrFile to fd 2...

	I0803 23:48:09.418768  346092 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:48:09.418971  346092 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:48:09.419574  346092 out.go:298] Setting JSON to false

	I0803 23:48:09.420569  346092 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":30637,"bootTime":1722698252,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0803 23:48:09.420633  346092 start.go:139] virtualization: kvm guest

	I0803 23:48:09.422786  346092 out.go:177] * [ha-349588] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0803 23:48:09.424092  346092 out.go:177]   - MINIKUBE_LOCATION=19370

	I0803 23:48:09.424144  346092 notify.go:220] Checking for updates...

	I0803 23:48:09.426416  346092 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0803 23:48:09.427707  346092 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:48:09.429120  346092 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:48:09.430526  346092 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0803 23:48:09.431632  346092 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0803 23:48:09.432954  346092 driver.go:392] Setting default libvirt URI to qemu:///system

	I0803 23:48:09.470138  346092 out.go:177] * Using the kvm2 driver based on user configuration

	I0803 23:48:09.471317  346092 start.go:297] selected driver: kvm2

	I0803 23:48:09.471334  346092 start.go:901] validating driver "kvm2" against <nil>

	I0803 23:48:09.471347  346092 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0803 23:48:09.472158  346092 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0803 23:48:09.472262  346092 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19370-323890/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0803 23:48:09.488603  346092 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0803 23:48:09.488655  346092 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0803 23:48:09.488888  346092 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:48:09.488957  346092 cni.go:84] Creating CNI manager for ""

	I0803 23:48:09.488969  346092 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0803 23:48:09.488977  346092 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0803 23:48:09.489047  346092 start.go:340] cluster config:

	{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0803 23:48:09.489163  346092 iso.go:125] acquiring lock: {Name:mke18ad45a0f8e7ec51adacd21c7952f17bf0357 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0803 23:48:09.490895  346092 out.go:177] * Starting "ha-349588" primary control-plane node in "ha-349588" cluster

	I0803 23:48:09.491984  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:48:09.492039  346092 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4

	I0803 23:48:09.492063  346092 cache.go:56] Caching tarball of preloaded images

	I0803 23:48:09.492163  346092 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:48:09.492174  346092 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:48:09.492520  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:48:09.492548  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json: {Name:mk903cfda9df964846737e7e0ecec8ea46a5827c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:09.492717  346092 start.go:360] acquireMachinesLock for ha-349588: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:48:09.492747  346092 start.go:364] duration metric: took 17.293µs to acquireMachinesLock for "ha-349588"

	I0803 23:48:09.492765  346092 start.go:93] Provisioning new machine with config: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:48:09.492824  346092 start.go:125] createHost starting for "" (driver="kvm2")

	I0803 23:48:09.494421  346092 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0803 23:48:09.494578  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:48:09.494618  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:48:09.509993  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38087

	I0803 23:48:09.510451  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:48:09.511049  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:48:09.511070  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:48:09.511439  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:48:09.511701  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:09.511862  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:09.512020  346092 start.go:159] libmachine.API.Create for "ha-349588" (driver="kvm2")

	I0803 23:48:09.512050  346092 client.go:168] LocalClient.Create starting

	I0803 23:48:09.512089  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:48:09.512149  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:48:09.512174  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:48:09.512252  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:48:09.512279  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:48:09.512295  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:48:09.512320  346092 main.go:141] libmachine: Running pre-create checks...

	I0803 23:48:09.512339  346092 main.go:141] libmachine: (ha-349588) Calling .PreCreateCheck

	I0803 23:48:09.512682  346092 main.go:141] libmachine: (ha-349588) Calling .GetConfigRaw

	I0803 23:48:09.513102  346092 main.go:141] libmachine: Creating machine...

	I0803 23:48:09.513120  346092 main.go:141] libmachine: (ha-349588) Calling .Create

	I0803 23:48:09.513250  346092 main.go:141] libmachine: (ha-349588) Creating KVM machine...

	I0803 23:48:09.514581  346092 main.go:141] libmachine: (ha-349588) DBG | found existing default KVM network

	I0803 23:48:09.515280  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.515113  346115 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00012d990}

	I0803 23:48:09.515306  346092 main.go:141] libmachine: (ha-349588) DBG | created network xml: 

	I0803 23:48:09.515319  346092 main.go:141] libmachine: (ha-349588) DBG | <network>

	I0803 23:48:09.515327  346092 main.go:141] libmachine: (ha-349588) DBG |   <name>mk-ha-349588</name>

	I0803 23:48:09.515341  346092 main.go:141] libmachine: (ha-349588) DBG |   <dns enable='no'/>

	I0803 23:48:09.515351  346092 main.go:141] libmachine: (ha-349588) DBG |   

	I0803 23:48:09.515360  346092 main.go:141] libmachine: (ha-349588) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0803 23:48:09.515366  346092 main.go:141] libmachine: (ha-349588) DBG |     <dhcp>

	I0803 23:48:09.515374  346092 main.go:141] libmachine: (ha-349588) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0803 23:48:09.515391  346092 main.go:141] libmachine: (ha-349588) DBG |     </dhcp>

	I0803 23:48:09.515412  346092 main.go:141] libmachine: (ha-349588) DBG |   </ip>

	I0803 23:48:09.515424  346092 main.go:141] libmachine: (ha-349588) DBG |   

	I0803 23:48:09.515430  346092 main.go:141] libmachine: (ha-349588) DBG | </network>

	I0803 23:48:09.515435  346092 main.go:141] libmachine: (ha-349588) DBG | 

	I0803 23:48:09.520559  346092 main.go:141] libmachine: (ha-349588) DBG | trying to create private KVM network mk-ha-349588 192.168.39.0/24...

	I0803 23:48:09.590357  346092 main.go:141] libmachine: (ha-349588) DBG | private KVM network mk-ha-349588 192.168.39.0/24 created

	I0803 23:48:09.590389  346092 main.go:141] libmachine: (ha-349588) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588 ...

	I0803 23:48:09.590434  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.590305  346115 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:48:09.590461  346092 main.go:141] libmachine: (ha-349588) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:48:09.590489  346092 main.go:141] libmachine: (ha-349588) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:48:09.872162  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.871931  346115 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa...

	I0803 23:48:09.925823  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.925663  346115 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/ha-349588.rawdisk...

	I0803 23:48:09.925875  346092 main.go:141] libmachine: (ha-349588) DBG | Writing magic tar header

	I0803 23:48:09.925892  346092 main.go:141] libmachine: (ha-349588) DBG | Writing SSH key tar header

	I0803 23:48:09.925900  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.925798  346115 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588 ...

	I0803 23:48:09.925912  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588

	I0803 23:48:09.925995  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588 (perms=drwx------)

	I0803 23:48:09.926018  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:48:09.926030  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:48:09.926051  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:48:09.926063  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:48:09.926077  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:48:09.926086  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:48:09.926094  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:48:09.926102  346092 main.go:141] libmachine: (ha-349588) Creating domain...

	I0803 23:48:09.926112  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:48:09.926120  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:48:09.926126  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:48:09.926135  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home

	I0803 23:48:09.926168  346092 main.go:141] libmachine: (ha-349588) DBG | Skipping /home - not owner

	I0803 23:48:09.927340  346092 main.go:141] libmachine: (ha-349588) define libvirt domain using xml: 

	I0803 23:48:09.927363  346092 main.go:141] libmachine: (ha-349588) <domain type='kvm'>

	I0803 23:48:09.927373  346092 main.go:141] libmachine: (ha-349588)   <name>ha-349588</name>

	I0803 23:48:09.927384  346092 main.go:141] libmachine: (ha-349588)   <memory unit='MiB'>2200</memory>

	I0803 23:48:09.927393  346092 main.go:141] libmachine: (ha-349588)   <vcpu>2</vcpu>

	I0803 23:48:09.927402  346092 main.go:141] libmachine: (ha-349588)   <features>

	I0803 23:48:09.927414  346092 main.go:141] libmachine: (ha-349588)     <acpi/>

	I0803 23:48:09.927420  346092 main.go:141] libmachine: (ha-349588)     <apic/>

	I0803 23:48:09.927429  346092 main.go:141] libmachine: (ha-349588)     <pae/>

	I0803 23:48:09.927443  346092 main.go:141] libmachine: (ha-349588)     

	I0803 23:48:09.927452  346092 main.go:141] libmachine: (ha-349588)   </features>

	I0803 23:48:09.927466  346092 main.go:141] libmachine: (ha-349588)   <cpu mode='host-passthrough'>

	I0803 23:48:09.927474  346092 main.go:141] libmachine: (ha-349588)   

	I0803 23:48:09.927485  346092 main.go:141] libmachine: (ha-349588)   </cpu>

	I0803 23:48:09.927493  346092 main.go:141] libmachine: (ha-349588)   <os>

	I0803 23:48:09.927500  346092 main.go:141] libmachine: (ha-349588)     <type>hvm</type>

	I0803 23:48:09.927509  346092 main.go:141] libmachine: (ha-349588)     <boot dev='cdrom'/>

	I0803 23:48:09.927519  346092 main.go:141] libmachine: (ha-349588)     <boot dev='hd'/>

	I0803 23:48:09.927528  346092 main.go:141] libmachine: (ha-349588)     <bootmenu enable='no'/>

	I0803 23:48:09.927541  346092 main.go:141] libmachine: (ha-349588)   </os>

	I0803 23:48:09.927557  346092 main.go:141] libmachine: (ha-349588)   <devices>

	I0803 23:48:09.927567  346092 main.go:141] libmachine: (ha-349588)     <disk type='file' device='cdrom'>

	I0803 23:48:09.927580  346092 main.go:141] libmachine: (ha-349588)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/boot2docker.iso'/>

	I0803 23:48:09.927595  346092 main.go:141] libmachine: (ha-349588)       <target dev='hdc' bus='scsi'/>

	I0803 23:48:09.927606  346092 main.go:141] libmachine: (ha-349588)       <readonly/>

	I0803 23:48:09.927615  346092 main.go:141] libmachine: (ha-349588)     </disk>

	I0803 23:48:09.927625  346092 main.go:141] libmachine: (ha-349588)     <disk type='file' device='disk'>

	I0803 23:48:09.927637  346092 main.go:141] libmachine: (ha-349588)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:48:09.927655  346092 main.go:141] libmachine: (ha-349588)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/ha-349588.rawdisk'/>

	I0803 23:48:09.927670  346092 main.go:141] libmachine: (ha-349588)       <target dev='hda' bus='virtio'/>

	I0803 23:48:09.927681  346092 main.go:141] libmachine: (ha-349588)     </disk>

	I0803 23:48:09.927691  346092 main.go:141] libmachine: (ha-349588)     <interface type='network'>

	I0803 23:48:09.927707  346092 main.go:141] libmachine: (ha-349588)       <source network='mk-ha-349588'/>

	I0803 23:48:09.927717  346092 main.go:141] libmachine: (ha-349588)       <model type='virtio'/>

	I0803 23:48:09.927728  346092 main.go:141] libmachine: (ha-349588)     </interface>

	I0803 23:48:09.927743  346092 main.go:141] libmachine: (ha-349588)     <interface type='network'>

	I0803 23:48:09.927756  346092 main.go:141] libmachine: (ha-349588)       <source network='default'/>

	I0803 23:48:09.927766  346092 main.go:141] libmachine: (ha-349588)       <model type='virtio'/>

	I0803 23:48:09.927776  346092 main.go:141] libmachine: (ha-349588)     </interface>

	I0803 23:48:09.927786  346092 main.go:141] libmachine: (ha-349588)     <serial type='pty'>

	I0803 23:48:09.927795  346092 main.go:141] libmachine: (ha-349588)       <target port='0'/>

	I0803 23:48:09.927804  346092 main.go:141] libmachine: (ha-349588)     </serial>

	I0803 23:48:09.927829  346092 main.go:141] libmachine: (ha-349588)     <console type='pty'>

	I0803 23:48:09.927851  346092 main.go:141] libmachine: (ha-349588)       <target type='serial' port='0'/>

	I0803 23:48:09.927862  346092 main.go:141] libmachine: (ha-349588)     </console>

	I0803 23:48:09.927868  346092 main.go:141] libmachine: (ha-349588)     <rng model='virtio'>

	I0803 23:48:09.927877  346092 main.go:141] libmachine: (ha-349588)       <backend model='random'>/dev/random</backend>

	I0803 23:48:09.927883  346092 main.go:141] libmachine: (ha-349588)     </rng>

	I0803 23:48:09.927888  346092 main.go:141] libmachine: (ha-349588)     

	I0803 23:48:09.927892  346092 main.go:141] libmachine: (ha-349588)     

	I0803 23:48:09.927898  346092 main.go:141] libmachine: (ha-349588)   </devices>

	I0803 23:48:09.927904  346092 main.go:141] libmachine: (ha-349588) </domain>

	I0803 23:48:09.927911  346092 main.go:141] libmachine: (ha-349588) 

	I0803 23:48:09.932195  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:c8:e6:c5 in network default

	I0803 23:48:09.932825  346092 main.go:141] libmachine: (ha-349588) Ensuring networks are active...

	I0803 23:48:09.932848  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:09.933616  346092 main.go:141] libmachine: (ha-349588) Ensuring network default is active

	I0803 23:48:09.933995  346092 main.go:141] libmachine: (ha-349588) Ensuring network mk-ha-349588 is active

	I0803 23:48:09.934553  346092 main.go:141] libmachine: (ha-349588) Getting domain xml...

	I0803 23:48:09.935413  346092 main.go:141] libmachine: (ha-349588) Creating domain...

	I0803 23:48:11.143458  346092 main.go:141] libmachine: (ha-349588) Waiting to get IP...

	I0803 23:48:11.144201  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.144600  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.144647  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.144590  346115 retry.go:31] will retry after 217.821157ms: waiting for machine to come up

	I0803 23:48:11.364303  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.364800  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.364827  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.364747  346115 retry.go:31] will retry after 290.305806ms: waiting for machine to come up

	I0803 23:48:11.656462  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.656882  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.656915  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.656819  346115 retry.go:31] will retry after 307.829475ms: waiting for machine to come up

	I0803 23:48:11.966421  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.966824  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.966854  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.966778  346115 retry.go:31] will retry after 424.675082ms: waiting for machine to come up

	I0803 23:48:12.393572  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:12.394043  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:12.394075  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:12.393985  346115 retry.go:31] will retry after 469.819501ms: waiting for machine to come up

	I0803 23:48:12.865672  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:12.866068  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:12.866113  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:12.866030  346115 retry.go:31] will retry after 703.183302ms: waiting for machine to come up

	I0803 23:48:13.571033  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:13.571450  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:13.571536  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:13.571432  346115 retry.go:31] will retry after 1.123702351s: waiting for machine to come up

	I0803 23:48:14.696577  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:14.697000  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:14.697052  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:14.696947  346115 retry.go:31] will retry after 1.12664628s: waiting for machine to come up

	I0803 23:48:15.824971  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:15.825444  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:15.825471  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:15.825370  346115 retry.go:31] will retry after 1.337432737s: waiting for machine to come up

	I0803 23:48:17.164972  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:17.165341  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:17.165365  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:17.165301  346115 retry.go:31] will retry after 1.584311544s: waiting for machine to come up

	I0803 23:48:18.752092  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:18.752563  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:18.752599  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:18.752497  346115 retry.go:31] will retry after 2.404172369s: waiting for machine to come up

	I0803 23:48:21.159266  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:21.159722  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:21.159746  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:21.159660  346115 retry.go:31] will retry after 3.566530198s: waiting for machine to come up

	I0803 23:48:24.727868  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:24.728217  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:24.728244  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:24.728197  346115 retry.go:31] will retry after 4.050810748s: waiting for machine to come up

	I0803 23:48:28.782752  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:28.783279  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:28.783306  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:28.783240  346115 retry.go:31] will retry after 4.340405118s: waiting for machine to come up

	I0803 23:48:33.126682  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:33.127152  346092 main.go:141] libmachine: (ha-349588) Found IP for machine: 192.168.39.168

	I0803 23:48:33.127176  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has current primary IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:33.127210  346092 main.go:141] libmachine: (ha-349588) Reserving static IP address...

	I0803 23:48:33.127440  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find host DHCP lease matching {name: "ha-349588", mac: "52:54:00:d9:f9:50", ip: "192.168.39.168"} in network mk-ha-349588

	I0803 23:48:33.206830  346092 main.go:141] libmachine: (ha-349588) DBG | Getting to WaitForSSH function...

	I0803 23:48:33.206864  346092 main.go:141] libmachine: (ha-349588) Reserved static IP address: 192.168.39.168

	I0803 23:48:33.206877  346092 main.go:141] libmachine: (ha-349588) Waiting for SSH to be available...

	I0803 23:48:33.209538  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:33.209926  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588

	I0803 23:48:33.209953  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find defined IP address of network mk-ha-349588 interface with MAC address 52:54:00:d9:f9:50

	I0803 23:48:33.210115  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH client type: external

	I0803 23:48:33.210168  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa (-rw-------)

	I0803 23:48:33.210224  346092 main.go:141] libmachine: (ha-349588) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:48:33.210244  346092 main.go:141] libmachine: (ha-349588) DBG | About to run SSH command:

	I0803 23:48:33.210260  346092 main.go:141] libmachine: (ha-349588) DBG | exit 0

	I0803 23:48:33.214010  346092 main.go:141] libmachine: (ha-349588) DBG | SSH cmd err, output: exit status 255: 

	I0803 23:48:33.214077  346092 main.go:141] libmachine: (ha-349588) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0803 23:48:33.214103  346092 main.go:141] libmachine: (ha-349588) DBG | command : exit 0

	I0803 23:48:33.214117  346092 main.go:141] libmachine: (ha-349588) DBG | err     : exit status 255

	I0803 23:48:33.214129  346092 main.go:141] libmachine: (ha-349588) DBG | output  : 

	I0803 23:48:36.215923  346092 main.go:141] libmachine: (ha-349588) DBG | Getting to WaitForSSH function...

	I0803 23:48:36.218572  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.218985  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.219013  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.219082  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH client type: external

	I0803 23:48:36.219103  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa (-rw-------)

	I0803 23:48:36.219141  346092 main.go:141] libmachine: (ha-349588) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.168 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:48:36.219157  346092 main.go:141] libmachine: (ha-349588) DBG | About to run SSH command:

	I0803 23:48:36.219170  346092 main.go:141] libmachine: (ha-349588) DBG | exit 0

	I0803 23:48:36.337862  346092 main.go:141] libmachine: (ha-349588) DBG | SSH cmd err, output: <nil>: 

	I0803 23:48:36.338165  346092 main.go:141] libmachine: (ha-349588) KVM machine creation complete!

	I0803 23:48:36.338513  346092 main.go:141] libmachine: (ha-349588) Calling .GetConfigRaw

	I0803 23:48:36.339091  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:36.339286  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:36.339413  346092 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:48:36.339424  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:48:36.340646  346092 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:48:36.340662  346092 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:48:36.340669  346092 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:48:36.340676  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.342849  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.343214  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.343243  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.343346  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.343540  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.343678  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.343794  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.343956  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.344188  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.344202  346092 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:48:36.441183  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:48:36.441208  346092 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:48:36.441216  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.443990  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.444394  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.444424  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.444612  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.444811  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.444973  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.445104  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.445241  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.445426  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.445437  346092 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:48:36.542286  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:48:36.542365  346092 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:48:36.542371  346092 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:48:36.542384  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:36.542688  346092 buildroot.go:166] provisioning hostname "ha-349588"

	I0803 23:48:36.542739  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:36.542966  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.545919  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.546337  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.546368  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.546552  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.546755  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.546913  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.547066  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.547213  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.547411  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.547426  346092 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-349588 && echo "ha-349588" | sudo tee /etc/hostname

	I0803 23:48:36.660783  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-349588

	I0803 23:48:36.660811  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.663757  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.664197  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.664222  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.664426  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.664653  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.664851  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.664993  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.665167  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.665347  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.665362  346092 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-349588' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-349588/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-349588' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:48:36.771045  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:48:36.771076  346092 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:48:36.771125  346092 buildroot.go:174] setting up certificates

	I0803 23:48:36.771143  346092 provision.go:84] configureAuth start

	I0803 23:48:36.771157  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:36.771474  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:36.774122  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.774504  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.774536  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.774645  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.776986  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.777284  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.777333  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.777497  346092 provision.go:143] copyHostCerts

	I0803 23:48:36.777544  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:48:36.777581  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem, removing ...

	I0803 23:48:36.777591  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:48:36.777659  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:48:36.777742  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:48:36.777760  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem, removing ...

	I0803 23:48:36.777766  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:48:36.777790  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:48:36.777832  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:48:36.777848  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem, removing ...

	I0803 23:48:36.777854  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:48:36.777874  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:48:36.777921  346092 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.ha-349588 san=[127.0.0.1 192.168.39.168 ha-349588 localhost minikube]

	I0803 23:48:36.891183  346092 provision.go:177] copyRemoteCerts

	I0803 23:48:36.891251  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:48:36.891279  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.894188  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.894510  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.894544  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.894727  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.894957  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.895157  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.895313  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:36.978456  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0803 23:48:36.978533  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:48:37.004096  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0803 23:48:37.004172  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0803 23:48:37.028761  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0803 23:48:37.028864  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0803 23:48:37.053090  346092 provision.go:87] duration metric: took 281.906542ms to configureAuth

	I0803 23:48:37.053131  346092 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:48:37.053320  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:48:37.053406  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.056081  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.056541  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.056567  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.056725  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.056959  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.057168  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.057334  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.057499  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:37.057703  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:37.057719  346092 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:48:37.329708  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:48:37.329744  346092 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:48:37.329755  346092 main.go:141] libmachine: (ha-349588) Calling .GetURL

	I0803 23:48:37.331027  346092 main.go:141] libmachine: (ha-349588) DBG | Using libvirt version 6000000

	I0803 23:48:37.333248  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.333780  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.333808  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.333977  346092 main.go:141] libmachine: Docker is up and running!

	I0803 23:48:37.333999  346092 main.go:141] libmachine: Reticulating splines...

	I0803 23:48:37.334010  346092 client.go:171] duration metric: took 27.821945455s to LocalClient.Create

	I0803 23:48:37.334044  346092 start.go:167] duration metric: took 27.822025189s to libmachine.API.Create "ha-349588"

	I0803 23:48:37.334056  346092 start.go:293] postStartSetup for "ha-349588" (driver="kvm2")

	I0803 23:48:37.334065  346092 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:48:37.334081  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.334393  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:48:37.334417  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.336642  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.336927  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.336953  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.337119  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.337290  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.337446  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.337616  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:37.416116  346092 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:48:37.420420  346092 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:48:37.420451  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:48:37.420522  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:48:37.420630  346092 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> 3310972.pem in /etc/ssl/certs

	I0803 23:48:37.420645  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /etc/ssl/certs/3310972.pem

	I0803 23:48:37.420778  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0803 23:48:37.430694  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:48:37.459257  346092 start.go:296] duration metric: took 125.186102ms for postStartSetup

	I0803 23:48:37.459317  346092 main.go:141] libmachine: (ha-349588) Calling .GetConfigRaw

	I0803 23:48:37.459978  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:37.463817  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.464170  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.464194  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.464482  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:48:37.464696  346092 start.go:128] duration metric: took 27.971861416s to createHost

	I0803 23:48:37.464731  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.466929  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.467283  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.467311  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.467442  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.467641  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.467814  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.467939  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.468075  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:37.468271  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:37.468281  346092 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0803 23:48:37.566205  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722728917.546761844

	I0803 23:48:37.566231  346092 fix.go:216] guest clock: 1722728917.546761844

	I0803 23:48:37.566238  346092 fix.go:229] Guest: 2024-08-03 23:48:37.546761844 +0000 UTC Remote: 2024-08-03 23:48:37.464710805 +0000 UTC m=+28.082129480 (delta=82.051039ms)

	I0803 23:48:37.566259  346092 fix.go:200] guest clock delta is within tolerance: 82.051039ms

	I0803 23:48:37.566264  346092 start.go:83] releasing machines lock for "ha-349588", held for 28.07350849s

	I0803 23:48:37.566282  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.566552  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:37.569332  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.569715  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.569744  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.569912  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.570398  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.570564  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.570663  346092 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:48:37.570703  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.570820  346092 ssh_runner.go:195] Run: cat /version.json

	I0803 23:48:37.570846  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.573409  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.573687  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.573810  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.573834  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.573988  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.574087  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.574132  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.574275  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.574307  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.574464  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.574495  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.574606  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.574618  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:37.574770  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:37.668834  346092 ssh_runner.go:195] Run: systemctl --version

	I0803 23:48:37.675150  346092 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:48:37.834421  346092 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:48:37.840819  346092 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:48:37.840914  346092 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:48:37.857582  346092 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:48:37.857616  346092 start.go:495] detecting cgroup driver to use...

	I0803 23:48:37.857725  346092 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:48:37.875286  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:48:37.891205  346092 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:48:37.891287  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:48:37.906903  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:48:37.922814  346092 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:48:38.040844  346092 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:48:38.187910  346092 docker.go:233] disabling docker service ...

	I0803 23:48:38.187983  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:48:38.203041  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:48:38.216953  346092 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:48:38.356540  346092 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:48:38.471367  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:48:38.485586  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:48:38.504903  346092 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:48:38.504998  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.515915  346092 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:48:38.515993  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.527084  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.538078  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.549280  346092 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:48:38.560636  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.571734  346092 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.589785  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.600819  346092 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:48:38.610949  346092 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:48:38.611026  346092 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:48:38.624934  346092 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:48:38.635005  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:48:38.748298  346092 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:48:38.887792  346092 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:48:38.887892  346092 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:48:38.892998  346092 start.go:563] Will wait 60s for crictl version

	I0803 23:48:38.893081  346092 ssh_runner.go:195] Run: which crictl

	I0803 23:48:38.897088  346092 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:48:38.935449  346092 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:48:38.935539  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:48:38.965015  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:48:38.995381  346092 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:48:38.996902  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:38.999775  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:39.000151  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:39.000175  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:39.000430  346092 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:48:39.004744  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:48:39.019060  346092 kubeadm.go:883] updating cluster {Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cl

usterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0803 23:48:39.019244  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:48:39.019542  346092 ssh_runner.go:195] Run: sudo crictl images --output json

	I0803 23:48:39.058144  346092 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.3". assuming images are not preloaded.

	I0803 23:48:39.058231  346092 ssh_runner.go:195] Run: which lz4

	I0803 23:48:39.062491  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0803 23:48:39.062602  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0803 23:48:39.066958  346092 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0803 23:48:39.067007  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (406200976 bytes)

	I0803 23:48:40.528763  346092 crio.go:462] duration metric: took 1.466185715s to copy over tarball

	I0803 23:48:40.528870  346092 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0803 23:48:42.691815  346092 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.162903819s)

	I0803 23:48:42.691850  346092 crio.go:469] duration metric: took 2.163033059s to extract the tarball

	I0803 23:48:42.691861  346092 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0803 23:48:42.730485  346092 ssh_runner.go:195] Run: sudo crictl images --output json

	I0803 23:48:42.778939  346092 crio.go:514] all images are preloaded for cri-o runtime.

	I0803 23:48:42.778965  346092 cache_images.go:84] Images are preloaded, skipping loading

	I0803 23:48:42.778978  346092 kubeadm.go:934] updating node { 192.168.39.168 8443 v1.30.3 crio true true} ...

	I0803 23:48:42.779117  346092 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-349588 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.168

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:48:42.779205  346092 ssh_runner.go:195] Run: crio config

	I0803 23:48:42.828670  346092 cni.go:84] Creating CNI manager for ""

	I0803 23:48:42.828702  346092 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0803 23:48:42.828719  346092 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0803 23:48:42.828744  346092 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.168 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-349588 NodeName:ha-349588 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.168"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.168 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0803 23:48:42.828899  346092 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.168

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-349588"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.168

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.168"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0803 23:48:42.828929  346092 kube-vip.go:115] generating kube-vip config ...

	I0803 23:48:42.828978  346092 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0803 23:48:42.847620  346092 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0803 23:48:42.847740  346092 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0803 23:48:42.847794  346092 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:48:42.858826  346092 binaries.go:44] Found k8s binaries, skipping transfer

	I0803 23:48:42.858911  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0803 23:48:42.869873  346092 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0803 23:48:42.888649  346092 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:48:42.906568  346092 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0803 23:48:42.924948  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0803 23:48:42.942182  346092 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0803 23:48:42.946393  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:48:42.959877  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:48:43.090573  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:48:43.109673  346092 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588 for IP: 192.168.39.168

	I0803 23:48:43.109707  346092 certs.go:194] generating shared ca certs ...

	I0803 23:48:43.109736  346092 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.109935  346092 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:48:43.109995  346092 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:48:43.110016  346092 certs.go:256] generating profile certs ...

	I0803 23:48:43.110095  346092 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key

	I0803 23:48:43.110115  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt with IP's: []

	I0803 23:48:43.176202  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt ...

	I0803 23:48:43.176243  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt: {Name:mk8846af52ab7192f012806995ca5756c43d9aa4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.176414  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key ...

	I0803 23:48:43.176426  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key: {Name:mk3c59388753fea20f89d92bf03bdfc970c14c5e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.176505  346092 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad

	I0803 23:48:43.176520  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.168 192.168.39.254]

	I0803 23:48:43.323353  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad ...

	I0803 23:48:43.323387  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad: {Name:mk8daf6ee6cbba709dc68563d6432752e9aeecab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.323547  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad ...

	I0803 23:48:43.323560  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad: {Name:mkbb0f47da156ebcc5042f70a6f380500f1cb64c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.323633  346092 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt

	I0803 23:48:43.323725  346092 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key

	I0803 23:48:43.323784  346092 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key

	I0803 23:48:43.323798  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt with IP's: []

	I0803 23:48:43.488751  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt ...

	I0803 23:48:43.488786  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt: {Name:mk0d9fb306df1ed4b7eeba1f21c32111bb96f6c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.488947  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key ...

	I0803 23:48:43.488958  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key: {Name:mkb23eaf410419e953894e823db49217d4b5f172 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.489031  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0803 23:48:43.489065  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0803 23:48:43.489088  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0803 23:48:43.489102  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0803 23:48:43.489116  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0803 23:48:43.489130  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0803 23:48:43.489142  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0803 23:48:43.489155  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0803 23:48:43.489236  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem (1338 bytes)

	W0803 23:48:43.489273  346092 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097_empty.pem, impossibly tiny 0 bytes

	I0803 23:48:43.489282  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:48:43.489304  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:48:43.489326  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:48:43.489346  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:48:43.489382  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:48:43.489420  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem -> /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.489441  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.489453  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.490082  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:48:43.517725  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:48:43.543526  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:48:43.568742  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:48:43.594201  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0803 23:48:43.620048  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0803 23:48:43.644985  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:48:43.677146  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0803 23:48:43.703176  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem --> /usr/share/ca-certificates/331097.pem (1338 bytes)

	I0803 23:48:43.727682  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /usr/share/ca-certificates/3310972.pem (1708 bytes)

	I0803 23:48:43.752318  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:48:43.777458  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0803 23:48:43.794903  346092 ssh_runner.go:195] Run: openssl version

	I0803 23:48:43.801030  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/331097.pem && ln -fs /usr/share/ca-certificates/331097.pem /etc/ssl/certs/331097.pem"

	I0803 23:48:43.812834  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.817558  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  3 23:44 /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.817619  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.823759  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/331097.pem /etc/ssl/certs/51391683.0"

	I0803 23:48:43.834807  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3310972.pem && ln -fs /usr/share/ca-certificates/3310972.pem /etc/ssl/certs/3310972.pem"

	I0803 23:48:43.845824  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.850583  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  3 23:44 /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.850645  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.856639  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3310972.pem /etc/ssl/certs/3ec20f2e.0"

	I0803 23:48:43.868327  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:48:43.880525  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.885320  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.885395  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.891760  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:48:43.906642  346092 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:48:43.916110  346092 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:48:43.916210  346092 kubeadm.go:392] StartCluster: {Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Clust

erName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:48:43.916326  346092 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0803 23:48:43.916400  346092 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0803 23:48:43.980609  346092 cri.go:89] found id: ""

	I0803 23:48:43.980701  346092 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0803 23:48:43.996519  346092 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0803 23:48:44.010446  346092 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0803 23:48:44.024303  346092 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0803 23:48:44.024325  346092 kubeadm.go:157] found existing configuration files:

	I0803 23:48:44.024387  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0803 23:48:44.034689  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0803 23:48:44.034769  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0803 23:48:44.045767  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0803 23:48:44.056709  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0803 23:48:44.056781  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0803 23:48:44.067638  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0803 23:48:44.077701  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0803 23:48:44.077809  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0803 23:48:44.088461  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0803 23:48:44.098545  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0803 23:48:44.098609  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0803 23:48:44.109113  346092 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0803 23:48:44.215580  346092 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3

	I0803 23:48:44.215831  346092 kubeadm.go:310] [preflight] Running pre-flight checks

	I0803 23:48:44.347666  346092 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0803 23:48:44.347842  346092 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0803 23:48:44.348003  346092 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0803 23:48:44.559912  346092 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0803 23:48:44.623290  346092 out.go:204]   - Generating certificates and keys ...

	I0803 23:48:44.623399  346092 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0803 23:48:44.623498  346092 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0803 23:48:44.677872  346092 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0803 23:48:45.161412  346092 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0803 23:48:45.359698  346092 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0803 23:48:45.509093  346092 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0803 23:48:45.735838  346092 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0803 23:48:45.736073  346092 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-349588 localhost] and IPs [192.168.39.168 127.0.0.1 ::1]

	I0803 23:48:45.868983  346092 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0803 23:48:45.869145  346092 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-349588 localhost] and IPs [192.168.39.168 127.0.0.1 ::1]

	I0803 23:48:45.939849  346092 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0803 23:48:46.488546  346092 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0803 23:48:46.609445  346092 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0803 23:48:46.609584  346092 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0803 23:48:46.913292  346092 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0803 23:48:47.075011  346092 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0803 23:48:47.280716  346092 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0803 23:48:47.381369  346092 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0803 23:48:47.425104  346092 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0803 23:48:47.425771  346092 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0803 23:48:47.430790  346092 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0803 23:48:47.432462  346092 out.go:204]   - Booting up control plane ...

	I0803 23:48:47.432572  346092 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0803 23:48:47.432670  346092 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0803 23:48:47.432761  346092 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0803 23:48:47.451505  346092 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0803 23:48:47.452518  346092 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0803 23:48:47.452610  346092 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0803 23:48:47.581671  346092 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0803 23:48:47.581778  346092 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0803 23:48:48.582643  346092 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001457349s

	I0803 23:48:48.582750  346092 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0803 23:48:54.290536  346092 kubeadm.go:310] [api-check] The API server is healthy after 5.710287165s

	I0803 23:48:54.303491  346092 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0803 23:48:54.323699  346092 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0803 23:48:54.354226  346092 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0803 23:48:54.354458  346092 kubeadm.go:310] [mark-control-plane] Marking the node ha-349588 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0803 23:48:54.369768  346092 kubeadm.go:310] [bootstrap-token] Using token: vmd729.4ijgfu3uo5k2v1gw

	I0803 23:48:54.371222  346092 out.go:204]   - Configuring RBAC rules ...

	I0803 23:48:54.371383  346092 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0803 23:48:54.384821  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0803 23:48:54.400057  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0803 23:48:54.403731  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0803 23:48:54.408140  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0803 23:48:54.416162  346092 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0803 23:48:54.701480  346092 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0803 23:48:55.157420  346092 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0803 23:48:55.698866  346092 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0803 23:48:55.698893  346092 kubeadm.go:310] 

	I0803 23:48:55.699005  346092 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0803 23:48:55.699032  346092 kubeadm.go:310] 

	I0803 23:48:55.699132  346092 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0803 23:48:55.699142  346092 kubeadm.go:310] 

	I0803 23:48:55.699181  346092 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0803 23:48:55.699255  346092 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0803 23:48:55.699320  346092 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0803 23:48:55.699330  346092 kubeadm.go:310] 

	I0803 23:48:55.699410  346092 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0803 23:48:55.699418  346092 kubeadm.go:310] 

	I0803 23:48:55.699495  346092 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0803 23:48:55.699514  346092 kubeadm.go:310] 

	I0803 23:48:55.699557  346092 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0803 23:48:55.699622  346092 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0803 23:48:55.699684  346092 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0803 23:48:55.699690  346092 kubeadm.go:310] 

	I0803 23:48:55.699764  346092 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0803 23:48:55.699833  346092 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0803 23:48:55.699839  346092 kubeadm.go:310] 

	I0803 23:48:55.699954  346092 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token vmd729.4ijgfu3uo5k2v1gw \

	I0803 23:48:55.700069  346092 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c \

	I0803 23:48:55.700090  346092 kubeadm.go:310] 	--control-plane 

	I0803 23:48:55.700094  346092 kubeadm.go:310] 

	I0803 23:48:55.700168  346092 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0803 23:48:55.700181  346092 kubeadm.go:310] 

	I0803 23:48:55.700261  346092 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token vmd729.4ijgfu3uo5k2v1gw \

	I0803 23:48:55.700368  346092 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c 

	I0803 23:48:55.701070  346092 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0803 23:48:55.701096  346092 cni.go:84] Creating CNI manager for ""

	I0803 23:48:55.701103  346092 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0803 23:48:55.702841  346092 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0803 23:48:55.704052  346092 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0803 23:48:55.709875  346092 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...

	I0803 23:48:55.709897  346092 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0803 23:48:55.735301  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0803 23:48:56.119562  346092 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0803 23:48:56.119694  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-349588 minikube.k8s.io/updated_at=2024_08_03T23_48_56_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=ha-349588 minikube.k8s.io/primary=true

	I0803 23:48:56.119699  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:56.147094  346092 ops.go:34] apiserver oom_adj: -16

	I0803 23:48:56.339836  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:56.840689  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:57.339892  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:57.840550  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:58.340862  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:58.840451  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:59.339991  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:59.840655  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:00.340322  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:00.840255  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:01.340913  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:01.840915  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:02.340929  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:02.840491  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:03.339993  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:03.840488  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:04.340852  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:04.840324  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:05.339902  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:05.840734  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:06.339995  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:06.840443  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:07.340744  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:07.840499  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:07.945567  346092 kubeadm.go:1113] duration metric: took 11.825936372s to wait for elevateKubeSystemPrivileges

	I0803 23:49:07.945620  346092 kubeadm.go:394] duration metric: took 24.029418072s to StartCluster

	I0803 23:49:07.945649  346092 settings.go:142] acquiring lock: {Name:mk918fd72253bf33e8bae308fd36ed8b1c353763 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:07.945731  346092 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:49:07.946576  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/kubeconfig: {Name:mkd789cdd11c6330d283dbc76129ed198eb15398 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:07.946821  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0803 23:49:07.946833  346092 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:49:07.946857  346092 start.go:241] waiting for startup goroutines ...

	I0803 23:49:07.946870  346092 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0803 23:49:07.946934  346092 addons.go:69] Setting storage-provisioner=true in profile "ha-349588"

	I0803 23:49:07.946952  346092 addons.go:69] Setting default-storageclass=true in profile "ha-349588"

	I0803 23:49:07.946967  346092 addons.go:234] Setting addon storage-provisioner=true in "ha-349588"

	I0803 23:49:07.946981  346092 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-349588"

	I0803 23:49:07.946996  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:07.947103  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:07.947486  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.947486  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.947519  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.947532  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.963361  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36977

	I0803 23:49:07.963699  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33815

	I0803 23:49:07.963950  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.964258  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.964486  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.964506  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.964822  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.964843  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.964892  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.965113  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:07.965322  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.965886  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.965916  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.967448  346092 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:49:07.967821  346092 kapi.go:59] client config for ha-349588: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt", KeyFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key", CAFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02f40), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0803 23:49:07.968419  346092 cert_rotation.go:137] Starting client certificate rotation controller

	I0803 23:49:07.968706  346092 addons.go:234] Setting addon default-storageclass=true in "ha-349588"

	I0803 23:49:07.968758  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:07.969038  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.969082  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.981268  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43065

	I0803 23:49:07.981760  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.982406  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.982449  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.982806  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.983026  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:07.984863  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:07.984975  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43115

	I0803 23:49:07.985529  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.986001  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.986021  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.986315  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.986782  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.986817  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.986999  346092 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0803 23:49:07.988373  346092 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0803 23:49:07.988390  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0803 23:49:07.988406  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:07.991634  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:07.992145  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:07.992175  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:07.992401  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:07.992624  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:07.992802  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:07.992977  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:08.004028  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41705

	I0803 23:49:08.004521  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:08.004986  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:08.005008  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:08.005356  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:08.005562  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:08.007175  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:08.007434  346092 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0803 23:49:08.007453  346092 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0803 23:49:08.007479  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:08.010032  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:08.010474  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:08.010504  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:08.010667  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:08.010853  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:08.011029  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:08.011165  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:08.072504  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0803 23:49:08.190173  346092 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0803 23:49:08.206987  346092 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0803 23:49:08.632401  346092 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0803 23:49:09.027910  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.027947  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.027987  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.028010  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.028254  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028269  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028278  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.028285  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.028315  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028333  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028343  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.028350  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.028534  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028546  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028690  346092 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0803 23:49:09.028698  346092 round_trippers.go:469] Request Headers:

	I0803 23:49:09.028710  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:49:09.028714  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:49:09.028850  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028876  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028916  346092 main.go:141] libmachine: (ha-349588) DBG | Closing plugin on server side

	I0803 23:49:09.058640  346092 round_trippers.go:574] Response Status: 200 OK in 29 milliseconds

	I0803 23:49:09.059232  346092 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0803 23:49:09.059248  346092 round_trippers.go:469] Request Headers:

	I0803 23:49:09.059257  346092 round_trippers.go:473]     Content-Type: application/json

	I0803 23:49:09.059262  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:49:09.059267  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:49:09.065033  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:49:09.065333  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.065358  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.065669  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.065690  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.067539  346092 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0803 23:49:09.068807  346092 addons.go:510] duration metric: took 1.121931039s for enable addons: enabled=[storage-provisioner default-storageclass]

	I0803 23:49:09.068867  346092 start.go:246] waiting for cluster config update ...

	I0803 23:49:09.068886  346092 start.go:255] writing updated cluster config ...

	I0803 23:49:09.070612  346092 out.go:177] 

	I0803 23:49:09.072304  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:09.072402  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:49:09.074300  346092 out.go:177] * Starting "ha-349588-m02" control-plane node in "ha-349588" cluster

	I0803 23:49:09.075715  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:49:09.075749  346092 cache.go:56] Caching tarball of preloaded images

	I0803 23:49:09.075867  346092 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:49:09.075882  346092 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:49:09.075999  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:49:09.076295  346092 start.go:360] acquireMachinesLock for ha-349588-m02: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:49:09.076362  346092 start.go:364] duration metric: took 35.831µs to acquireMachinesLock for "ha-349588-m02"

	I0803 23:49:09.076384  346092 start.go:93] Provisioning new machine with config: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:49:09.076493  346092 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0803 23:49:09.079072  346092 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0803 23:49:09.079194  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:09.079228  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:09.095204  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33787

	I0803 23:49:09.095749  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:09.096322  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:09.096359  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:09.096849  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:09.097061  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:09.097232  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:09.097411  346092 start.go:159] libmachine.API.Create for "ha-349588" (driver="kvm2")

	I0803 23:49:09.097439  346092 client.go:168] LocalClient.Create starting

	I0803 23:49:09.097476  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:49:09.097545  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:49:09.097588  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:49:09.097649  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:49:09.097670  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:49:09.097681  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:49:09.097699  346092 main.go:141] libmachine: Running pre-create checks...

	I0803 23:49:09.097715  346092 main.go:141] libmachine: (ha-349588-m02) Calling .PreCreateCheck

	I0803 23:49:09.097887  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetConfigRaw

	I0803 23:49:09.098333  346092 main.go:141] libmachine: Creating machine...

	I0803 23:49:09.098349  346092 main.go:141] libmachine: (ha-349588-m02) Calling .Create

	I0803 23:49:09.098480  346092 main.go:141] libmachine: (ha-349588-m02) Creating KVM machine...

	I0803 23:49:09.099793  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found existing default KVM network

	I0803 23:49:09.099966  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found existing private KVM network mk-ha-349588

	I0803 23:49:09.100121  346092 main.go:141] libmachine: (ha-349588-m02) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02 ...

	I0803 23:49:09.100150  346092 main.go:141] libmachine: (ha-349588-m02) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:49:09.100241  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.100120  346511 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:49:09.100390  346092 main.go:141] libmachine: (ha-349588-m02) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:49:09.392884  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.392736  346511 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa...

	I0803 23:49:09.506019  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.505833  346511 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/ha-349588-m02.rawdisk...

	I0803 23:49:09.506078  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Writing magic tar header

	I0803 23:49:09.506097  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Writing SSH key tar header

	I0803 23:49:09.506110  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.505972  346511 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02 ...

	I0803 23:49:09.506140  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02

	I0803 23:49:09.506180  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:49:09.506197  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02 (perms=drwx------)

	I0803 23:49:09.506214  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:49:09.506255  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:49:09.506271  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:49:09.506284  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:49:09.506299  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:49:09.506311  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:49:09.506322  346092 main.go:141] libmachine: (ha-349588-m02) Creating domain...

	I0803 23:49:09.506337  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:49:09.506348  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:49:09.506358  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:49:09.506369  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home

	I0803 23:49:09.506379  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Skipping /home - not owner

	I0803 23:49:09.507461  346092 main.go:141] libmachine: (ha-349588-m02) define libvirt domain using xml: 

	I0803 23:49:09.507488  346092 main.go:141] libmachine: (ha-349588-m02) <domain type='kvm'>

	I0803 23:49:09.507498  346092 main.go:141] libmachine: (ha-349588-m02)   <name>ha-349588-m02</name>

	I0803 23:49:09.507513  346092 main.go:141] libmachine: (ha-349588-m02)   <memory unit='MiB'>2200</memory>

	I0803 23:49:09.507523  346092 main.go:141] libmachine: (ha-349588-m02)   <vcpu>2</vcpu>

	I0803 23:49:09.507530  346092 main.go:141] libmachine: (ha-349588-m02)   <features>

	I0803 23:49:09.507539  346092 main.go:141] libmachine: (ha-349588-m02)     <acpi/>

	I0803 23:49:09.507547  346092 main.go:141] libmachine: (ha-349588-m02)     <apic/>

	I0803 23:49:09.507555  346092 main.go:141] libmachine: (ha-349588-m02)     <pae/>

	I0803 23:49:09.507564  346092 main.go:141] libmachine: (ha-349588-m02)     

	I0803 23:49:09.507572  346092 main.go:141] libmachine: (ha-349588-m02)   </features>

	I0803 23:49:09.507586  346092 main.go:141] libmachine: (ha-349588-m02)   <cpu mode='host-passthrough'>

	I0803 23:49:09.507596  346092 main.go:141] libmachine: (ha-349588-m02)   

	I0803 23:49:09.507604  346092 main.go:141] libmachine: (ha-349588-m02)   </cpu>

	I0803 23:49:09.507615  346092 main.go:141] libmachine: (ha-349588-m02)   <os>

	I0803 23:49:09.507625  346092 main.go:141] libmachine: (ha-349588-m02)     <type>hvm</type>

	I0803 23:49:09.507633  346092 main.go:141] libmachine: (ha-349588-m02)     <boot dev='cdrom'/>

	I0803 23:49:09.507643  346092 main.go:141] libmachine: (ha-349588-m02)     <boot dev='hd'/>

	I0803 23:49:09.507655  346092 main.go:141] libmachine: (ha-349588-m02)     <bootmenu enable='no'/>

	I0803 23:49:09.507688  346092 main.go:141] libmachine: (ha-349588-m02)   </os>

	I0803 23:49:09.507701  346092 main.go:141] libmachine: (ha-349588-m02)   <devices>

	I0803 23:49:09.507709  346092 main.go:141] libmachine: (ha-349588-m02)     <disk type='file' device='cdrom'>

	I0803 23:49:09.507752  346092 main.go:141] libmachine: (ha-349588-m02)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/boot2docker.iso'/>

	I0803 23:49:09.507779  346092 main.go:141] libmachine: (ha-349588-m02)       <target dev='hdc' bus='scsi'/>

	I0803 23:49:09.507793  346092 main.go:141] libmachine: (ha-349588-m02)       <readonly/>

	I0803 23:49:09.507804  346092 main.go:141] libmachine: (ha-349588-m02)     </disk>

	I0803 23:49:09.507816  346092 main.go:141] libmachine: (ha-349588-m02)     <disk type='file' device='disk'>

	I0803 23:49:09.507829  346092 main.go:141] libmachine: (ha-349588-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:49:09.507845  346092 main.go:141] libmachine: (ha-349588-m02)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/ha-349588-m02.rawdisk'/>

	I0803 23:49:09.507856  346092 main.go:141] libmachine: (ha-349588-m02)       <target dev='hda' bus='virtio'/>

	I0803 23:49:09.507867  346092 main.go:141] libmachine: (ha-349588-m02)     </disk>

	I0803 23:49:09.507877  346092 main.go:141] libmachine: (ha-349588-m02)     <interface type='network'>

	I0803 23:49:09.507891  346092 main.go:141] libmachine: (ha-349588-m02)       <source network='mk-ha-349588'/>

	I0803 23:49:09.507916  346092 main.go:141] libmachine: (ha-349588-m02)       <model type='virtio'/>

	I0803 23:49:09.507946  346092 main.go:141] libmachine: (ha-349588-m02)     </interface>

	I0803 23:49:09.507967  346092 main.go:141] libmachine: (ha-349588-m02)     <interface type='network'>

	I0803 23:49:09.507982  346092 main.go:141] libmachine: (ha-349588-m02)       <source network='default'/>

	I0803 23:49:09.507992  346092 main.go:141] libmachine: (ha-349588-m02)       <model type='virtio'/>

	I0803 23:49:09.508003  346092 main.go:141] libmachine: (ha-349588-m02)     </interface>

	I0803 23:49:09.508013  346092 main.go:141] libmachine: (ha-349588-m02)     <serial type='pty'>

	I0803 23:49:09.508026  346092 main.go:141] libmachine: (ha-349588-m02)       <target port='0'/>

	I0803 23:49:09.508041  346092 main.go:141] libmachine: (ha-349588-m02)     </serial>

	I0803 23:49:09.508068  346092 main.go:141] libmachine: (ha-349588-m02)     <console type='pty'>

	I0803 23:49:09.508087  346092 main.go:141] libmachine: (ha-349588-m02)       <target type='serial' port='0'/>

	I0803 23:49:09.508100  346092 main.go:141] libmachine: (ha-349588-m02)     </console>

	I0803 23:49:09.508108  346092 main.go:141] libmachine: (ha-349588-m02)     <rng model='virtio'>

	I0803 23:49:09.508122  346092 main.go:141] libmachine: (ha-349588-m02)       <backend model='random'>/dev/random</backend>

	I0803 23:49:09.508132  346092 main.go:141] libmachine: (ha-349588-m02)     </rng>

	I0803 23:49:09.508140  346092 main.go:141] libmachine: (ha-349588-m02)     

	I0803 23:49:09.508149  346092 main.go:141] libmachine: (ha-349588-m02)     

	I0803 23:49:09.508162  346092 main.go:141] libmachine: (ha-349588-m02)   </devices>

	I0803 23:49:09.508174  346092 main.go:141] libmachine: (ha-349588-m02) </domain>

	I0803 23:49:09.508186  346092 main.go:141] libmachine: (ha-349588-m02) 

	I0803 23:49:09.515269  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:7a:63:bd in network default

	I0803 23:49:09.515943  346092 main.go:141] libmachine: (ha-349588-m02) Ensuring networks are active...

	I0803 23:49:09.515967  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:09.516868  346092 main.go:141] libmachine: (ha-349588-m02) Ensuring network default is active

	I0803 23:49:09.517308  346092 main.go:141] libmachine: (ha-349588-m02) Ensuring network mk-ha-349588 is active

	I0803 23:49:09.517724  346092 main.go:141] libmachine: (ha-349588-m02) Getting domain xml...

	I0803 23:49:09.518644  346092 main.go:141] libmachine: (ha-349588-m02) Creating domain...

	I0803 23:49:10.755347  346092 main.go:141] libmachine: (ha-349588-m02) Waiting to get IP...

	I0803 23:49:10.756208  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:10.756617  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:10.756647  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:10.756592  346511 retry.go:31] will retry after 196.457708ms: waiting for machine to come up

	I0803 23:49:10.955123  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:10.955579  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:10.955605  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:10.955538  346511 retry.go:31] will retry after 314.513004ms: waiting for machine to come up

	I0803 23:49:11.272300  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:11.272803  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:11.272840  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:11.272737  346511 retry.go:31] will retry after 311.291518ms: waiting for machine to come up

	I0803 23:49:11.585254  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:11.585799  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:11.585830  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:11.585723  346511 retry.go:31] will retry after 523.229806ms: waiting for machine to come up

	I0803 23:49:12.110649  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:12.111090  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:12.111117  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:12.111031  346511 retry.go:31] will retry after 594.349932ms: waiting for machine to come up

	I0803 23:49:12.706604  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:12.707015  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:12.707046  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:12.706950  346511 retry.go:31] will retry after 579.421708ms: waiting for machine to come up

	I0803 23:49:13.287722  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:13.288146  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:13.288173  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:13.288098  346511 retry.go:31] will retry after 832.78526ms: waiting for machine to come up

	I0803 23:49:14.122636  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:14.123072  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:14.123097  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:14.123032  346511 retry.go:31] will retry after 1.40942689s: waiting for machine to come up

	I0803 23:49:15.534952  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:15.535443  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:15.535483  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:15.535391  346511 retry.go:31] will retry after 1.773682348s: waiting for machine to come up

	I0803 23:49:17.310303  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:17.310693  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:17.310720  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:17.310649  346511 retry.go:31] will retry after 2.230324158s: waiting for machine to come up

	I0803 23:49:19.542820  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:19.543326  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:19.543357  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:19.543274  346511 retry.go:31] will retry after 2.161656606s: waiting for machine to come up

	I0803 23:49:21.706940  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:21.707447  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:21.707472  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:21.707412  346511 retry.go:31] will retry after 2.578584432s: waiting for machine to come up

	I0803 23:49:24.287397  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:24.287819  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:24.287849  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:24.287767  346511 retry.go:31] will retry after 3.341759682s: waiting for machine to come up

	I0803 23:49:27.633275  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:27.633768  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:27.634003  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:27.633715  346511 retry.go:31] will retry after 4.956950166s: waiting for machine to come up

	I0803 23:49:32.592015  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.592451  346092 main.go:141] libmachine: (ha-349588-m02) Found IP for machine: 192.168.39.67

	I0803 23:49:32.592471  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has current primary IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.592477  346092 main.go:141] libmachine: (ha-349588-m02) Reserving static IP address...

	I0803 23:49:32.592850  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find host DHCP lease matching {name: "ha-349588-m02", mac: "52:54:00:c5:a2:30", ip: "192.168.39.67"} in network mk-ha-349588

	I0803 23:49:32.671097  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Getting to WaitForSSH function...

	I0803 23:49:32.671127  346092 main.go:141] libmachine: (ha-349588-m02) Reserved static IP address: 192.168.39.67

	I0803 23:49:32.671140  346092 main.go:141] libmachine: (ha-349588-m02) Waiting for SSH to be available...

	I0803 23:49:32.674109  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.674564  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:32.674591  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.674755  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Using SSH client type: external

	I0803 23:49:32.674775  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa (-rw-------)

	I0803 23:49:32.674832  346092 main.go:141] libmachine: (ha-349588-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.67 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:49:32.674867  346092 main.go:141] libmachine: (ha-349588-m02) DBG | About to run SSH command:

	I0803 23:49:32.674884  346092 main.go:141] libmachine: (ha-349588-m02) DBG | exit 0

	I0803 23:49:32.797788  346092 main.go:141] libmachine: (ha-349588-m02) DBG | SSH cmd err, output: <nil>: 

	I0803 23:49:32.798082  346092 main.go:141] libmachine: (ha-349588-m02) KVM machine creation complete!

	I0803 23:49:32.798388  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetConfigRaw

	I0803 23:49:32.798971  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:32.799188  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:32.799417  346092 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:49:32.799435  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:49:32.800912  346092 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:49:32.800962  346092 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:49:32.800974  346092 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:49:32.800983  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:32.803140  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.803577  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:32.803607  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.803746  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:32.803953  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.804142  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.804329  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:32.804496  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:32.804723  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:32.804734  346092 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:49:32.905099  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:49:32.905127  346092 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:49:32.905135  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:32.908228  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.908609  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:32.908632  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.908801  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:32.909041  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.909218  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.909340  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:32.909571  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:32.909828  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:32.909842  346092 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:49:33.015154  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:49:33.015233  346092 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:49:33.015243  346092 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:49:33.015251  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:33.015518  346092 buildroot.go:166] provisioning hostname "ha-349588-m02"

	I0803 23:49:33.015547  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:33.015814  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.018501  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.018958  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.018992  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.019139  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.019322  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.019503  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.019644  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.019793  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:33.019965  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:33.019979  346092 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-349588-m02 && echo "ha-349588-m02" | sudo tee /etc/hostname

	I0803 23:49:33.137434  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-349588-m02

	I0803 23:49:33.137463  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.140293  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.140675  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.140702  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.140906  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.141108  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.141288  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.141456  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.141647  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:33.141861  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:33.141889  346092 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-349588-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-349588-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-349588-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:49:33.255392  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:49:33.255436  346092 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:49:33.255459  346092 buildroot.go:174] setting up certificates

	I0803 23:49:33.255472  346092 provision.go:84] configureAuth start

	I0803 23:49:33.255487  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:33.255787  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:33.258331  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.258649  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.258678  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.258872  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.260786  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.261093  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.261133  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.261245  346092 provision.go:143] copyHostCerts

	I0803 23:49:33.261291  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:49:33.261335  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem, removing ...

	I0803 23:49:33.261348  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:49:33.261441  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:49:33.261586  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:49:33.261610  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem, removing ...

	I0803 23:49:33.261617  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:49:33.261649  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:49:33.261693  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:49:33.261709  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem, removing ...

	I0803 23:49:33.261715  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:49:33.261736  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:49:33.261796  346092 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.ha-349588-m02 san=[127.0.0.1 192.168.39.67 ha-349588-m02 localhost minikube]

	I0803 23:49:33.513319  346092 provision.go:177] copyRemoteCerts

	I0803 23:49:33.513401  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:49:33.513438  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.516462  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.516819  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.516856  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.517011  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.517238  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.517393  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.517618  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:33.600517  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0803 23:49:33.600605  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:49:33.630035  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0803 23:49:33.630119  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0803 23:49:33.659132  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0803 23:49:33.659199  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0803 23:49:33.693181  346092 provision.go:87] duration metric: took 437.692464ms to configureAuth

	I0803 23:49:33.693210  346092 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:49:33.693426  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:33.693563  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.696446  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.696934  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.696969  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.697212  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.697497  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.697727  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.698031  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.698216  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:33.698403  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:33.698424  346092 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:49:33.959540  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:49:33.959581  346092 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:49:33.959593  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetURL

	I0803 23:49:33.960929  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Using libvirt version 6000000

	I0803 23:49:33.963512  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.963899  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.963929  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.964106  346092 main.go:141] libmachine: Docker is up and running!

	I0803 23:49:33.964121  346092 main.go:141] libmachine: Reticulating splines...

	I0803 23:49:33.964130  346092 client.go:171] duration metric: took 24.866682664s to LocalClient.Create

	I0803 23:49:33.964160  346092 start.go:167] duration metric: took 24.866749901s to libmachine.API.Create "ha-349588"

	I0803 23:49:33.964172  346092 start.go:293] postStartSetup for "ha-349588-m02" (driver="kvm2")

	I0803 23:49:33.964187  346092 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:49:33.964221  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:33.964513  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:49:33.964545  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.966907  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.967233  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.967264  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.967403  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.967604  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.967771  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.967915  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:34.048442  346092 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:49:34.052707  346092 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:49:34.052737  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:49:34.052818  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:49:34.052927  346092 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> 3310972.pem in /etc/ssl/certs

	I0803 23:49:34.052941  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /etc/ssl/certs/3310972.pem

	I0803 23:49:34.053050  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0803 23:49:34.063171  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:49:34.087600  346092 start.go:296] duration metric: took 123.413254ms for postStartSetup

	I0803 23:49:34.087662  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetConfigRaw

	I0803 23:49:34.088269  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:34.091450  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.091855  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.091886  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.092198  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:49:34.092466  346092 start.go:128] duration metric: took 25.015961226s to createHost

	I0803 23:49:34.092491  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:34.094844  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.095181  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.095213  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.095338  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:34.095493  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.095609  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.095704  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:34.095817  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:34.096032  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:34.096044  346092 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0803 23:49:34.198875  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722728974.174689570

	I0803 23:49:34.198914  346092 fix.go:216] guest clock: 1722728974.174689570

	I0803 23:49:34.198924  346092 fix.go:229] Guest: 2024-08-03 23:49:34.17468957 +0000 UTC Remote: 2024-08-03 23:49:34.092479911 +0000 UTC m=+84.709898585 (delta=82.209659ms)

	I0803 23:49:34.198942  346092 fix.go:200] guest clock delta is within tolerance: 82.209659ms

	I0803 23:49:34.198947  346092 start.go:83] releasing machines lock for "ha-349588-m02", held for 25.122576839s

	I0803 23:49:34.198968  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.199261  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:34.202135  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.202517  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.202542  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.204728  346092 out.go:177] * Found network options:

	I0803 23:49:34.206084  346092 out.go:177]   - NO_PROXY=192.168.39.168

	W0803 23:49:34.207413  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:49:34.207457  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.208191  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.208417  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.208530  346092 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:49:34.208577  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	W0803 23:49:34.208720  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:49:34.208822  346092 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:49:34.208847  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:34.211895  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.211921  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.212318  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.212350  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.212374  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.212388  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.212549  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:34.212667  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:34.212745  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.212837  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.212868  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:34.212971  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:34.213014  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:34.213205  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:34.447882  346092 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:49:34.454498  346092 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:49:34.454573  346092 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:49:34.471269  346092 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:49:34.471295  346092 start.go:495] detecting cgroup driver to use...

	I0803 23:49:34.471359  346092 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:49:34.488153  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:49:34.503703  346092 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:49:34.503780  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:49:34.518917  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:49:34.534021  346092 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:49:34.650977  346092 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:49:34.798998  346092 docker.go:233] disabling docker service ...

	I0803 23:49:34.799082  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:49:34.814209  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:49:34.828385  346092 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:49:34.970942  346092 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:49:35.098562  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:49:35.113143  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:49:35.132472  346092 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:49:35.132547  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.143835  346092 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:49:35.143943  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.155440  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.167348  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.178602  346092 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:49:35.190200  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.201259  346092 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.220070  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.231425  346092 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:49:35.241477  346092 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:49:35.241554  346092 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:49:35.255830  346092 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:49:35.265769  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:49:35.386227  346092 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:49:35.520835  346092 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:49:35.520906  346092 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:49:35.526284  346092 start.go:563] Will wait 60s for crictl version

	I0803 23:49:35.526385  346092 ssh_runner.go:195] Run: which crictl

	I0803 23:49:35.530619  346092 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:49:35.572868  346092 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:49:35.572976  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:49:35.602425  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:49:35.633811  346092 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:49:35.634957  346092 out.go:177]   - env NO_PROXY=192.168.39.168

	I0803 23:49:35.636018  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:35.638807  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:35.639117  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:35.639150  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:35.639321  346092 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:49:35.643666  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:49:35.656809  346092 mustload.go:65] Loading cluster: ha-349588

	I0803 23:49:35.657051  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:35.657322  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:35.657356  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:35.673016  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40289

	I0803 23:49:35.673600  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:35.674137  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:35.674163  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:35.674524  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:35.674729  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:35.676374  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:35.676762  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:35.676801  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:35.692471  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46379

	I0803 23:49:35.692902  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:35.693448  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:35.693472  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:35.693833  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:35.694035  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:35.694192  346092 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588 for IP: 192.168.39.67

	I0803 23:49:35.694204  346092 certs.go:194] generating shared ca certs ...

	I0803 23:49:35.694223  346092 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:35.694426  346092 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:49:35.694494  346092 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:49:35.694507  346092 certs.go:256] generating profile certs ...

	I0803 23:49:35.694605  346092 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key

	I0803 23:49:35.694640  346092 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71

	I0803 23:49:35.694659  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.168 192.168.39.67 192.168.39.254]

	I0803 23:49:35.917497  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71 ...

	I0803 23:49:35.917544  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71: {Name:mke951f82b9c8987c94f55cf17d3747067a5c196 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:35.917758  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71 ...

	I0803 23:49:35.917774  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71: {Name:mk02505c8ddb9ca87fb327815bc5ef9322277b2e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:35.917868  346092 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt

	I0803 23:49:35.918007  346092 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key

	I0803 23:49:35.918138  346092 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key

	I0803 23:49:35.918156  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0803 23:49:35.918172  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0803 23:49:35.918186  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0803 23:49:35.918202  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0803 23:49:35.918215  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0803 23:49:35.918227  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0803 23:49:35.918239  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0803 23:49:35.918251  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0803 23:49:35.918299  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem (1338 bytes)

	W0803 23:49:35.918329  346092 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097_empty.pem, impossibly tiny 0 bytes

	I0803 23:49:35.918338  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:49:35.918360  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:49:35.918384  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:49:35.918404  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:49:35.918441  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:49:35.918466  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem -> /usr/share/ca-certificates/331097.pem

	I0803 23:49:35.918480  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /usr/share/ca-certificates/3310972.pem

	I0803 23:49:35.918490  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:35.918524  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:35.921612  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:35.922060  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:35.922086  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:35.922268  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:35.922528  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:35.922696  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:35.922862  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:35.993968  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0803 23:49:35.999189  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0803 23:49:36.012984  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0803 23:49:36.017711  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0803 23:49:36.030643  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0803 23:49:36.035338  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0803 23:49:36.046723  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0803 23:49:36.051542  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0803 23:49:36.063687  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0803 23:49:36.068111  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0803 23:49:36.079721  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0803 23:49:36.084574  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0803 23:49:36.097214  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:49:36.123871  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:49:36.150504  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:49:36.176044  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:49:36.201207  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0803 23:49:36.226385  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0803 23:49:36.251236  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:49:36.276179  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0803 23:49:36.300943  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem --> /usr/share/ca-certificates/331097.pem (1338 bytes)

	I0803 23:49:36.326134  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /usr/share/ca-certificates/3310972.pem (1708 bytes)

	I0803 23:49:36.351169  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:49:36.376713  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0803 23:49:36.394851  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0803 23:49:36.412839  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0803 23:49:36.429967  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0803 23:49:36.447330  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0803 23:49:36.465224  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0803 23:49:36.484948  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0803 23:49:36.504399  346092 ssh_runner.go:195] Run: openssl version

	I0803 23:49:36.510609  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:49:36.522136  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:36.527204  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:36.527286  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:36.533370  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:49:36.545165  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/331097.pem && ln -fs /usr/share/ca-certificates/331097.pem /etc/ssl/certs/331097.pem"

	I0803 23:49:36.557561  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/331097.pem

	I0803 23:49:36.562446  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  3 23:44 /usr/share/ca-certificates/331097.pem

	I0803 23:49:36.562514  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/331097.pem

	I0803 23:49:36.568768  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/331097.pem /etc/ssl/certs/51391683.0"

	I0803 23:49:36.580483  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3310972.pem && ln -fs /usr/share/ca-certificates/3310972.pem /etc/ssl/certs/3310972.pem"

	I0803 23:49:36.592809  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3310972.pem

	I0803 23:49:36.598103  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  3 23:44 /usr/share/ca-certificates/3310972.pem

	I0803 23:49:36.598176  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3310972.pem

	I0803 23:49:36.604409  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3310972.pem /etc/ssl/certs/3ec20f2e.0"

	I0803 23:49:36.616058  346092 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:49:36.620743  346092 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:49:36.620797  346092 kubeadm.go:934] updating node {m02 192.168.39.67 8443 v1.30.3 crio true true} ...

	I0803 23:49:36.620884  346092 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-349588-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.67

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:49:36.620910  346092 kube-vip.go:115] generating kube-vip config ...

	I0803 23:49:36.620954  346092 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0803 23:49:36.638507  346092 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0803 23:49:36.638607  346092 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0803 23:49:36.638675  346092 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:49:36.649343  346092 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0803 23:49:36.649405  346092 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0803 23:49:36.661547  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0803 23:49:36.661580  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:49:36.661674  346092 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet

	I0803 23:49:36.661683  346092 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm

	I0803 23:49:36.661689  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:49:36.666174  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0803 23:49:36.666213  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0803 23:49:37.652314  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:49:37.669824  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:49:37.669973  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:49:37.674869  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0803 23:49:37.674913  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0803 23:49:39.850597  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:49:39.850682  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:49:39.855926  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0803 23:49:39.855963  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0803 23:49:40.108212  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0803 23:49:40.119630  346092 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0803 23:49:40.137422  346092 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:49:40.154245  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0803 23:49:40.171440  346092 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0803 23:49:40.175867  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:49:40.189078  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:49:40.320235  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:49:40.338074  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:40.338438  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:40.338480  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:40.354264  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41067

	I0803 23:49:40.354726  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:40.355217  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:40.355240  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:40.355602  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:40.355803  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:40.355978  346092 start.go:317] joinCluster: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration

:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:49:40.356124  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0803 23:49:40.356168  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:40.359343  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:40.359840  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:40.359873  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:40.360005  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:40.360235  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:40.360419  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:40.360578  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:40.515090  346092 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:49:40.515146  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token wojua7.acwoc7lubp2sjzye --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m02 --control-plane --apiserver-advertise-address=192.168.39.67 --apiserver-bind-port=8443"

	I0803 23:50:02.946975  346092 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token wojua7.acwoc7lubp2sjzye --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m02 --control-plane --apiserver-advertise-address=192.168.39.67 --apiserver-bind-port=8443": (22.431790037s)

	I0803 23:50:02.947019  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0803 23:50:03.446614  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-349588-m02 minikube.k8s.io/updated_at=2024_08_03T23_50_03_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=ha-349588 minikube.k8s.io/primary=false

	I0803 23:50:03.609385  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-349588-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0803 23:50:03.735531  346092 start.go:319] duration metric: took 23.379547866s to joinCluster

	I0803 23:50:03.735696  346092 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:50:03.735969  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:03.737123  346092 out.go:177] * Verifying Kubernetes components...

	I0803 23:50:03.738194  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:50:04.021548  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:50:04.087375  346092 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:50:04.087738  346092 kapi.go:59] client config for ha-349588: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt", KeyFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key", CAFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02f40), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0803 23:50:04.087825  346092 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.168:8443

	I0803 23:50:04.088155  346092 node_ready.go:35] waiting up to 6m0s for node "ha-349588-m02" to be "Ready" ...

	I0803 23:50:04.088267  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:04.088279  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:04.088289  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:04.088293  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:04.101608  346092 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0803 23:50:04.588793  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:04.588824  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:04.588835  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:04.588842  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:04.598391  346092 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0803 23:50:05.088603  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:05.088654  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:05.088667  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:05.088672  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:05.101983  346092 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0803 23:50:05.588487  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:05.588512  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:05.588520  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:05.588524  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:05.594895  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:50:06.088958  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:06.088993  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:06.089006  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:06.089013  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:06.093121  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:06.093903  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:06.589007  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:06.589034  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:06.589043  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:06.589049  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:06.592751  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:07.088728  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:07.088755  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:07.088765  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:07.088769  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:07.092603  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:07.588467  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:07.588494  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:07.588503  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:07.588507  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:07.592369  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:08.088806  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:08.088832  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:08.088842  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:08.088847  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:08.341203  346092 round_trippers.go:574] Response Status: 200 OK in 252 milliseconds

	I0803 23:50:08.341873  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:08.588741  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:08.588769  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:08.588784  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:08.588791  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:08.593035  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:09.088693  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:09.088718  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:09.088727  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:09.088730  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:09.092569  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:09.589160  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:09.589184  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:09.589193  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:09.589196  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:09.593032  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:10.088752  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:10.088778  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:10.088786  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:10.088790  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:10.093525  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:10.588993  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:10.589018  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:10.589026  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:10.589030  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:10.593009  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:10.593688  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:11.089324  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:11.089353  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:11.089364  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:11.089369  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:11.092666  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:11.588626  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:11.588652  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:11.588661  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:11.588665  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:11.592229  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:12.088688  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:12.088717  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:12.088728  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:12.088735  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:12.092442  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:12.588482  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:12.588508  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:12.588519  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:12.588525  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:12.592800  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:13.089159  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:13.089183  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:13.089192  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:13.089197  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:13.093008  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:13.093622  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:13.588880  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:13.588905  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:13.588914  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:13.588920  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:13.592486  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:14.088375  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:14.088400  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:14.088409  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:14.088413  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:14.092385  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:14.588835  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:14.588868  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:14.588877  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:14.588881  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:14.592420  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:15.089024  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:15.089047  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:15.089057  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:15.089061  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:15.094639  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:50:15.095247  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:15.589208  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:15.589235  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:15.589249  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:15.589255  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:15.592801  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:16.089093  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:16.089119  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:16.089127  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:16.089132  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:16.093269  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:16.588406  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:16.588436  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:16.588445  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:16.588448  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:16.592508  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:17.088496  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:17.088524  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:17.088532  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:17.088537  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:17.092475  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:17.588414  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:17.588441  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:17.588450  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:17.588454  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:17.591618  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:17.592274  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:18.088769  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:18.088799  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:18.088810  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:18.088815  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:18.092770  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:18.588849  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:18.588880  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:18.588891  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:18.588896  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:18.596556  346092 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0803 23:50:19.089425  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:19.089451  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:19.089460  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:19.089465  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:19.093449  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:19.588574  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:19.588600  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:19.588608  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:19.588611  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:19.592387  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:19.593033  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:20.089327  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.089353  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.089365  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.089371  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.092714  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.093273  346092 node_ready.go:49] node "ha-349588-m02" has status "Ready":"True"

	I0803 23:50:20.093308  346092 node_ready.go:38] duration metric: took 16.005118223s for node "ha-349588-m02" to be "Ready" ...

	I0803 23:50:20.093320  346092 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:50:20.093433  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:20.093448  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.093462  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.093469  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.100038  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:50:20.105890  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.105983  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-fzmtg

	I0803 23:50:20.105993  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.106000  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.106006  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.109203  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.110030  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.110048  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.110059  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.110065  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.113001  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.113519  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.113536  346092 pod_ready.go:81] duration metric: took 7.615549ms for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.113545  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.113609  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-z8qt6

	I0803 23:50:20.113616  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.113623  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.113630  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.116416  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.117033  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.117048  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.117055  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.117058  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.119946  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.120560  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.120579  346092 pod_ready.go:81] duration metric: took 7.024999ms for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.120591  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.120656  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588

	I0803 23:50:20.120666  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.120676  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.120683  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.122841  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.123473  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.123488  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.123495  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.123500  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.125721  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.126110  346092 pod_ready.go:92] pod "etcd-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.126125  346092 pod_ready.go:81] duration metric: took 5.526947ms for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.126134  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.126181  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m02

	I0803 23:50:20.126188  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.126194  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.126198  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.128291  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.128736  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.128749  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.128756  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.128759  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.130925  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.131570  346092 pod_ready.go:92] pod "etcd-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.131587  346092 pod_ready.go:81] duration metric: took 5.446889ms for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.131599  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.290056  346092 request.go:629] Waited for 158.368975ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:50:20.290126  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:50:20.290132  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.290140  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.290145  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.293571  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.489637  346092 request.go:629] Waited for 195.390522ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.489707  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.489712  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.489720  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.489725  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.492984  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.493434  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.493454  346092 pod_ready.go:81] duration metric: took 361.848401ms for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.493467  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.689358  346092 request.go:629] Waited for 195.783846ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:50:20.689430  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:50:20.689438  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.689456  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.689465  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.693618  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:20.889724  346092 request.go:629] Waited for 195.310872ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.889787  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.889792  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.889800  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.889804  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.893536  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.894217  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.894238  346092 pod_ready.go:81] duration metric: took 400.764562ms for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.894248  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.090421  346092 request.go:629] Waited for 196.080925ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:50:21.090509  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:50:21.090516  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.090534  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.090543  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.094083  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.290154  346092 request.go:629] Waited for 195.368168ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:21.290234  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:21.290238  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.290246  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.290250  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.293525  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.294206  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:21.294224  346092 pod_ready.go:81] duration metric: took 399.970486ms for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.294234  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.490360  346092 request.go:629] Waited for 196.055949ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:50:21.490451  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:50:21.490456  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.490465  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.490468  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.494025  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.690145  346092 request.go:629] Waited for 195.384727ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:21.690220  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:21.690228  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.690240  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.690248  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.693529  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.694169  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:21.694192  346092 pod_ready.go:81] duration metric: took 399.951921ms for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.694202  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.890179  346092 request.go:629] Waited for 195.854387ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:50:21.890259  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:50:21.890265  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.890274  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.890279  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.893716  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.089910  346092 request.go:629] Waited for 195.371972ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.090002  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.090008  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.090016  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.090027  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.093738  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.094479  346092 pod_ready.go:92] pod "kube-proxy-bbzdt" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:22.094500  346092 pod_ready.go:81] duration metric: took 400.291536ms for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.094509  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.289594  346092 request.go:629] Waited for 195.006002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:50:22.289686  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:50:22.289694  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.289702  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.289707  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.293120  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.490210  346092 request.go:629] Waited for 196.420033ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:22.490278  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:22.490283  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.490291  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.490294  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.493680  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.494297  346092 pod_ready.go:92] pod "kube-proxy-gbg5q" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:22.494322  346092 pod_ready.go:81] duration metric: took 399.806171ms for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.494332  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.689376  346092 request.go:629] Waited for 194.960002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:50:22.689464  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:50:22.689470  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.689478  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.689482  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.693104  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.890297  346092 request.go:629] Waited for 196.361011ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.890391  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.890399  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.890411  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.890420  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.893697  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.894373  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:22.894394  346092 pod_ready.go:81] duration metric: took 400.055147ms for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.894407  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:23.089430  346092 request.go:629] Waited for 194.917023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:50:23.089499  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:50:23.089515  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.089526  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.089531  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.093012  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:23.290011  346092 request.go:629] Waited for 196.376685ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:23.290074  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:23.290079  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.290087  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.290094  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.293439  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:23.293983  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:23.294011  346092 pod_ready.go:81] duration metric: took 399.595842ms for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:23.294023  346092 pod_ready.go:38] duration metric: took 3.200674416s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:50:23.294047  346092 api_server.go:52] waiting for apiserver process to appear ...

	I0803 23:50:23.294103  346092 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:50:23.311925  346092 api_server.go:72] duration metric: took 19.57618176s to wait for apiserver process to appear ...

	I0803 23:50:23.311959  346092 api_server.go:88] waiting for apiserver healthz status ...

	I0803 23:50:23.311986  346092 api_server.go:253] Checking apiserver healthz at https://192.168.39.168:8443/healthz ...

	I0803 23:50:23.316404  346092 api_server.go:279] https://192.168.39.168:8443/healthz returned 200:

	ok

	I0803 23:50:23.316479  346092 round_trippers.go:463] GET https://192.168.39.168:8443/version

	I0803 23:50:23.316488  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.316496  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.316500  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.317421  346092 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0803 23:50:23.317614  346092 api_server.go:141] control plane version: v1.30.3

	I0803 23:50:23.317642  346092 api_server.go:131] duration metric: took 5.676569ms to wait for apiserver health ...

	I0803 23:50:23.317651  346092 system_pods.go:43] waiting for kube-system pods to appear ...

	I0803 23:50:23.489822  346092 request.go:629] Waited for 172.098571ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.489889  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.489894  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.489904  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.489909  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.495307  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:50:23.500631  346092 system_pods.go:59] 17 kube-system pods found

	I0803 23:50:23.500677  346092 system_pods.go:61] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:50:23.500684  346092 system_pods.go:61] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:50:23.500688  346092 system_pods.go:61] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:50:23.500691  346092 system_pods.go:61] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:50:23.500698  346092 system_pods.go:61] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:50:23.500701  346092 system_pods.go:61] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:50:23.500704  346092 system_pods.go:61] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:50:23.500708  346092 system_pods.go:61] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:50:23.500713  346092 system_pods.go:61] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:50:23.500718  346092 system_pods.go:61] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:50:23.500722  346092 system_pods.go:61] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:50:23.500727  346092 system_pods.go:61] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:50:23.500731  346092 system_pods.go:61] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:50:23.500736  346092 system_pods.go:61] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:50:23.500744  346092 system_pods.go:61] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:50:23.500748  346092 system_pods.go:61] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:50:23.500760  346092 system_pods.go:61] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:50:23.500774  346092 system_pods.go:74] duration metric: took 183.114377ms to wait for pod list to return data ...

	I0803 23:50:23.500785  346092 default_sa.go:34] waiting for default service account to be created ...

	I0803 23:50:23.690294  346092 request.go:629] Waited for 189.403835ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:50:23.690372  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:50:23.690379  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.690387  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.690390  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.693867  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:23.694134  346092 default_sa.go:45] found service account: "default"

	I0803 23:50:23.694155  346092 default_sa.go:55] duration metric: took 193.358105ms for default service account to be created ...

	I0803 23:50:23.694165  346092 system_pods.go:116] waiting for k8s-apps to be running ...

	I0803 23:50:23.889572  346092 request.go:629] Waited for 195.298844ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.889643  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.889648  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.889656  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.889667  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.895176  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:50:23.899132  346092 system_pods.go:86] 17 kube-system pods found

	I0803 23:50:23.899162  346092 system_pods.go:89] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:50:23.899168  346092 system_pods.go:89] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:50:23.899173  346092 system_pods.go:89] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:50:23.899177  346092 system_pods.go:89] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:50:23.899180  346092 system_pods.go:89] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:50:23.899184  346092 system_pods.go:89] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:50:23.899188  346092 system_pods.go:89] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:50:23.899191  346092 system_pods.go:89] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:50:23.899196  346092 system_pods.go:89] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:50:23.899199  346092 system_pods.go:89] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:50:23.899203  346092 system_pods.go:89] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:50:23.899206  346092 system_pods.go:89] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:50:23.899210  346092 system_pods.go:89] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:50:23.899214  346092 system_pods.go:89] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:50:23.899218  346092 system_pods.go:89] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:50:23.899221  346092 system_pods.go:89] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:50:23.899224  346092 system_pods.go:89] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:50:23.899232  346092 system_pods.go:126] duration metric: took 205.059563ms to wait for k8s-apps to be running ...

	I0803 23:50:23.899241  346092 system_svc.go:44] waiting for kubelet service to be running ....

	I0803 23:50:23.899289  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:50:23.918586  346092 system_svc.go:56] duration metric: took 19.330492ms WaitForService to wait for kubelet

	I0803 23:50:23.918619  346092 kubeadm.go:582] duration metric: took 20.182883458s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:50:23.918639  346092 node_conditions.go:102] verifying NodePressure condition ...

	I0803 23:50:24.090107  346092 request.go:629] Waited for 171.389393ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes

	I0803 23:50:24.090194  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes

	I0803 23:50:24.090202  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:24.090213  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:24.090218  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:24.094436  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:24.095386  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:50:24.095419  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:50:24.095433  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:50:24.095439  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:50:24.095445  346092 node_conditions.go:105] duration metric: took 176.80069ms to run NodePressure ...

	I0803 23:50:24.095460  346092 start.go:241] waiting for startup goroutines ...

	I0803 23:50:24.095497  346092 start.go:255] writing updated cluster config ...

	I0803 23:50:24.097766  346092 out.go:177] 

	I0803 23:50:24.099166  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:24.099285  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:50:24.101394  346092 out.go:177] * Starting "ha-349588-m03" control-plane node in "ha-349588" cluster

	I0803 23:50:24.102673  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:50:24.102710  346092 cache.go:56] Caching tarball of preloaded images

	I0803 23:50:24.102810  346092 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:50:24.102821  346092 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:50:24.102925  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:50:24.103193  346092 start.go:360] acquireMachinesLock for ha-349588-m03: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:50:24.103240  346092 start.go:364] duration metric: took 27.2µs to acquireMachinesLock for "ha-349588-m03"

	I0803 23:50:24.103261  346092 start.go:93] Provisioning new machine with config: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-d

ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:50:24.103356  346092 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0803 23:50:24.104783  346092 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0803 23:50:24.104893  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:24.104933  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:24.121746  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44259

	I0803 23:50:24.122292  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:24.122833  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:24.122857  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:24.123219  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:24.123424  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:24.123599  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:24.123792  346092 start.go:159] libmachine.API.Create for "ha-349588" (driver="kvm2")

	I0803 23:50:24.123823  346092 client.go:168] LocalClient.Create starting

	I0803 23:50:24.123860  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:50:24.123907  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:50:24.123930  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:50:24.124006  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:50:24.124033  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:50:24.124049  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:50:24.124078  346092 main.go:141] libmachine: Running pre-create checks...

	I0803 23:50:24.124089  346092 main.go:141] libmachine: (ha-349588-m03) Calling .PreCreateCheck

	I0803 23:50:24.124263  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetConfigRaw

	I0803 23:50:24.124674  346092 main.go:141] libmachine: Creating machine...

	I0803 23:50:24.124688  346092 main.go:141] libmachine: (ha-349588-m03) Calling .Create

	I0803 23:50:24.124837  346092 main.go:141] libmachine: (ha-349588-m03) Creating KVM machine...

	I0803 23:50:24.126236  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found existing default KVM network

	I0803 23:50:24.126409  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found existing private KVM network mk-ha-349588

	I0803 23:50:24.126593  346092 main.go:141] libmachine: (ha-349588-m03) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03 ...

	I0803 23:50:24.126610  346092 main.go:141] libmachine: (ha-349588-m03) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:50:24.126756  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.126596  346924 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:50:24.126786  346092 main.go:141] libmachine: (ha-349588-m03) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:50:24.399033  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.398884  346924 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa...

	I0803 23:50:24.516914  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.516772  346924 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/ha-349588-m03.rawdisk...

	I0803 23:50:24.516953  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Writing magic tar header

	I0803 23:50:24.516982  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Writing SSH key tar header

	I0803 23:50:24.516996  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.516895  346924 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03 ...

	I0803 23:50:24.517016  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03

	I0803 23:50:24.517113  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:50:24.517143  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03 (perms=drwx------)

	I0803 23:50:24.517162  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:50:24.517179  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:50:24.517197  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:50:24.517211  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:50:24.517226  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:50:24.517243  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:50:24.517254  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:50:24.517267  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home

	I0803 23:50:24.517278  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Skipping /home - not owner

	I0803 23:50:24.517290  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:50:24.517307  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:50:24.517318  346092 main.go:141] libmachine: (ha-349588-m03) Creating domain...

	I0803 23:50:24.518387  346092 main.go:141] libmachine: (ha-349588-m03) define libvirt domain using xml: 

	I0803 23:50:24.518416  346092 main.go:141] libmachine: (ha-349588-m03) <domain type='kvm'>

	I0803 23:50:24.518427  346092 main.go:141] libmachine: (ha-349588-m03)   <name>ha-349588-m03</name>

	I0803 23:50:24.518438  346092 main.go:141] libmachine: (ha-349588-m03)   <memory unit='MiB'>2200</memory>

	I0803 23:50:24.518445  346092 main.go:141] libmachine: (ha-349588-m03)   <vcpu>2</vcpu>

	I0803 23:50:24.518453  346092 main.go:141] libmachine: (ha-349588-m03)   <features>

	I0803 23:50:24.518464  346092 main.go:141] libmachine: (ha-349588-m03)     <acpi/>

	I0803 23:50:24.518474  346092 main.go:141] libmachine: (ha-349588-m03)     <apic/>

	I0803 23:50:24.518485  346092 main.go:141] libmachine: (ha-349588-m03)     <pae/>

	I0803 23:50:24.518498  346092 main.go:141] libmachine: (ha-349588-m03)     

	I0803 23:50:24.518509  346092 main.go:141] libmachine: (ha-349588-m03)   </features>

	I0803 23:50:24.518523  346092 main.go:141] libmachine: (ha-349588-m03)   <cpu mode='host-passthrough'>

	I0803 23:50:24.518533  346092 main.go:141] libmachine: (ha-349588-m03)   

	I0803 23:50:24.518543  346092 main.go:141] libmachine: (ha-349588-m03)   </cpu>

	I0803 23:50:24.518553  346092 main.go:141] libmachine: (ha-349588-m03)   <os>

	I0803 23:50:24.518563  346092 main.go:141] libmachine: (ha-349588-m03)     <type>hvm</type>

	I0803 23:50:24.518575  346092 main.go:141] libmachine: (ha-349588-m03)     <boot dev='cdrom'/>

	I0803 23:50:24.518584  346092 main.go:141] libmachine: (ha-349588-m03)     <boot dev='hd'/>

	I0803 23:50:24.518594  346092 main.go:141] libmachine: (ha-349588-m03)     <bootmenu enable='no'/>

	I0803 23:50:24.518607  346092 main.go:141] libmachine: (ha-349588-m03)   </os>

	I0803 23:50:24.518618  346092 main.go:141] libmachine: (ha-349588-m03)   <devices>

	I0803 23:50:24.518629  346092 main.go:141] libmachine: (ha-349588-m03)     <disk type='file' device='cdrom'>

	I0803 23:50:24.518647  346092 main.go:141] libmachine: (ha-349588-m03)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/boot2docker.iso'/>

	I0803 23:50:24.518657  346092 main.go:141] libmachine: (ha-349588-m03)       <target dev='hdc' bus='scsi'/>

	I0803 23:50:24.518670  346092 main.go:141] libmachine: (ha-349588-m03)       <readonly/>

	I0803 23:50:24.518683  346092 main.go:141] libmachine: (ha-349588-m03)     </disk>

	I0803 23:50:24.518726  346092 main.go:141] libmachine: (ha-349588-m03)     <disk type='file' device='disk'>

	I0803 23:50:24.518753  346092 main.go:141] libmachine: (ha-349588-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:50:24.518781  346092 main.go:141] libmachine: (ha-349588-m03)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/ha-349588-m03.rawdisk'/>

	I0803 23:50:24.518793  346092 main.go:141] libmachine: (ha-349588-m03)       <target dev='hda' bus='virtio'/>

	I0803 23:50:24.518802  346092 main.go:141] libmachine: (ha-349588-m03)     </disk>

	I0803 23:50:24.518813  346092 main.go:141] libmachine: (ha-349588-m03)     <interface type='network'>

	I0803 23:50:24.518823  346092 main.go:141] libmachine: (ha-349588-m03)       <source network='mk-ha-349588'/>

	I0803 23:50:24.518836  346092 main.go:141] libmachine: (ha-349588-m03)       <model type='virtio'/>

	I0803 23:50:24.518878  346092 main.go:141] libmachine: (ha-349588-m03)     </interface>

	I0803 23:50:24.518907  346092 main.go:141] libmachine: (ha-349588-m03)     <interface type='network'>

	I0803 23:50:24.518942  346092 main.go:141] libmachine: (ha-349588-m03)       <source network='default'/>

	I0803 23:50:24.518960  346092 main.go:141] libmachine: (ha-349588-m03)       <model type='virtio'/>

	I0803 23:50:24.518970  346092 main.go:141] libmachine: (ha-349588-m03)     </interface>

	I0803 23:50:24.518978  346092 main.go:141] libmachine: (ha-349588-m03)     <serial type='pty'>

	I0803 23:50:24.518990  346092 main.go:141] libmachine: (ha-349588-m03)       <target port='0'/>

	I0803 23:50:24.519000  346092 main.go:141] libmachine: (ha-349588-m03)     </serial>

	I0803 23:50:24.519008  346092 main.go:141] libmachine: (ha-349588-m03)     <console type='pty'>

	I0803 23:50:24.519020  346092 main.go:141] libmachine: (ha-349588-m03)       <target type='serial' port='0'/>

	I0803 23:50:24.519029  346092 main.go:141] libmachine: (ha-349588-m03)     </console>

	I0803 23:50:24.519045  346092 main.go:141] libmachine: (ha-349588-m03)     <rng model='virtio'>

	I0803 23:50:24.519059  346092 main.go:141] libmachine: (ha-349588-m03)       <backend model='random'>/dev/random</backend>

	I0803 23:50:24.519065  346092 main.go:141] libmachine: (ha-349588-m03)     </rng>

	I0803 23:50:24.519077  346092 main.go:141] libmachine: (ha-349588-m03)     

	I0803 23:50:24.519084  346092 main.go:141] libmachine: (ha-349588-m03)     

	I0803 23:50:24.519098  346092 main.go:141] libmachine: (ha-349588-m03)   </devices>

	I0803 23:50:24.519106  346092 main.go:141] libmachine: (ha-349588-m03) </domain>

	I0803 23:50:24.519124  346092 main.go:141] libmachine: (ha-349588-m03) 

	I0803 23:50:24.526713  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:ab:a3:ea in network default

	I0803 23:50:24.527228  346092 main.go:141] libmachine: (ha-349588-m03) Ensuring networks are active...

	I0803 23:50:24.527253  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:24.527861  346092 main.go:141] libmachine: (ha-349588-m03) Ensuring network default is active

	I0803 23:50:24.528200  346092 main.go:141] libmachine: (ha-349588-m03) Ensuring network mk-ha-349588 is active

	I0803 23:50:24.528499  346092 main.go:141] libmachine: (ha-349588-m03) Getting domain xml...

	I0803 23:50:24.529299  346092 main.go:141] libmachine: (ha-349588-m03) Creating domain...

	I0803 23:50:25.809639  346092 main.go:141] libmachine: (ha-349588-m03) Waiting to get IP...

	I0803 23:50:25.810693  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:25.811149  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:25.811200  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:25.811127  346924 retry.go:31] will retry after 239.766839ms: waiting for machine to come up

	I0803 23:50:26.052890  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:26.053455  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:26.053526  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:26.053417  346924 retry.go:31] will retry after 350.096869ms: waiting for machine to come up

	I0803 23:50:26.404999  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:26.405425  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:26.405450  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:26.405378  346924 retry.go:31] will retry after 426.316752ms: waiting for machine to come up

	I0803 23:50:26.832924  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:26.833346  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:26.833377  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:26.833286  346924 retry.go:31] will retry after 468.911288ms: waiting for machine to come up

	I0803 23:50:27.303717  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:27.304186  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:27.304209  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:27.304153  346924 retry.go:31] will retry after 588.198491ms: waiting for machine to come up

	I0803 23:50:27.893918  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:27.894345  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:27.894376  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:27.894289  346924 retry.go:31] will retry after 756.527198ms: waiting for machine to come up

	I0803 23:50:28.652222  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:28.652692  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:28.652722  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:28.652635  346924 retry.go:31] will retry after 956.618375ms: waiting for machine to come up

	I0803 23:50:29.610577  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:29.611053  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:29.611081  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:29.611003  346924 retry.go:31] will retry after 894.193355ms: waiting for machine to come up

	I0803 23:50:30.506910  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:30.507443  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:30.507475  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:30.507383  346924 retry.go:31] will retry after 1.475070752s: waiting for machine to come up

	I0803 23:50:31.984363  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:31.984792  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:31.984823  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:31.984738  346924 retry.go:31] will retry after 1.96830202s: waiting for machine to come up

	I0803 23:50:33.954805  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:33.955250  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:33.955283  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:33.955190  346924 retry.go:31] will retry after 2.345601343s: waiting for machine to come up

	I0803 23:50:36.302961  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:36.303447  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:36.303478  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:36.303397  346924 retry.go:31] will retry after 2.267010238s: waiting for machine to come up

	I0803 23:50:38.571635  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:38.572141  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:38.572165  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:38.572088  346924 retry.go:31] will retry after 4.429291681s: waiting for machine to come up

	I0803 23:50:43.003156  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:43.003613  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:43.003638  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:43.003558  346924 retry.go:31] will retry after 3.48372957s: waiting for machine to come up

	I0803 23:50:46.490110  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.490603  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has current primary IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.490633  346092 main.go:141] libmachine: (ha-349588-m03) Found IP for machine: 192.168.39.79

	I0803 23:50:46.490655  346092 main.go:141] libmachine: (ha-349588-m03) Reserving static IP address...

	I0803 23:50:46.491072  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find host DHCP lease matching {name: "ha-349588-m03", mac: "52:54:00:1d:c9:03", ip: "192.168.39.79"} in network mk-ha-349588

	I0803 23:50:46.573000  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Getting to WaitForSSH function...

	I0803 23:50:46.573036  346092 main.go:141] libmachine: (ha-349588-m03) Reserved static IP address: 192.168.39.79

	I0803 23:50:46.573049  346092 main.go:141] libmachine: (ha-349588-m03) Waiting for SSH to be available...

	I0803 23:50:46.575539  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.575870  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.575901  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.576123  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Using SSH client type: external

	I0803 23:50:46.576160  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa (-rw-------)

	I0803 23:50:46.576188  346092 main.go:141] libmachine: (ha-349588-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.79 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:50:46.576201  346092 main.go:141] libmachine: (ha-349588-m03) DBG | About to run SSH command:

	I0803 23:50:46.576213  346092 main.go:141] libmachine: (ha-349588-m03) DBG | exit 0

	I0803 23:50:46.710090  346092 main.go:141] libmachine: (ha-349588-m03) DBG | SSH cmd err, output: <nil>: 

	I0803 23:50:46.710376  346092 main.go:141] libmachine: (ha-349588-m03) KVM machine creation complete!

	I0803 23:50:46.710702  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetConfigRaw

	I0803 23:50:46.711288  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:46.711523  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:46.711699  346092 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:50:46.711715  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:50:46.713405  346092 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:50:46.713420  346092 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:50:46.713426  346092 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:50:46.713432  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:46.715823  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.716240  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.716262  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.716392  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:46.716587  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.716764  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.716943  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:46.717168  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:46.717414  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:46.717426  346092 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:50:46.833008  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:50:46.833043  346092 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:50:46.833055  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:46.836050  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.836542  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.836581  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.836685  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:46.836896  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.837102  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.837277  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:46.837427  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:46.837659  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:46.837674  346092 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:50:46.954626  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:50:46.954732  346092 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:50:46.954746  346092 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:50:46.954761  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:46.955024  346092 buildroot.go:166] provisioning hostname "ha-349588-m03"

	I0803 23:50:46.955054  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:46.955260  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:46.958280  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.958653  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.958677  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.958827  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:46.959018  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.959199  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.959356  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:46.959528  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:46.959713  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:46.959727  346092 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-349588-m03 && echo "ha-349588-m03" | sudo tee /etc/hostname

	I0803 23:50:47.091774  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-349588-m03

	I0803 23:50:47.091816  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.095084  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.095475  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.095509  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.095705  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.095912  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.096140  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.096327  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.096531  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:47.096732  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:47.096764  346092 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-349588-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-349588-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-349588-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:50:47.224450  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:50:47.224503  346092 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:50:47.224536  346092 buildroot.go:174] setting up certificates

	I0803 23:50:47.224547  346092 provision.go:84] configureAuth start

	I0803 23:50:47.224561  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:47.224940  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:47.228138  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.228514  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.228544  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.228711  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.231105  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.231425  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.231449  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.231559  346092 provision.go:143] copyHostCerts

	I0803 23:50:47.231597  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:50:47.231642  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem, removing ...

	I0803 23:50:47.231680  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:50:47.231784  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:50:47.231887  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:50:47.231914  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem, removing ...

	I0803 23:50:47.231924  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:50:47.231961  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:50:47.232050  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:50:47.232071  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem, removing ...

	I0803 23:50:47.232075  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:50:47.232099  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:50:47.232148  346092 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.ha-349588-m03 san=[127.0.0.1 192.168.39.79 ha-349588-m03 localhost minikube]

	I0803 23:50:47.399469  346092 provision.go:177] copyRemoteCerts

	I0803 23:50:47.399534  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:50:47.399562  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.402686  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.403211  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.403235  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.403420  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.403606  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.403793  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.403925  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:47.492467  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0803 23:50:47.492566  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0803 23:50:47.517280  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0803 23:50:47.517354  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0803 23:50:47.542649  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0803 23:50:47.542733  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:50:47.568029  346092 provision.go:87] duration metric: took 343.464982ms to configureAuth

	I0803 23:50:47.568066  346092 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:50:47.568348  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:47.568459  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.571724  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.572147  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.572177  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.572434  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.572661  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.572844  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.573018  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.573266  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:47.573499  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:47.573552  346092 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:50:47.853244  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:50:47.853276  346092 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:50:47.853285  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetURL

	I0803 23:50:47.854683  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Using libvirt version 6000000

	I0803 23:50:47.856880  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.857234  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.857272  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.857396  346092 main.go:141] libmachine: Docker is up and running!

	I0803 23:50:47.857411  346092 main.go:141] libmachine: Reticulating splines...

	I0803 23:50:47.857419  346092 client.go:171] duration metric: took 23.733587583s to LocalClient.Create

	I0803 23:50:47.857445  346092 start.go:167] duration metric: took 23.733655538s to libmachine.API.Create "ha-349588"

	I0803 23:50:47.857455  346092 start.go:293] postStartSetup for "ha-349588-m03" (driver="kvm2")

	I0803 23:50:47.857465  346092 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:50:47.857481  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:47.857750  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:50:47.857787  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.859967  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.860290  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.860314  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.860473  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.860661  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.860856  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.861033  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:47.950131  346092 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:50:47.954819  346092 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:50:47.954849  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:50:47.954920  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:50:47.955013  346092 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> 3310972.pem in /etc/ssl/certs

	I0803 23:50:47.955026  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /etc/ssl/certs/3310972.pem

	I0803 23:50:47.955136  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0803 23:50:47.965629  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:50:47.991355  346092 start.go:296] duration metric: took 133.884824ms for postStartSetup

	I0803 23:50:47.991428  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetConfigRaw

	I0803 23:50:47.992144  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:47.995389  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.995867  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.995892  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.996186  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:50:47.996383  346092 start.go:128] duration metric: took 23.893015539s to createHost

	I0803 23:50:47.996409  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.998754  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.999113  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.999143  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.999287  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.999474  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.999669  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.999821  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:48.000025  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:48.000233  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:48.000247  346092 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0803 23:50:48.118642  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722729048.091068532

	I0803 23:50:48.118694  346092 fix.go:216] guest clock: 1722729048.091068532

	I0803 23:50:48.118704  346092 fix.go:229] Guest: 2024-08-03 23:50:48.091068532 +0000 UTC Remote: 2024-08-03 23:50:47.996396829 +0000 UTC m=+158.613815502 (delta=94.671703ms)

	I0803 23:50:48.118730  346092 fix.go:200] guest clock delta is within tolerance: 94.671703ms

	I0803 23:50:48.118739  346092 start.go:83] releasing machines lock for "ha-349588-m03", held for 24.015487886s

	I0803 23:50:48.118770  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.119061  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:48.121626  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.121930  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:48.121964  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.124323  346092 out.go:177] * Found network options:

	I0803 23:50:48.126077  346092 out.go:177]   - NO_PROXY=192.168.39.168,192.168.39.67

	W0803 23:50:48.127478  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	W0803 23:50:48.127501  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:50:48.127518  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.128153  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.128346  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.128449  346092 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:50:48.128485  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	W0803 23:50:48.128555  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	W0803 23:50:48.128576  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:50:48.128633  346092 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:50:48.128650  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:48.131323  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.131347  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.131817  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:48.131848  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.131891  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:48.131906  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.132081  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:48.132094  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:48.132320  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:48.132324  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:48.132523  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:48.132533  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:48.132701  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:48.132773  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:48.389379  346092 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:50:48.395859  346092 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:50:48.395928  346092 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:50:48.415300  346092 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:50:48.415326  346092 start.go:495] detecting cgroup driver to use...

	I0803 23:50:48.415389  346092 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:50:48.434790  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:50:48.449942  346092 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:50:48.450002  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:50:48.464339  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:50:48.479343  346092 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:50:48.598044  346092 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:50:48.771836  346092 docker.go:233] disabling docker service ...

	I0803 23:50:48.771936  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:50:48.786743  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:50:48.800909  346092 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:50:48.929721  346092 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:50:49.070946  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:50:49.085981  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:50:49.107145  346092 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:50:49.107204  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.118494  346092 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:50:49.118562  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.129818  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.141337  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.152936  346092 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:50:49.165557  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.176476  346092 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.195609  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.206645  346092 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:50:49.216707  346092 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:50:49.216779  346092 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:50:49.229560  346092 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:50:49.240199  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:50:49.363339  346092 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:50:49.509934  346092 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:50:49.510026  346092 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:50:49.515470  346092 start.go:563] Will wait 60s for crictl version

	I0803 23:50:49.515551  346092 ssh_runner.go:195] Run: which crictl

	I0803 23:50:49.519688  346092 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:50:49.558552  346092 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:50:49.558653  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:50:49.588140  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:50:49.618274  346092 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:50:49.619575  346092 out.go:177]   - env NO_PROXY=192.168.39.168

	I0803 23:50:49.620837  346092 out.go:177]   - env NO_PROXY=192.168.39.168,192.168.39.67

	I0803 23:50:49.622108  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:49.624763  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:49.625127  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:49.625156  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:49.625361  346092 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:50:49.629549  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:50:49.642294  346092 mustload.go:65] Loading cluster: ha-349588

	I0803 23:50:49.642557  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:49.642856  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:49.642907  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:49.661314  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33485

	I0803 23:50:49.661775  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:49.662267  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:49.662289  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:49.662672  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:49.662927  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:50:49.664647  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:50:49.665078  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:49.665123  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:49.681650  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37001

	I0803 23:50:49.682116  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:49.682716  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:49.682741  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:49.683105  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:49.683339  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:50:49.683495  346092 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588 for IP: 192.168.39.79

	I0803 23:50:49.683508  346092 certs.go:194] generating shared ca certs ...

	I0803 23:50:49.683525  346092 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:50:49.683695  346092 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:50:49.683752  346092 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:50:49.683765  346092 certs.go:256] generating profile certs ...

	I0803 23:50:49.683876  346092 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key

	I0803 23:50:49.683910  346092 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80

	I0803 23:50:49.683937  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.168 192.168.39.67 192.168.39.79 192.168.39.254]

	I0803 23:50:49.893374  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80 ...

	I0803 23:50:49.893411  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80: {Name:mkdc2fe11503b9f1d1c4c6c90e0b1df90eefa7ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:50:49.893608  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80 ...

	I0803 23:50:49.893627  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80: {Name:mk4257b808aff31998eea42cc17d84d4d90cd6cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:50:49.893730  346092 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt

	I0803 23:50:49.893899  346092 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key

	I0803 23:50:49.894070  346092 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key

	I0803 23:50:49.894092  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0803 23:50:49.894112  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0803 23:50:49.894132  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0803 23:50:49.894149  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0803 23:50:49.894168  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0803 23:50:49.894188  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0803 23:50:49.894206  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0803 23:50:49.894225  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0803 23:50:49.894291  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem (1338 bytes)

	W0803 23:50:49.894333  346092 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097_empty.pem, impossibly tiny 0 bytes

	I0803 23:50:49.894348  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:50:49.894383  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:50:49.894416  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:50:49.894447  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:50:49.894501  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:50:49.894539  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /usr/share/ca-certificates/3310972.pem

	I0803 23:50:49.894563  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:49.894581  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem -> /usr/share/ca-certificates/331097.pem

	I0803 23:50:49.894629  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:50:49.897587  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:49.897949  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:50:49.897980  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:49.898200  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:50:49.898435  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:50:49.898608  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:50:49.898763  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:50:49.969917  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0803 23:50:49.975416  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0803 23:50:49.988587  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0803 23:50:49.995102  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0803 23:50:50.010263  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0803 23:50:50.015483  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0803 23:50:50.027162  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0803 23:50:50.031962  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0803 23:50:50.043075  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0803 23:50:50.047433  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0803 23:50:50.061685  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0803 23:50:50.066714  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0803 23:50:50.078785  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:50:50.107115  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:50:50.132767  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:50:50.158356  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:50:50.183481  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0803 23:50:50.208890  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0803 23:50:50.233259  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:50:50.258319  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0803 23:50:50.283420  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /usr/share/ca-certificates/3310972.pem (1708 bytes)

	I0803 23:50:50.308734  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:50:50.332877  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem --> /usr/share/ca-certificates/331097.pem (1338 bytes)

	I0803 23:50:50.358589  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0803 23:50:50.378002  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0803 23:50:50.397027  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0803 23:50:50.415515  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0803 23:50:50.432653  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0803 23:50:50.451386  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0803 23:50:50.469186  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0803 23:50:50.487462  346092 ssh_runner.go:195] Run: openssl version

	I0803 23:50:50.494163  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:50:50.506441  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:50.511410  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:50.511508  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:50.518230  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:50:50.529617  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/331097.pem && ln -fs /usr/share/ca-certificates/331097.pem /etc/ssl/certs/331097.pem"

	I0803 23:50:50.541105  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/331097.pem

	I0803 23:50:50.545860  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  3 23:44 /usr/share/ca-certificates/331097.pem

	I0803 23:50:50.545931  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/331097.pem

	I0803 23:50:50.551998  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/331097.pem /etc/ssl/certs/51391683.0"

	I0803 23:50:50.563960  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3310972.pem && ln -fs /usr/share/ca-certificates/3310972.pem /etc/ssl/certs/3310972.pem"

	I0803 23:50:50.575845  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3310972.pem

	I0803 23:50:50.580600  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  3 23:44 /usr/share/ca-certificates/3310972.pem

	I0803 23:50:50.580681  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3310972.pem

	I0803 23:50:50.586680  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3310972.pem /etc/ssl/certs/3ec20f2e.0"

	I0803 23:50:50.598021  346092 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:50:50.602251  346092 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:50:50.602313  346092 kubeadm.go:934] updating node {m03 192.168.39.79 8443 v1.30.3 crio true true} ...

	I0803 23:50:50.602404  346092 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-349588-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.79

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:50:50.602429  346092 kube-vip.go:115] generating kube-vip config ...

	I0803 23:50:50.602467  346092 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0803 23:50:50.619648  346092 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0803 23:50:50.619721  346092 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0803 23:50:50.619777  346092 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:50:50.630085  346092 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0803 23:50:50.630144  346092 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0803 23:50:50.640083  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0803 23:50:50.640126  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:50:50.640138  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256

	I0803 23:50:50.640144  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256

	I0803 23:50:50.640152  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:50:50.640196  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:50:50.640219  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:50:50.640219  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:50:50.658556  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0803 23:50:50.658604  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:50:50.658606  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0803 23:50:50.658650  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0803 23:50:50.658680  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0803 23:50:50.658723  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:50:50.690959  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0803 23:50:50.691012  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0803 23:50:51.642253  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0803 23:50:51.652555  346092 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0803 23:50:51.670949  346092 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:50:51.689089  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0803 23:50:51.706834  346092 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0803 23:50:51.711106  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:50:51.724182  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:50:51.847681  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:50:51.869416  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:50:51.869884  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:51.869941  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:51.886556  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39421

	I0803 23:50:51.888144  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:51.888782  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:51.888815  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:51.889193  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:51.889432  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:50:51.889615  346092 start.go:317] joinCluster: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.79 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false in

spektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt

imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:50:51.889756  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0803 23:50:51.889775  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:50:51.893005  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:51.893469  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:50:51.893519  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:51.893703  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:50:51.893926  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:50:51.894096  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:50:51.894277  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:50:52.068131  346092 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.79 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:50:52.068197  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token jhmyct.fs9mmu6drhozseqf --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m03 --control-plane --apiserver-advertise-address=192.168.39.79 --apiserver-bind-port=8443"

	I0803 23:51:16.339682  346092 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token jhmyct.fs9mmu6drhozseqf --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m03 --control-plane --apiserver-advertise-address=192.168.39.79 --apiserver-bind-port=8443": (24.271445189s)

	I0803 23:51:16.339733  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0803 23:51:17.004233  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-349588-m03 minikube.k8s.io/updated_at=2024_08_03T23_51_17_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=ha-349588 minikube.k8s.io/primary=false

	I0803 23:51:17.133330  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-349588-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0803 23:51:17.258692  346092 start.go:319] duration metric: took 25.369072533s to joinCluster

	I0803 23:51:17.258795  346092 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.79 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:51:17.259136  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:51:17.260411  346092 out.go:177] * Verifying Kubernetes components...

	I0803 23:51:17.261728  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:51:17.568914  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:51:17.612603  346092 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:51:17.613015  346092 kapi.go:59] client config for ha-349588: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt", KeyFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key", CAFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02f40), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0803 23:51:17.613118  346092 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.168:8443

	I0803 23:51:17.613361  346092 node_ready.go:35] waiting up to 6m0s for node "ha-349588-m03" to be "Ready" ...

	I0803 23:51:17.613453  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:17.613464  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:17.613472  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:17.613477  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:17.616902  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:18.113863  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:18.113893  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:18.113905  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:18.113910  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:18.117470  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:18.613693  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:18.613717  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:18.613727  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:18.613735  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:18.617494  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:19.114494  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:19.114519  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:19.114528  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:19.114533  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:19.118484  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:19.614244  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:19.614267  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:19.614278  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:19.614289  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:19.618392  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:19.619001  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:20.114427  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:20.114450  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:20.114458  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:20.114463  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:20.118888  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:20.614464  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:20.614496  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:20.614509  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:20.614515  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:20.620459  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:51:21.114661  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:21.114690  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:21.114701  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:21.114706  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:21.119029  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:21.613753  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:21.613779  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:21.613788  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:21.613794  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:21.617083  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:22.114520  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:22.114548  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:22.114559  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:22.114564  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:22.117991  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:22.118703  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:22.614188  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:22.614211  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:22.614220  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:22.614223  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:22.617880  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:23.113699  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:23.113732  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:23.113741  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:23.113747  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:23.117692  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:23.613659  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:23.613686  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:23.613695  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:23.613698  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:23.617919  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:24.113692  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:24.113722  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:24.113731  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:24.113735  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:24.117496  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:24.613911  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:24.613936  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:24.613945  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:24.613951  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:24.617695  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:24.618387  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:25.113589  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:25.113615  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:25.113622  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:25.113625  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:25.117040  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:25.614494  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:25.614518  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:25.614527  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:25.614530  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:25.618351  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:26.114570  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:26.114600  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:26.114613  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:26.114617  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:26.117984  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:26.613722  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:26.613752  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:26.613762  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:26.613765  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:26.617091  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:27.113607  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:27.113636  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:27.113646  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:27.113651  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:27.116932  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:27.117575  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:27.613684  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:27.613707  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:27.613716  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:27.613719  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:27.617010  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:28.114036  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:28.114061  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:28.114072  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:28.114077  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:28.117689  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:28.613694  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:28.613717  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:28.613727  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:28.613731  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:28.617175  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:29.114486  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:29.114516  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:29.114528  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:29.114534  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:29.117960  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:29.118584  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:29.614581  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:29.614606  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:29.614615  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:29.614619  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:29.618157  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:30.113701  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:30.113728  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:30.113738  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:30.113745  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:30.118868  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:51:30.614474  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:30.614503  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:30.614516  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:30.614522  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:30.618005  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.113747  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:31.113773  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.113784  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.113789  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.117249  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.117818  346092 node_ready.go:49] node "ha-349588-m03" has status "Ready":"True"

	I0803 23:51:31.117844  346092 node_ready.go:38] duration metric: took 13.504465294s for node "ha-349588-m03" to be "Ready" ...

	I0803 23:51:31.117857  346092 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:51:31.117936  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:31.117948  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.117957  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.117963  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.125096  346092 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0803 23:51:31.132659  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.132757  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-fzmtg

	I0803 23:51:31.132765  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.132773  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.132777  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.136446  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.137409  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.137425  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.137433  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.137437  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.140711  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.141628  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.141652  346092 pod_ready.go:81] duration metric: took 8.959263ms for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.141664  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.141746  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-z8qt6

	I0803 23:51:31.141756  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.141766  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.141774  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.144612  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.145703  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.145717  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.145724  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.145729  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.148882  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.149402  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.149422  346092 pod_ready.go:81] duration metric: took 7.748921ms for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.149433  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.149524  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588

	I0803 23:51:31.149537  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.149547  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.149554  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.151974  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.152558  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.152572  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.152579  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.152583  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.154985  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.155502  346092 pod_ready.go:92] pod "etcd-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.155526  346092 pod_ready.go:81] duration metric: took 6.085151ms for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.155537  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.155596  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m02

	I0803 23:51:31.155603  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.155610  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.155613  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.158896  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.159772  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:31.159786  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.159793  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.159797  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.162550  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.163470  346092 pod_ready.go:92] pod "etcd-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.163488  346092 pod_ready.go:81] duration metric: took 7.945539ms for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.163497  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.313805  346092 request.go:629] Waited for 150.235244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m03

	I0803 23:51:31.313887  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m03

	I0803 23:51:31.313894  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.313903  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.313910  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.316950  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.514235  346092 request.go:629] Waited for 196.41936ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:31.514342  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:31.514350  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.514360  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.514370  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.517499  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.518373  346092 pod_ready.go:92] pod "etcd-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.518391  346092 pod_ready.go:81] duration metric: took 354.888561ms for pod "etcd-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.518408  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.714574  346092 request.go:629] Waited for 196.078655ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:51:31.714640  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:51:31.714645  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.714654  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.714660  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.718192  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.914516  346092 request.go:629] Waited for 195.494317ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.914594  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.914602  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.914614  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.914624  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.920699  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:31.922297  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.922322  346092 pod_ready.go:81] duration metric: took 403.9068ms for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.922337  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.114309  346092 request.go:629] Waited for 191.882286ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:51:32.114410  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:51:32.114422  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.114436  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.114446  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.118362  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:32.314850  346092 request.go:629] Waited for 195.414465ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:32.314943  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:32.314954  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.314968  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.314978  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.319424  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:32.319937  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:32.319956  346092 pod_ready.go:81] duration metric: took 397.612453ms for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.319968  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.514132  346092 request.go:629] Waited for 194.066274ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m03

	I0803 23:51:32.514207  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m03

	I0803 23:51:32.514218  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.514230  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.514239  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.517826  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:32.714186  346092 request.go:629] Waited for 195.384867ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:32.714263  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:32.714268  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.714276  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.714280  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.717622  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:32.718276  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:32.718295  346092 pod_ready.go:81] duration metric: took 398.320232ms for pod "kube-apiserver-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.718305  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.914423  346092 request.go:629] Waited for 196.027987ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:51:32.914519  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:51:32.914531  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.914544  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.914557  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.918214  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.114290  346092 request.go:629] Waited for 195.385789ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:33.114354  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:33.114359  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.114367  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.114372  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.118031  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.118758  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:33.118786  346092 pod_ready.go:81] duration metric: took 400.47234ms for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.118801  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.313773  346092 request.go:629] Waited for 194.874757ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:51:33.313869  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:51:33.313886  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.313897  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.313904  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.322352  346092 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0803 23:51:33.514604  346092 request.go:629] Waited for 191.39455ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:33.514693  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:33.514701  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.514733  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.514761  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.518436  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.519029  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:33.519057  346092 pod_ready.go:81] duration metric: took 400.246953ms for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.519070  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.714097  346092 request.go:629] Waited for 194.942392ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m03

	I0803 23:51:33.714177  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m03

	I0803 23:51:33.714183  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.714191  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.714198  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.718005  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.914140  346092 request.go:629] Waited for 195.367976ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:33.914237  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:33.914248  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.914260  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.914268  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.918105  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.918773  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:33.918794  346092 pod_ready.go:81] duration metric: took 399.718883ms for pod "kube-controller-manager-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.918804  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.113900  346092 request.go:629] Waited for 194.98485ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:51:34.113982  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:51:34.113991  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.114001  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.114010  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.117261  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:34.313842  346092 request.go:629] Waited for 195.884146ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:34.313923  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:34.313928  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.313936  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.313941  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.318055  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:34.318690  346092 pod_ready.go:92] pod "kube-proxy-bbzdt" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:34.318718  346092 pod_ready.go:81] duration metric: took 399.906769ms for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.318733  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.514717  346092 request.go:629] Waited for 195.884216ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:51:34.514827  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:51:34.514837  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.514846  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.514857  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.518454  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:34.713786  346092 request.go:629] Waited for 194.249312ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:34.713853  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:34.713858  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.713867  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.713872  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.717311  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:34.718121  346092 pod_ready.go:92] pod "kube-proxy-gbg5q" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:34.718146  346092 pod_ready.go:81] duration metric: took 399.405642ms for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.718156  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gxhmd" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.914190  346092 request.go:629] Waited for 195.951933ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gxhmd

	I0803 23:51:34.914334  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gxhmd

	I0803 23:51:34.914349  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.914359  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.914368  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.918014  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.114246  346092 request.go:629] Waited for 195.393665ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:35.114346  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:35.114351  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.114360  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.114364  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.120400  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:35.120927  346092 pod_ready.go:92] pod "kube-proxy-gxhmd" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:35.120947  346092 pod_ready.go:81] duration metric: took 402.784938ms for pod "kube-proxy-gxhmd" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.120957  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.314134  346092 request.go:629] Waited for 193.077756ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:51:35.314197  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:51:35.314204  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.314212  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.314216  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.317495  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.514753  346092 request.go:629] Waited for 196.397541ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:35.514819  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:35.514824  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.514832  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.514837  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.518678  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.519382  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:35.519403  346092 pod_ready.go:81] duration metric: took 398.440069ms for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.519413  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.714054  346092 request.go:629] Waited for 194.546982ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:51:35.714123  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:51:35.714131  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.714139  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.714143  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.717555  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.914758  346092 request.go:629] Waited for 196.375402ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:35.914818  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:35.914824  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.914832  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.914836  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.918263  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.918956  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:35.918981  346092 pod_ready.go:81] duration metric: took 399.560987ms for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.918996  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:36.114089  346092 request.go:629] Waited for 195.010266ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m03

	I0803 23:51:36.114169  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m03

	I0803 23:51:36.114176  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.114187  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.114203  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.117295  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:36.314318  346092 request.go:629] Waited for 196.362498ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:36.314391  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:36.314396  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.314405  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.314408  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.317683  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:36.318319  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:36.318338  346092 pod_ready.go:81] duration metric: took 399.336283ms for pod "kube-scheduler-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:36.318349  346092 pod_ready.go:38] duration metric: took 5.200478543s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:51:36.318365  346092 api_server.go:52] waiting for apiserver process to appear ...

	I0803 23:51:36.318431  346092 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:51:36.335947  346092 api_server.go:72] duration metric: took 19.077109461s to wait for apiserver process to appear ...

	I0803 23:51:36.335981  346092 api_server.go:88] waiting for apiserver healthz status ...

	I0803 23:51:36.336001  346092 api_server.go:253] Checking apiserver healthz at https://192.168.39.168:8443/healthz ...

	I0803 23:51:36.342426  346092 api_server.go:279] https://192.168.39.168:8443/healthz returned 200:

	ok

	I0803 23:51:36.342513  346092 round_trippers.go:463] GET https://192.168.39.168:8443/version

	I0803 23:51:36.342524  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.342534  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.342541  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.343354  346092 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0803 23:51:36.343424  346092 api_server.go:141] control plane version: v1.30.3

	I0803 23:51:36.343444  346092 api_server.go:131] duration metric: took 7.456114ms to wait for apiserver health ...

	I0803 23:51:36.343454  346092 system_pods.go:43] waiting for kube-system pods to appear ...

	I0803 23:51:36.514719  346092 request.go:629] Waited for 171.163392ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.514813  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.514819  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.514826  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.514831  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.521672  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:36.528449  346092 system_pods.go:59] 24 kube-system pods found

	I0803 23:51:36.528484  346092 system_pods.go:61] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:51:36.528488  346092 system_pods.go:61] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:51:36.528492  346092 system_pods.go:61] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:51:36.528496  346092 system_pods.go:61] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:51:36.528499  346092 system_pods.go:61] "etcd-ha-349588-m03" [b94d4e04-56f0-4892-927a-346559af3711] Running

	I0803 23:51:36.528502  346092 system_pods.go:61] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:51:36.528505  346092 system_pods.go:61] "kindnet-7sr59" [09355fc1-1a86-4f3f-be39-4e2e315e679f] Running

	I0803 23:51:36.528508  346092 system_pods.go:61] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:51:36.528511  346092 system_pods.go:61] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:51:36.528515  346092 system_pods.go:61] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:51:36.528518  346092 system_pods.go:61] "kube-apiserver-ha-349588-m03" [fb835dfe-b2d1-49ea-be6a-1c2f2c682095] Running

	I0803 23:51:36.528521  346092 system_pods.go:61] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:51:36.528524  346092 system_pods.go:61] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:51:36.528528  346092 system_pods.go:61] "kube-controller-manager-ha-349588-m03" [c4531c53-f3ca-42ef-a58b-1c30e752607b] Running

	I0803 23:51:36.528530  346092 system_pods.go:61] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:51:36.528533  346092 system_pods.go:61] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:51:36.528537  346092 system_pods.go:61] "kube-proxy-gxhmd" [4781a85e-af7c-49c2-80fb-c85db217189e] Running

	I0803 23:51:36.528540  346092 system_pods.go:61] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:51:36.528543  346092 system_pods.go:61] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:51:36.528549  346092 system_pods.go:61] "kube-scheduler-ha-349588-m03" [49495c84-d655-44a6-b732-a3520fc9e4db] Running

	I0803 23:51:36.528552  346092 system_pods.go:61] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:51:36.528555  346092 system_pods.go:61] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:51:36.528558  346092 system_pods.go:61] "kube-vip-ha-349588-m03" [17db3ee6-75d6-44a2-b663-22eb669c3916] Running

	I0803 23:51:36.528561  346092 system_pods.go:61] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:51:36.528567  346092 system_pods.go:74] duration metric: took 185.106343ms to wait for pod list to return data ...

	I0803 23:51:36.528578  346092 default_sa.go:34] waiting for default service account to be created ...

	I0803 23:51:36.714053  346092 request.go:629] Waited for 185.392294ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:51:36.714147  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:51:36.714158  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.714167  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.714172  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.718328  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:36.718486  346092 default_sa.go:45] found service account: "default"

	I0803 23:51:36.718504  346092 default_sa.go:55] duration metric: took 189.92038ms for default service account to be created ...

	I0803 23:51:36.718512  346092 system_pods.go:116] waiting for k8s-apps to be running ...

	I0803 23:51:36.914027  346092 request.go:629] Waited for 195.407927ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.914096  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.914102  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.914112  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.914120  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.920598  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:36.927121  346092 system_pods.go:86] 24 kube-system pods found

	I0803 23:51:36.927158  346092 system_pods.go:89] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:51:36.927164  346092 system_pods.go:89] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:51:36.927168  346092 system_pods.go:89] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:51:36.927172  346092 system_pods.go:89] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:51:36.927176  346092 system_pods.go:89] "etcd-ha-349588-m03" [b94d4e04-56f0-4892-927a-346559af3711] Running

	I0803 23:51:36.927181  346092 system_pods.go:89] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:51:36.927185  346092 system_pods.go:89] "kindnet-7sr59" [09355fc1-1a86-4f3f-be39-4e2e315e679f] Running

	I0803 23:51:36.927189  346092 system_pods.go:89] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:51:36.927192  346092 system_pods.go:89] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:51:36.927196  346092 system_pods.go:89] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:51:36.927200  346092 system_pods.go:89] "kube-apiserver-ha-349588-m03" [fb835dfe-b2d1-49ea-be6a-1c2f2c682095] Running

	I0803 23:51:36.927205  346092 system_pods.go:89] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:51:36.927211  346092 system_pods.go:89] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:51:36.927217  346092 system_pods.go:89] "kube-controller-manager-ha-349588-m03" [c4531c53-f3ca-42ef-a58b-1c30e752607b] Running

	I0803 23:51:36.927222  346092 system_pods.go:89] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:51:36.927227  346092 system_pods.go:89] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:51:36.927233  346092 system_pods.go:89] "kube-proxy-gxhmd" [4781a85e-af7c-49c2-80fb-c85db217189e] Running

	I0803 23:51:36.927239  346092 system_pods.go:89] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:51:36.927246  346092 system_pods.go:89] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:51:36.927259  346092 system_pods.go:89] "kube-scheduler-ha-349588-m03" [49495c84-d655-44a6-b732-a3520fc9e4db] Running

	I0803 23:51:36.927264  346092 system_pods.go:89] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:51:36.927268  346092 system_pods.go:89] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:51:36.927275  346092 system_pods.go:89] "kube-vip-ha-349588-m03" [17db3ee6-75d6-44a2-b663-22eb669c3916] Running

	I0803 23:51:36.927285  346092 system_pods.go:89] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:51:36.927296  346092 system_pods.go:126] duration metric: took 208.777353ms to wait for k8s-apps to be running ...

	I0803 23:51:36.927304  346092 system_svc.go:44] waiting for kubelet service to be running ....

	I0803 23:51:36.927363  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:51:36.945526  346092 system_svc.go:56] duration metric: took 18.195559ms WaitForService to wait for kubelet

	I0803 23:51:36.945565  346092 kubeadm.go:582] duration metric: took 19.686733073s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:51:36.945591  346092 node_conditions.go:102] verifying NodePressure condition ...

	I0803 23:51:37.113811  346092 request.go:629] Waited for 168.118325ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes

	I0803 23:51:37.113911  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes

	I0803 23:51:37.113922  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:37.113934  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:37.113943  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:37.117855  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:37.119104  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:51:37.119131  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:51:37.119165  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:51:37.119171  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:51:37.119180  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:51:37.119185  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:51:37.119192  346092 node_conditions.go:105] duration metric: took 173.595468ms to run NodePressure ...

	I0803 23:51:37.119210  346092 start.go:241] waiting for startup goroutines ...

	I0803 23:51:37.119240  346092 start.go:255] writing updated cluster config ...

	I0803 23:51:37.119591  346092 ssh_runner.go:195] Run: rm -f paused

	I0803 23:51:37.173652  346092 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)

	I0803 23:51:37.175744  346092 out.go:177] * Done! kubectl is now configured to use "ha-349588" cluster and "default" namespace by default

	==> CRI-O <==

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.250591294Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729316250563177,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=2679dc69-de28-4dec-b02d-903e1b3669e9 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.251209418Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=25b38948-e505-49af-9878-93574e1e4ba7 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.251266254Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=25b38948-e505-49af-9878-93574e1e4ba7 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.251599533Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=25b38948-e505-49af-9878-93574e1e4ba7 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.294695344Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=3e44ef7d-5f4b-4141-a1ae-067336ed74b8 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.294794875Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=3e44ef7d-5f4b-4141-a1ae-067336ed74b8 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.296103535Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=a785295c-854c-4c75-a158-de1bb07d3796 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.296642974Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729316296618036,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=a785295c-854c-4c75-a158-de1bb07d3796 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.297151459Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=86f42afe-150d-45c8-b39d-ed29c4f1a4b5 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.297209200Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=86f42afe-150d-45c8-b39d-ed29c4f1a4b5 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.297497356Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=86f42afe-150d-45c8-b39d-ed29c4f1a4b5 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.340427560Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=8b64e77d-5e25-4947-b8b0-7c1a677eac88 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.340561621Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=8b64e77d-5e25-4947-b8b0-7c1a677eac88 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.342067640Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=c9d5a5da-6888-4058-9732-fca0a65cd29c name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.342910146Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729316342883669,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=c9d5a5da-6888-4058-9732-fca0a65cd29c name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.343602473Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=2079224b-9654-47be-8a33-11e621be0415 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.343657813Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=2079224b-9654-47be-8a33-11e621be0415 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.343883633Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=2079224b-9654-47be-8a33-11e621be0415 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.384705246Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=be426c5e-26a5-4cbb-815a-613dd6380f3e name=/runtime.v1.RuntimeService/Version

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.385108934Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=be426c5e-26a5-4cbb-815a-613dd6380f3e name=/runtime.v1.RuntimeService/Version

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.387762055Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=6e026de8-faf1-4996-ae63-e9ea5f389340 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.388242303Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729316388217403,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=6e026de8-faf1-4996-ae63-e9ea5f389340 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.388919659Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=a6c5de5c-bb0e-4792-84d3-84c6ce4567be name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.388981958Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=a6c5de5c-bb0e-4792-84d3-84c6ce4567be name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:55:16 ha-349588 crio[685]: time="2024-08-03 23:55:16.389426492Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=a6c5de5c-bb0e-4792-84d3-84c6ce4567be name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	c6fd002f59b0d       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   a2e2fb00f6b54       busybox-fc5497c4f-4mwk4

	ed4f0996565c3       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      5 minutes ago       Running             storage-provisioner       0                   c29d357fc68b0       storage-provisioner

	c780810d93e46       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      5 minutes ago       Running             coredns                   0                   37f34e1fe1b85       coredns-7db6d8ff4d-fzmtg

	81817890a62a6       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      5 minutes ago       Running             coredns                   0                   925c168e44d83       coredns-7db6d8ff4d-z8qt6

	8706b763ebe33       docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9    6 minutes ago       Running             kindnet-cni               0                   d2e5e2b102cd4       kindnet-2q4kc

	1f48d6d5328f8       55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1                                      6 minutes ago       Running             kube-proxy                0                   842c0109e8643       kube-proxy-bbzdt

	4f4a81f925548       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     6 minutes ago       Running             kube-vip                  0                   c58f6f98744c8       kube-vip-ha-349588

	9bd785365c881       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      6 minutes ago       Running             etcd                      0                   69dc19cc2bbff       etcd-ha-349588

	f061678087351       3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2                                      6 minutes ago       Running             kube-scheduler            0                   16e8a700bcd71       kube-scheduler-ha-349588

	c7a32eac14445       1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d                                      6 minutes ago       Running             kube-apiserver            0                   5d722be95195f       kube-apiserver-ha-349588

	1b3755f3d86ea       76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e                                      6 minutes ago       Running             kube-controller-manager   0                   b6a89d83c0aaf       kube-controller-manager-ha-349588

	==> coredns [81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87] <==

	[INFO] 10.244.0.4:58030 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146295s

	[INFO] 10.244.0.4:57522 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004292718s

	[INFO] 10.244.0.4:60466 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198733s

	[INFO] 10.244.0.4:45293 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002739449s

	[INFO] 10.244.0.4:50180 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129872s

	[INFO] 10.244.2.2:56181 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00186686s

	[INFO] 10.244.2.2:56701 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000166229s

	[INFO] 10.244.2.2:38728 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000109023s

	[INFO] 10.244.2.2:45155 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001333912s

	[INFO] 10.244.2.2:51605 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000083342s

	[INFO] 10.244.1.2:38219 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00015823s

	[INFO] 10.244.1.2:52488 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000178675s

	[INFO] 10.244.1.2:40148 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000097525s

	[INFO] 10.244.0.4:55438 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000074628s

	[INFO] 10.244.2.2:36883 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00010754s

	[INFO] 10.244.2.2:53841 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000090252s

	[INFO] 10.244.2.2:59602 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000092585s

	[INFO] 10.244.1.2:59266 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000147793s

	[INFO] 10.244.1.2:44530 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000122943s

	[INFO] 10.244.0.4:42192 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000097553s

	[INFO] 10.244.2.2:40701 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000172686s

	[INFO] 10.244.2.2:38338 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000166475s

	[INFO] 10.244.2.2:58001 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000140105s

	[INFO] 10.244.2.2:51129 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000105337s

	[INFO] 10.244.1.2:44130 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000106258s

	==> coredns [c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d] <==

	[INFO] 10.244.1.2:47738 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.000122865s

	[INFO] 10.244.1.2:35251 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.000545486s

	[INFO] 10.244.0.4:59904 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000165239s

	[INFO] 10.244.0.4:38273 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000132118s

	[INFO] 10.244.0.4:49517 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00021182s

	[INFO] 10.244.2.2:39556 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000137234s

	[INFO] 10.244.2.2:60582 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000141615s

	[INFO] 10.244.2.2:36052 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000074574s

	[INFO] 10.244.1.2:36007 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00019702s

	[INFO] 10.244.1.2:39746 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001827365s

	[INFO] 10.244.1.2:47114 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000078787s

	[INFO] 10.244.1.2:38856 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198841s

	[INFO] 10.244.1.2:49149 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001428046s

	[INFO] 10.244.0.4:47461 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000104433s

	[INFO] 10.244.0.4:47790 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000083369s

	[INFO] 10.244.0.4:39525 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000161056s

	[INFO] 10.244.2.2:58034 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000169362s

	[INFO] 10.244.1.2:44282 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000187567s

	[INFO] 10.244.1.2:48438 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00016257s

	[INFO] 10.244.0.4:52544 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000142962s

	[INFO] 10.244.0.4:41203 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000152657s

	[INFO] 10.244.0.4:45953 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00009439s

	[INFO] 10.244.1.2:57136 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000160618s

	[INFO] 10.244.1.2:58739 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000139508s

	[INFO] 10.244.1.2:50023 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000125422s

	==> describe nodes <==

	Name:               ha-349588

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_03T23_48_56_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:48:52 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:55:12 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:48:51 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:48:51 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:48:51 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:49:23 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.168

	  Hostname:    ha-349588

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 72ab11669b434797a5e41b5352f74be2

	  System UUID:                72ab1166-9b43-4797-a5e4-1b5352f74be2

	  Boot ID:                    e1637c60-2dbe-4ea9-949e-0f2b10f03d1b

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-4mwk4              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m38s

	  kube-system                 coredns-7db6d8ff4d-fzmtg             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m8s

	  kube-system                 coredns-7db6d8ff4d-z8qt6             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m8s

	  kube-system                 etcd-ha-349588                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m21s

	  kube-system                 kindnet-2q4kc                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m9s

	  kube-system                 kube-apiserver-ha-349588             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m22s

	  kube-system                 kube-controller-manager-ha-349588    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m23s

	  kube-system                 kube-proxy-bbzdt                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m9s

	  kube-system                 kube-scheduler-ha-349588             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m21s

	  kube-system                 kube-vip-ha-349588                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m21s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m7s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m7s   kube-proxy       

	  Normal  Starting                 6m22s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m21s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m21s  kubelet          Node ha-349588 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m21s  kubelet          Node ha-349588 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m21s  kubelet          Node ha-349588 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m9s   node-controller  Node ha-349588 event: Registered Node ha-349588 in Controller

	  Normal  NodeReady                5m53s  kubelet          Node ha-349588 status is now: NodeReady

	  Normal  RegisteredNode           4m57s  node-controller  Node ha-349588 event: Registered Node ha-349588 in Controller

	  Normal  RegisteredNode           3m45s  node-controller  Node ha-349588 event: Registered Node ha-349588 in Controller

	Name:               ha-349588-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_03T23_50_03_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:49:59 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588-m02

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:52:53 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.67

	  Hostname:    ha-349588-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 8919c8bcbd284472a3c4b5b3ae885051

	  System UUID:                8919c8bc-bd28-4472-a3c4-b5b3ae885051

	  Boot ID:                    000b155d-14ed-4044-bb42-b52680d7292c

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-szvhv                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m38s

	  kube-system                 etcd-ha-349588-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m14s

	  kube-system                 kindnet-zqhp6                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m16s

	  kube-system                 kube-apiserver-ha-349588-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m14s

	  kube-system                 kube-controller-manager-ha-349588-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m13s

	  kube-system                 kube-proxy-gbg5q                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m16s

	  kube-system                 kube-scheduler-ha-349588-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m15s

	  kube-system                 kube-vip-ha-349588-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m13s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m11s                  kube-proxy       

	  Normal  NodeAllocatableEnforced  5m17s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  5m16s (x8 over 5m17s)  kubelet          Node ha-349588-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m16s (x8 over 5m17s)  kubelet          Node ha-349588-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m16s (x7 over 5m17s)  kubelet          Node ha-349588-m02 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           5m14s                  node-controller  Node ha-349588-m02 event: Registered Node ha-349588-m02 in Controller

	  Normal  RegisteredNode           4m57s                  node-controller  Node ha-349588-m02 event: Registered Node ha-349588-m02 in Controller

	  Normal  RegisteredNode           3m45s                  node-controller  Node ha-349588-m02 event: Registered Node ha-349588-m02 in Controller

	  Normal  NodeNotReady             100s                   node-controller  Node ha-349588-m02 status is now: NodeNotReady

	Name:               ha-349588-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_03T23_51_17_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:51:12 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588-m03

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:55:07 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:12 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:12 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:12 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:30 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.79

	  Hostname:    ha-349588-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 43f3523f989d4c49bec19f93fe176e08

	  System UUID:                43f3523f-989d-4c49-bec1-9f93fe176e08

	  Boot ID:                    49cb00cd-1df4-4d0c-b32a-0575118d2aca

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-mlkx9                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m38s

	  kube-system                 etcd-ha-349588-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m2s

	  kube-system                 kindnet-7sr59                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m2s

	  kube-system                 kube-apiserver-ha-349588-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m2s

	  kube-system                 kube-controller-manager-ha-349588-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m54s

	  kube-system                 kube-proxy-gxhmd                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m4s

	  kube-system                 kube-scheduler-ha-349588-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m2s

	  kube-system                 kube-vip-ha-349588-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m1s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 3m58s                kube-proxy       

	  Normal  RegisteredNode           4m4s                 node-controller  Node ha-349588-m03 event: Registered Node ha-349588-m03 in Controller

	  Normal  NodeHasSufficientMemory  4m4s (x8 over 4m4s)  kubelet          Node ha-349588-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m4s (x8 over 4m4s)  kubelet          Node ha-349588-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m4s (x7 over 4m4s)  kubelet          Node ha-349588-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m4s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m2s                 node-controller  Node ha-349588-m03 event: Registered Node ha-349588-m03 in Controller

	  Normal  RegisteredNode           3m45s                node-controller  Node ha-349588-m03 event: Registered Node ha-349588-m03 in Controller

	Name:               ha-349588-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_03T23_52_17_0700

	                    minikube.k8s.io/version=v1.33.1

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:52:16 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588-m04

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:55:10 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:35 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.61

	  Hostname:    ha-349588-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 4ac9326af96243febea155e979b68343

	  System UUID:                4ac9326a-f962-43fe-bea1-55e979b68343

	  Boot ID:                    e2f3d546-daab-46ec-be7d-1fdf0a72df36

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-7rfzm       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m

	  kube-system                 kube-proxy-2sdf6    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age              From             Message

	  ----    ------                   ----             ----             -------

	  Normal  Starting                 2m55s            kube-proxy       

	  Normal  RegisteredNode           3m               node-controller  Node ha-349588-m04 event: Registered Node ha-349588-m04 in Controller

	  Normal  NodeHasSufficientMemory  3m (x2 over 3m)  kubelet          Node ha-349588-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m (x2 over 3m)  kubelet          Node ha-349588-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m (x2 over 3m)  kubelet          Node ha-349588-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m               kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m59s            node-controller  Node ha-349588-m04 event: Registered Node ha-349588-m04 in Controller

	  Normal  RegisteredNode           2m57s            node-controller  Node ha-349588-m04 event: Registered Node ha-349588-m04 in Controller

	  Normal  NodeReady                2m41s            kubelet          Node ha-349588-m04 status is now: NodeReady

	==> dmesg <==

	[Aug 3 23:48] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.051792] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.040861] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.793620] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.513980] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.584703] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[ +12.778088] systemd-fstab-generator[603]: Ignoring "noauto" option for root device

	[  +0.061103] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.063697] systemd-fstab-generator[615]: Ignoring "noauto" option for root device

	[  +0.170133] systemd-fstab-generator[629]: Ignoring "noauto" option for root device

	[  +0.139803] systemd-fstab-generator[641]: Ignoring "noauto" option for root device

	[  +0.274186] systemd-fstab-generator[670]: Ignoring "noauto" option for root device

	[  +4.334862] systemd-fstab-generator[769]: Ignoring "noauto" option for root device

	[  +0.066522] kauditd_printk_skb: 130 callbacks suppressed

	[  +4.414847] systemd-fstab-generator[950]: Ignoring "noauto" option for root device

	[  +0.686183] kauditd_printk_skb: 46 callbacks suppressed

	[  +6.066614] kauditd_printk_skb: 51 callbacks suppressed

	[  +0.504623] systemd-fstab-generator[1366]: Ignoring "noauto" option for root device

	[Aug 3 23:49] kauditd_printk_skb: 15 callbacks suppressed

	[ +15.728228] kauditd_printk_skb: 38 callbacks suppressed

	[  +9.925424] kauditd_printk_skb: 24 callbacks suppressed

	==> etcd [9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70] <==

	{"level":"warn","ts":"2024-08-03T23:55:16.585285Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.672029Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.683116Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.685849Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.690309Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.720552Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.729239Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.736466Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.740101Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.743302Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.752545Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.760408Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.7669Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.771953Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.775481Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.785463Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.788075Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.797755Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.808746Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.813437Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.817503Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.824012Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.832182Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.840204Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:55:16.885924Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 23:55:16 up 7 min,  0 users,  load average: 0.21, 0.29, 0.16

	Linux ha-349588 5.10.207 #1 SMP Mon Jul 29 15:19:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a] <==

	I0803 23:54:43.544002       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:54:53.547948       1 main.go:295] Handling node with IPs: map[192.168.39.168:{}]

	I0803 23:54:53.548040       1 main.go:299] handling current node

	I0803 23:54:53.548067       1 main.go:295] Handling node with IPs: map[192.168.39.67:{}]

	I0803 23:54:53.548085       1 main.go:322] Node ha-349588-m02 has CIDR [10.244.1.0/24] 

	I0803 23:54:53.548265       1 main.go:295] Handling node with IPs: map[192.168.39.79:{}]

	I0803 23:54:53.548288       1 main.go:322] Node ha-349588-m03 has CIDR [10.244.2.0/24] 

	I0803 23:54:53.548509       1 main.go:295] Handling node with IPs: map[192.168.39.61:{}]

	I0803 23:54:53.548554       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:55:03.552139       1 main.go:295] Handling node with IPs: map[192.168.39.168:{}]

	I0803 23:55:03.552186       1 main.go:299] handling current node

	I0803 23:55:03.552205       1 main.go:295] Handling node with IPs: map[192.168.39.67:{}]

	I0803 23:55:03.552211       1 main.go:322] Node ha-349588-m02 has CIDR [10.244.1.0/24] 

	I0803 23:55:03.552429       1 main.go:295] Handling node with IPs: map[192.168.39.79:{}]

	I0803 23:55:03.552452       1 main.go:322] Node ha-349588-m03 has CIDR [10.244.2.0/24] 

	I0803 23:55:03.552534       1 main.go:295] Handling node with IPs: map[192.168.39.61:{}]

	I0803 23:55:03.552554       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:55:13.542952       1 main.go:295] Handling node with IPs: map[192.168.39.67:{}]

	I0803 23:55:13.543121       1 main.go:322] Node ha-349588-m02 has CIDR [10.244.1.0/24] 

	I0803 23:55:13.543414       1 main.go:295] Handling node with IPs: map[192.168.39.79:{}]

	I0803 23:55:13.543478       1 main.go:322] Node ha-349588-m03 has CIDR [10.244.2.0/24] 

	I0803 23:55:13.543638       1 main.go:295] Handling node with IPs: map[192.168.39.61:{}]

	I0803 23:55:13.543675       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:55:13.543791       1 main.go:295] Handling node with IPs: map[192.168.39.168:{}]

	I0803 23:55:13.543823       1 main.go:299] handling current node

	==> kube-apiserver [c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35] <==

	W0803 23:48:53.926522       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.168]

	I0803 23:48:53.927634       1 controller.go:615] quota admission added evaluator for: endpoints

	I0803 23:48:53.932255       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0803 23:48:54.119070       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0803 23:48:55.111182       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0803 23:48:55.144783       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0803 23:48:55.170847       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0803 23:49:07.575208       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0803 23:49:08.182339       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E0803 23:51:41.064985       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49338: use of closed network connection

	E0803 23:51:41.285771       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49360: use of closed network connection

	E0803 23:51:41.481817       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49368: use of closed network connection

	E0803 23:51:41.673398       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49382: use of closed network connection

	E0803 23:51:41.860608       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49400: use of closed network connection

	E0803 23:51:42.066800       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49404: use of closed network connection

	E0803 23:51:42.265786       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49410: use of closed network connection

	E0803 23:51:42.477198       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49424: use of closed network connection

	E0803 23:51:42.661794       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49434: use of closed network connection

	E0803 23:51:42.962222       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49456: use of closed network connection

	E0803 23:51:43.153260       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49474: use of closed network connection

	E0803 23:51:43.341009       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49484: use of closed network connection

	E0803 23:51:43.542718       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49500: use of closed network connection

	E0803 23:51:43.745794       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55872: use of closed network connection

	E0803 23:51:43.941278       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55888: use of closed network connection

	W0803 23:53:03.929989       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.168 192.168.39.79]

	==> kube-controller-manager [1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2] <==

	I0803 23:51:12.392050       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-349588-m03\" does not exist"

	I0803 23:51:12.409979       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-349588-m03" podCIDRs=["10.244.2.0/24"]

	I0803 23:51:12.615890       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-349588-m03"

	I0803 23:51:38.099794       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="82.870305ms"

	I0803 23:51:38.149470       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="48.332864ms"

	I0803 23:51:38.150864       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="656.77µs"

	I0803 23:51:38.180131       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="84.73µs"

	I0803 23:51:38.336907       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="149.035867ms"

	I0803 23:51:38.494837       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="157.68925ms"

	I0803 23:51:38.552625       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="57.651091ms"

	I0803 23:51:38.552748       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="50.712µs"

	I0803 23:51:39.851012       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="38.989391ms"

	I0803 23:51:39.851245       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="90.684µs"

	I0803 23:51:39.955292       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="76.091µs"

	I0803 23:51:40.029088       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="11.487775ms"

	I0803 23:51:40.029453       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.265µs"

	I0803 23:51:40.582519       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="11.030815ms"

	I0803 23:51:40.582675       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="56.813µs"

	I0803 23:52:16.772216       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-349588-m04\" does not exist"

	I0803 23:52:16.799833       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-349588-m04" podCIDRs=["10.244.3.0/24"]

	I0803 23:52:17.978544       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-349588-m04"

	I0803 23:52:35.312225       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-349588-m04"

	I0803 23:53:36.959632       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-349588-m04"

	I0803 23:53:37.137008       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="11.48034ms"

	I0803 23:53:37.137626       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="59.676µs"

	==> kube-proxy [1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511] <==

	I0803 23:49:09.173626       1 server_linux.go:69] "Using iptables proxy"

	I0803 23:49:09.204726       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.168"]

	I0803 23:49:09.262456       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0803 23:49:09.262510       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0803 23:49:09.262529       1 server_linux.go:165] "Using iptables Proxier"

	I0803 23:49:09.265850       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0803 23:49:09.266449       1 server.go:872] "Version info" version="v1.30.3"

	I0803 23:49:09.266491       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0803 23:49:09.267962       1 config.go:192] "Starting service config controller"

	I0803 23:49:09.268231       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0803 23:49:09.268329       1 config.go:101] "Starting endpoint slice config controller"

	I0803 23:49:09.268413       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0803 23:49:09.270529       1 config.go:319] "Starting node config controller"

	I0803 23:49:09.270556       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0803 23:49:09.369309       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0803 23:49:09.369490       1 shared_informer.go:320] Caches are synced for service config

	I0803 23:49:09.372278       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802] <==

	W0803 23:48:53.304668       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0803 23:48:53.304715       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0803 23:48:53.354479       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0803 23:48:53.354578       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0803 23:48:53.485317       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0803 23:48:53.485445       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0803 23:48:53.514811       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0803 23:48:53.514858       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0803 23:48:55.773274       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0803 23:51:12.541229       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-6mxhx\": pod kube-proxy-6mxhx is already assigned to node \"ha-349588-m03\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-6mxhx" node="ha-349588-m03"

	E0803 23:51:12.542506       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod e0f96924-b772-456b-b2f6-698af8e94038(kube-system/kube-proxy-6mxhx) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-6mxhx"

	E0803 23:51:12.543622       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-6mxhx\": pod kube-proxy-6mxhx is already assigned to node \"ha-349588-m03\"" pod="kube-system/kube-proxy-6mxhx"

	I0803 23:51:12.543720       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-6mxhx" node="ha-349588-m03"

	E0803 23:52:16.874914       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-7rfzm\": pod kindnet-7rfzm is already assigned to node \"ha-349588-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-7rfzm" node="ha-349588-m04"

	E0803 23:52:16.875424       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod b882822a-1717-446e-9816-b0d709515f5a(kube-system/kindnet-7rfzm) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-7rfzm"

	E0803 23:52:16.876997       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-7rfzm\": pod kindnet-7rfzm is already assigned to node \"ha-349588-m04\"" pod="kube-system/kindnet-7rfzm"

	I0803 23:52:16.877333       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-7rfzm" node="ha-349588-m04"

	E0803 23:52:16.874987       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-2sdf6\": pod kube-proxy-2sdf6 is already assigned to node \"ha-349588-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-2sdf6" node="ha-349588-m04"

	E0803 23:52:16.878219       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 2c41bdec-3f55-4626-9c5b-b757faed7907(kube-system/kube-proxy-2sdf6) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-2sdf6"

	E0803 23:52:16.878316       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-2sdf6\": pod kube-proxy-2sdf6 is already assigned to node \"ha-349588-m04\"" pod="kube-system/kube-proxy-2sdf6"

	I0803 23:52:16.878440       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-2sdf6" node="ha-349588-m04"

	E0803 23:52:17.021480       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-6rctf\": pod kube-proxy-6rctf is already assigned to node \"ha-349588-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-6rctf" node="ha-349588-m04"

	E0803 23:52:17.021686       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 22d8b275-6e92-4f89-85b5-5138eb55855b(kube-system/kube-proxy-6rctf) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-6rctf"

	E0803 23:52:17.021811       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-6rctf\": pod kube-proxy-6rctf is already assigned to node \"ha-349588-m04\"" pod="kube-system/kube-proxy-6rctf"

	I0803 23:52:17.022047       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-6rctf" node="ha-349588-m04"

	==> kubelet <==

	Aug 03 23:50:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:50:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:50:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:51:38 ha-349588 kubelet[1373]: I0803 23:51:38.109289    1373 topology_manager.go:215] "Topology Admit Handler" podUID="a1f7a988-c439-426d-87ef-876b33660835" podNamespace="default" podName="busybox-fc5497c4f-4mwk4"

	Aug 03 23:51:38 ha-349588 kubelet[1373]: I0803 23:51:38.153663    1373 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lr5c\" (UniqueName: \"kubernetes.io/projected/a1f7a988-c439-426d-87ef-876b33660835-kube-api-access-9lr5c\") pod \"busybox-fc5497c4f-4mwk4\" (UID: \"a1f7a988-c439-426d-87ef-876b33660835\") " pod="default/busybox-fc5497c4f-4mwk4"

	Aug 03 23:51:55 ha-349588 kubelet[1373]: E0803 23:51:55.143837    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:51:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:51:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:51:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:51:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:52:55 ha-349588 kubelet[1373]: E0803 23:52:55.144049    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:52:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:52:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:52:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:52:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:53:55 ha-349588 kubelet[1373]: E0803 23:53:55.154670    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:53:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:53:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:53:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:53:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:54:55 ha-349588 kubelet[1373]: E0803 23:54:55.142276    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:54:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:54:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:54:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:54:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-349588 -n ha-349588

helpers_test.go:261: (dbg) Run:  kubectl --context ha-349588 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (142.03s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 node start m02 -v=7 --alsologtostderr

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (3.20659362s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:55:21.475673  350953 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:55:21.475805  350953 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:21.475813  350953 out.go:304] Setting ErrFile to fd 2...

	I0803 23:55:21.475818  350953 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:21.476019  350953 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:55:21.476176  350953 out.go:298] Setting JSON to false

	I0803 23:55:21.476205  350953 mustload.go:65] Loading cluster: ha-349588

	I0803 23:55:21.476316  350953 notify.go:220] Checking for updates...

	I0803 23:55:21.476621  350953 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:55:21.476644  350953 status.go:255] checking status of ha-349588 ...

	I0803 23:55:21.477097  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:21.477173  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:21.498102  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39669

	I0803 23:55:21.498566  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:21.499220  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:21.499252  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:21.499754  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:21.499992  350953 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:55:21.501863  350953 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:55:21.501879  350953 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:21.502245  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:21.502289  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:21.518804  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33993

	I0803 23:55:21.519280  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:21.519821  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:21.519864  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:21.520305  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:21.520508  350953 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:55:21.523524  350953 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:21.523878  350953 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:21.523906  350953 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:21.524025  350953 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:21.524384  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:21.524430  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:21.540216  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34619

	I0803 23:55:21.540758  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:21.541274  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:21.541299  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:21.541709  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:21.541914  350953 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:55:21.542106  350953 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:21.542132  350953 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:55:21.544886  350953 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:21.545353  350953 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:21.545383  350953 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:21.545539  350953 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:55:21.545729  350953 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:55:21.545893  350953 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:55:21.546060  350953 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:55:21.626212  350953 ssh_runner.go:195] Run: systemctl --version

	I0803 23:55:21.633248  350953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:21.648943  350953 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:21.648985  350953 api_server.go:166] Checking apiserver status ...

	I0803 23:55:21.649022  350953 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:21.664483  350953 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:55:21.674623  350953 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:21.674680  350953 ssh_runner.go:195] Run: ls

	I0803 23:55:21.679563  350953 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:21.686513  350953 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:21.686544  350953 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:55:21.686557  350953 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:21.686578  350953 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:55:21.686906  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:21.686950  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:21.702824  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34757

	I0803 23:55:21.703321  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:21.703857  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:21.703880  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:21.704245  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:21.704480  350953 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:55:21.706198  350953 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:55:21.706215  350953 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:21.706558  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:21.706606  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:21.723383  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34071

	I0803 23:55:21.723935  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:21.724485  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:21.724511  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:21.724871  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:21.725084  350953 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:55:21.727987  350953 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:21.728386  350953 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:21.728417  350953 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:21.728544  350953 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:21.728885  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:21.728937  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:21.744655  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44219

	I0803 23:55:21.745077  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:21.745561  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:21.745581  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:21.745923  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:21.746129  350953 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:55:21.746339  350953 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:21.746363  350953 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:55:21.749412  350953 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:21.749849  350953 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:21.749873  350953 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:21.750067  350953 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:55:21.750254  350953 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:55:21.750413  350953 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:55:21.750569  350953 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:24.269866  350953 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:24.270014  350953 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:24.270040  350953 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:24.270052  350953 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:24.270092  350953 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:24.270104  350953 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:24.270443  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:24.270500  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:24.286405  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40733

	I0803 23:55:24.286867  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:24.287413  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:24.287438  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:24.287775  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:24.288006  350953 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:24.289704  350953 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:24.289725  350953 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:24.290038  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:24.290082  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:24.305599  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44301

	I0803 23:55:24.306103  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:24.306684  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:24.306708  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:24.307028  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:24.307213  350953 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:24.309951  350953 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:24.310451  350953 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:24.310485  350953 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:24.310665  350953 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:24.311016  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:24.311065  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:24.326985  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36695

	I0803 23:55:24.327548  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:24.328062  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:24.328086  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:24.328397  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:24.328590  350953 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:24.328760  350953 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:24.328795  350953 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:24.331541  350953 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:24.331992  350953 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:24.332022  350953 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:24.332199  350953 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:24.332412  350953 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:24.332611  350953 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:24.332781  350953 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:24.421328  350953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:24.439279  350953 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:24.439322  350953 api_server.go:166] Checking apiserver status ...

	I0803 23:55:24.439366  350953 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:24.453636  350953 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:24.463648  350953 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:24.463715  350953 ssh_runner.go:195] Run: ls

	I0803 23:55:24.468282  350953 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:24.472882  350953 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:24.472912  350953 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:24.472921  350953 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:24.472939  350953 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:24.473242  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:24.473280  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:24.489967  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33759

	I0803 23:55:24.490442  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:24.490887  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:24.490906  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:24.491232  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:24.491450  350953 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:24.493106  350953 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:24.493122  350953 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:24.493475  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:24.493536  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:24.510058  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43817

	I0803 23:55:24.510586  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:24.511124  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:24.511152  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:24.511495  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:24.511742  350953 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:24.514686  350953 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:24.515122  350953 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:24.515166  350953 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:24.515267  350953 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:24.515731  350953 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:24.515772  350953 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:24.531507  350953 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42923

	I0803 23:55:24.531991  350953 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:24.532427  350953 main.go:141] libmachine: Using API Version  1

	I0803 23:55:24.532449  350953 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:24.532718  350953 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:24.532871  350953 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:24.533061  350953 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:24.533084  350953 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:24.535640  350953 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:24.536165  350953 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:24.536194  350953 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:24.536339  350953 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:24.536525  350953 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:24.536689  350953 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:24.536833  350953 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:24.621811  350953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:24.636961  350953 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (4.865283924s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:55:26.134555  351037 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:55:26.135222  351037 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:26.135289  351037 out.go:304] Setting ErrFile to fd 2...

	I0803 23:55:26.135310  351037 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:26.135756  351037 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:55:26.136323  351037 out.go:298] Setting JSON to false

	I0803 23:55:26.136361  351037 mustload.go:65] Loading cluster: ha-349588

	I0803 23:55:26.136475  351037 notify.go:220] Checking for updates...

	I0803 23:55:26.136762  351037 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:55:26.136778  351037 status.go:255] checking status of ha-349588 ...

	I0803 23:55:26.137260  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:26.137351  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:26.152734  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41243

	I0803 23:55:26.153209  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:26.154072  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:26.154106  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:26.154463  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:26.154726  351037 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:55:26.156527  351037 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:55:26.156549  351037 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:26.156964  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:26.157022  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:26.172618  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33337

	I0803 23:55:26.173092  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:26.173606  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:26.173630  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:26.173949  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:26.174143  351037 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:55:26.177107  351037 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:26.177651  351037 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:26.177682  351037 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:26.177858  351037 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:26.178179  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:26.178227  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:26.194214  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33681

	I0803 23:55:26.194704  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:26.195378  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:26.195416  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:26.195805  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:26.196027  351037 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:55:26.196259  351037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:26.196292  351037 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:55:26.199650  351037 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:26.200223  351037 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:26.200250  351037 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:26.200407  351037 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:55:26.200619  351037 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:55:26.200806  351037 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:55:26.201066  351037 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:55:26.277669  351037 ssh_runner.go:195] Run: systemctl --version

	I0803 23:55:26.284079  351037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:26.299086  351037 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:26.299122  351037 api_server.go:166] Checking apiserver status ...

	I0803 23:55:26.299170  351037 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:26.313781  351037 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:55:26.324149  351037 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:26.324218  351037 ssh_runner.go:195] Run: ls

	I0803 23:55:26.328831  351037 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:26.333105  351037 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:26.333134  351037 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:55:26.333145  351037 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:26.333170  351037 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:55:26.333488  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:26.333545  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:26.349483  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37289

	I0803 23:55:26.350019  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:26.350587  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:26.350608  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:26.350901  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:26.351084  351037 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:55:26.352605  351037 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:55:26.352625  351037 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:26.352923  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:26.352959  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:26.371781  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34693

	I0803 23:55:26.372283  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:26.372802  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:26.372822  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:26.373236  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:26.373447  351037 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:55:26.376504  351037 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:26.377002  351037 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:26.377051  351037 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:26.377176  351037 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:26.377550  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:26.377601  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:26.393083  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45193

	I0803 23:55:26.393649  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:26.394169  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:26.394201  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:26.394558  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:26.394794  351037 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:55:26.395009  351037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:26.395039  351037 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:55:26.397909  351037 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:26.398344  351037 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:26.398384  351037 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:26.398525  351037 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:55:26.398703  351037 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:55:26.398871  351037 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:55:26.398999  351037 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:27.341795  351037 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:27.341852  351037 retry.go:31] will retry after 177.214341ms: dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:30.573789  351037 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:30.573894  351037 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:30.573912  351037 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:30.573920  351037 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:30.573941  351037 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:30.573948  351037 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:30.574312  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:30.574365  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:30.590184  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34029

	I0803 23:55:30.590601  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:30.591122  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:30.591142  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:30.591490  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:30.591708  351037 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:30.593585  351037 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:30.593608  351037 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:30.593924  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:30.593960  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:30.609341  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42135

	I0803 23:55:30.609786  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:30.610344  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:30.610370  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:30.610713  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:30.610999  351037 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:30.613879  351037 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:30.614343  351037 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:30.614365  351037 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:30.614494  351037 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:30.614802  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:30.614841  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:30.633092  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44521

	I0803 23:55:30.633560  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:30.634119  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:30.634150  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:30.634460  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:30.634636  351037 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:30.634856  351037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:30.634884  351037 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:30.637756  351037 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:30.638156  351037 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:30.638198  351037 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:30.638302  351037 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:30.638483  351037 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:30.638610  351037 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:30.638720  351037 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:30.728565  351037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:30.752437  351037 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:30.752477  351037 api_server.go:166] Checking apiserver status ...

	I0803 23:55:30.752524  351037 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:30.769338  351037 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:30.779541  351037 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:30.779610  351037 ssh_runner.go:195] Run: ls

	I0803 23:55:30.784446  351037 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:30.789029  351037 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:30.789058  351037 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:30.789068  351037 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:30.789084  351037 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:30.789432  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:30.789473  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:30.805451  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43727

	I0803 23:55:30.805962  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:30.806659  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:30.806694  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:30.807071  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:30.807312  351037 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:30.808917  351037 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:30.808937  351037 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:30.809269  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:30.809317  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:30.826563  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40759

	I0803 23:55:30.827072  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:30.827716  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:30.827746  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:30.828092  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:30.828294  351037 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:30.831229  351037 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:30.831639  351037 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:30.831675  351037 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:30.831878  351037 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:30.832183  351037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:30.832223  351037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:30.847519  351037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37353

	I0803 23:55:30.848032  351037 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:30.848524  351037 main.go:141] libmachine: Using API Version  1

	I0803 23:55:30.848548  351037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:30.848974  351037 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:30.849166  351037 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:30.849385  351037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:30.849408  351037 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:30.852233  351037 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:30.852617  351037 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:30.852646  351037 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:30.852805  351037 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:30.852998  351037 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:30.853160  351037 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:30.853305  351037 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:30.937324  351037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:30.953784  351037 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (4.963126445s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:55:32.165443  351153 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:55:32.165593  351153 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:32.165605  351153 out.go:304] Setting ErrFile to fd 2...

	I0803 23:55:32.165611  351153 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:32.165814  351153 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:55:32.166028  351153 out.go:298] Setting JSON to false

	I0803 23:55:32.166063  351153 mustload.go:65] Loading cluster: ha-349588

	I0803 23:55:32.166188  351153 notify.go:220] Checking for updates...

	I0803 23:55:32.166567  351153 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:55:32.166589  351153 status.go:255] checking status of ha-349588 ...

	I0803 23:55:32.167077  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:32.167155  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:32.185184  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38079

	I0803 23:55:32.185679  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:32.186312  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:32.186335  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:32.186770  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:32.186980  351153 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:55:32.188657  351153 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:55:32.188679  351153 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:32.189110  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:32.189161  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:32.204510  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32983

	I0803 23:55:32.204969  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:32.205574  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:32.205614  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:32.205936  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:32.206143  351153 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:55:32.208637  351153 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:32.209038  351153 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:32.209069  351153 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:32.209223  351153 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:32.209584  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:32.209630  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:32.225303  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34921

	I0803 23:55:32.225750  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:32.226277  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:32.226298  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:32.226653  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:32.226859  351153 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:55:32.227097  351153 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:32.227134  351153 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:55:32.230151  351153 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:32.230589  351153 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:32.230629  351153 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:32.230789  351153 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:55:32.231002  351153 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:55:32.231167  351153 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:55:32.231357  351153 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:55:32.310256  351153 ssh_runner.go:195] Run: systemctl --version

	I0803 23:55:32.316822  351153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:32.332812  351153 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:32.332848  351153 api_server.go:166] Checking apiserver status ...

	I0803 23:55:32.332894  351153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:32.348500  351153 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:55:32.359871  351153 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:32.359942  351153 ssh_runner.go:195] Run: ls

	I0803 23:55:32.364661  351153 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:32.371088  351153 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:32.371121  351153 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:55:32.371140  351153 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:32.371164  351153 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:55:32.371506  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:32.371549  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:32.387518  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39429

	I0803 23:55:32.388056  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:32.388527  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:32.388550  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:32.388866  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:32.389051  351153 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:55:32.390517  351153 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:55:32.390535  351153 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:32.390835  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:32.390875  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:32.407640  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33071

	I0803 23:55:32.408088  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:32.408574  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:32.408596  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:32.408897  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:32.409124  351153 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:55:32.412246  351153 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:32.412720  351153 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:32.412758  351153 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:32.412903  351153 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:32.413267  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:32.413311  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:32.429196  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39585

	I0803 23:55:32.429664  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:32.430162  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:32.430207  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:32.430639  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:32.430849  351153 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:55:32.431071  351153 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:32.431095  351153 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:55:32.433799  351153 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:32.434211  351153 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:32.434241  351153 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:32.434390  351153 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:55:32.434589  351153 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:55:32.434780  351153 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:55:32.434948  351153 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:33.645807  351153 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:33.645873  351153 retry.go:31] will retry after 272.49385ms: dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:36.718067  351153 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:36.718173  351153 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:36.718208  351153 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:36.718219  351153 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:36.718268  351153 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:36.718282  351153 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:36.718716  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:36.718779  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:36.734542  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43819

	I0803 23:55:36.735051  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:36.735545  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:36.735577  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:36.735899  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:36.736070  351153 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:36.737788  351153 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:36.737823  351153 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:36.738137  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:36.738173  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:36.753618  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45839

	I0803 23:55:36.754073  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:36.754576  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:36.754596  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:36.754972  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:36.755208  351153 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:36.758371  351153 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:36.758938  351153 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:36.758982  351153 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:36.759281  351153 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:36.759719  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:36.759766  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:36.775723  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43257

	I0803 23:55:36.776220  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:36.776736  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:36.776758  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:36.777067  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:36.777252  351153 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:36.777446  351153 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:36.777467  351153 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:36.780238  351153 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:36.780584  351153 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:36.780619  351153 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:36.780787  351153 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:36.780963  351153 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:36.781139  351153 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:36.781258  351153 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:36.865334  351153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:36.882046  351153 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:36.882080  351153 api_server.go:166] Checking apiserver status ...

	I0803 23:55:36.882120  351153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:36.897084  351153 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:36.907669  351153 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:36.907743  351153 ssh_runner.go:195] Run: ls

	I0803 23:55:36.912672  351153 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:36.919236  351153 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:36.919267  351153 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:36.919276  351153 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:36.919293  351153 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:36.919601  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:36.919651  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:36.936005  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41667

	I0803 23:55:36.936535  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:36.937106  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:36.937129  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:36.937462  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:36.937740  351153 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:36.939524  351153 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:36.939545  351153 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:36.939862  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:36.939918  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:36.954989  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40739

	I0803 23:55:36.955422  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:36.955894  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:36.955919  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:36.956252  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:36.956452  351153 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:36.959430  351153 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:36.959784  351153 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:36.959821  351153 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:36.959967  351153 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:36.960345  351153 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:36.960387  351153 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:36.978335  351153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37665

	I0803 23:55:36.978743  351153 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:36.979244  351153 main.go:141] libmachine: Using API Version  1

	I0803 23:55:36.979266  351153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:36.979577  351153 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:36.979782  351153 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:36.980004  351153 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:36.980026  351153 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:36.982842  351153 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:36.983326  351153 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:36.983352  351153 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:36.983510  351153 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:36.983700  351153 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:36.983836  351153 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:36.983972  351153 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:37.065580  351153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:37.082423  351153 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (4.927408736s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:55:38.345142  351252 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:55:38.345414  351252 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:38.345425  351252 out.go:304] Setting ErrFile to fd 2...

	I0803 23:55:38.345431  351252 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:38.345725  351252 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:55:38.345970  351252 out.go:298] Setting JSON to false

	I0803 23:55:38.346004  351252 mustload.go:65] Loading cluster: ha-349588

	I0803 23:55:38.346055  351252 notify.go:220] Checking for updates...

	I0803 23:55:38.346384  351252 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:55:38.346399  351252 status.go:255] checking status of ha-349588 ...

	I0803 23:55:38.346765  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:38.346836  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:38.364588  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43413

	I0803 23:55:38.365085  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:38.365669  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:38.365693  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:38.366163  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:38.366388  351252 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:55:38.367972  351252 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:55:38.367993  351252 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:38.368315  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:38.368367  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:38.384469  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38109

	I0803 23:55:38.384948  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:38.385413  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:38.385434  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:38.385877  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:38.386097  351252 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:55:38.388876  351252 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:38.389285  351252 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:38.389314  351252 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:38.389472  351252 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:38.389875  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:38.389924  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:38.406703  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33635

	I0803 23:55:38.407133  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:38.407601  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:38.407624  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:38.407993  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:38.408193  351252 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:55:38.408406  351252 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:38.408434  351252 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:55:38.411176  351252 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:38.411633  351252 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:38.411662  351252 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:38.411805  351252 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:55:38.411993  351252 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:55:38.412120  351252 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:55:38.412259  351252 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:55:38.491285  351252 ssh_runner.go:195] Run: systemctl --version

	I0803 23:55:38.501110  351252 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:38.520671  351252 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:38.520709  351252 api_server.go:166] Checking apiserver status ...

	I0803 23:55:38.520754  351252 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:38.536683  351252 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:55:38.547488  351252 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:38.547552  351252 ssh_runner.go:195] Run: ls

	I0803 23:55:38.552157  351252 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:38.556990  351252 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:38.557021  351252 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:55:38.557032  351252 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:38.557049  351252 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:55:38.557365  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:38.557406  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:38.573721  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39497

	I0803 23:55:38.574176  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:38.574736  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:38.574761  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:38.575077  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:38.575286  351252 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:55:38.577152  351252 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:55:38.577171  351252 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:38.577598  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:38.577646  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:38.593696  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42881

	I0803 23:55:38.594168  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:38.594668  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:38.594690  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:38.595047  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:38.595233  351252 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:55:38.598670  351252 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:38.599140  351252 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:38.599168  351252 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:38.599343  351252 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:38.599654  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:38.599692  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:38.615408  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37435

	I0803 23:55:38.615890  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:38.616473  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:38.616506  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:38.616871  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:38.617096  351252 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:55:38.617352  351252 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:38.617381  351252 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:55:38.620245  351252 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:38.620630  351252 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:38.620652  351252 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:38.620809  351252 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:55:38.620990  351252 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:55:38.621151  351252 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:55:38.621295  351252 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:39.789899  351252 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:39.789976  351252 retry.go:31] will retry after 353.309069ms: dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:42.861911  351252 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:42.862045  351252 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:42.862074  351252 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:42.862085  351252 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:42.862112  351252 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:42.862125  351252 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:42.862453  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:42.862526  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:42.878938  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33077

	I0803 23:55:42.879485  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:42.880101  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:42.880142  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:42.880771  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:42.881014  351252 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:42.882676  351252 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:42.882695  351252 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:42.883188  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:42.883234  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:42.899412  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35959

	I0803 23:55:42.899931  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:42.900502  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:42.900524  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:42.900833  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:42.901016  351252 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:42.903767  351252 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:42.904332  351252 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:42.904361  351252 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:42.904573  351252 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:42.904933  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:42.904978  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:42.921480  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34405

	I0803 23:55:42.921931  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:42.922468  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:42.922502  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:42.922876  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:42.923074  351252 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:42.923292  351252 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:42.923332  351252 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:42.926433  351252 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:42.926961  351252 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:42.926995  351252 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:42.927121  351252 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:42.927310  351252 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:42.927444  351252 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:42.927607  351252 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:43.013724  351252 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:43.030777  351252 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:43.030808  351252 api_server.go:166] Checking apiserver status ...

	I0803 23:55:43.030865  351252 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:43.045724  351252 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:43.056258  351252 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:43.056330  351252 ssh_runner.go:195] Run: ls

	I0803 23:55:43.061599  351252 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:43.066365  351252 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:43.066402  351252 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:43.066415  351252 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:43.066439  351252 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:43.066782  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:43.066826  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:43.082919  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44271

	I0803 23:55:43.083439  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:43.083930  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:43.083955  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:43.084292  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:43.084503  351252 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:43.086210  351252 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:43.086230  351252 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:43.086660  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:43.086710  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:43.102927  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36661

	I0803 23:55:43.103466  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:43.104025  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:43.104069  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:43.104473  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:43.104658  351252 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:43.107852  351252 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:43.108309  351252 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:43.108334  351252 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:43.108509  351252 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:43.108826  351252 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:43.108870  351252 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:43.124356  351252 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40147

	I0803 23:55:43.124831  351252 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:43.125404  351252 main.go:141] libmachine: Using API Version  1

	I0803 23:55:43.125434  351252 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:43.125841  351252 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:43.126031  351252 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:43.126269  351252 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:43.126298  351252 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:43.129116  351252 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:43.129591  351252 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:43.129616  351252 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:43.129753  351252 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:43.129956  351252 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:43.130126  351252 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:43.130280  351252 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:43.209972  351252 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:43.226708  351252 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (3.771744192s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:55:48.279144  351369 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:55:48.279425  351369 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:48.279436  351369 out.go:304] Setting ErrFile to fd 2...

	I0803 23:55:48.279441  351369 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:48.279647  351369 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:55:48.279843  351369 out.go:298] Setting JSON to false

	I0803 23:55:48.279880  351369 mustload.go:65] Loading cluster: ha-349588

	I0803 23:55:48.280012  351369 notify.go:220] Checking for updates...

	I0803 23:55:48.280450  351369 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:55:48.280475  351369 status.go:255] checking status of ha-349588 ...

	I0803 23:55:48.281007  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:48.281063  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:48.302347  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42333

	I0803 23:55:48.302938  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:48.303632  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:48.303683  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:48.304117  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:48.304348  351369 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:55:48.306284  351369 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:55:48.306307  351369 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:48.306721  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:48.306796  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:48.322221  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44127

	I0803 23:55:48.322711  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:48.323341  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:48.323370  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:48.323737  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:48.323970  351369 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:55:48.326876  351369 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:48.327342  351369 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:48.327373  351369 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:48.327453  351369 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:48.327781  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:48.327833  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:48.343629  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32877

	I0803 23:55:48.344053  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:48.344542  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:48.344573  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:48.344949  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:48.345169  351369 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:55:48.345379  351369 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:48.345429  351369 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:55:48.348411  351369 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:48.348868  351369 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:48.348904  351369 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:48.349032  351369 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:55:48.349233  351369 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:55:48.349417  351369 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:55:48.349618  351369 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:55:48.429722  351369 ssh_runner.go:195] Run: systemctl --version

	I0803 23:55:48.436637  351369 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:48.451430  351369 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:48.451464  351369 api_server.go:166] Checking apiserver status ...

	I0803 23:55:48.451500  351369 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:48.467003  351369 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:55:48.477709  351369 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:48.477773  351369 ssh_runner.go:195] Run: ls

	I0803 23:55:48.482416  351369 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:48.486824  351369 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:48.486846  351369 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:55:48.486856  351369 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:48.486871  351369 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:55:48.487196  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:48.487235  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:48.503212  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45867

	I0803 23:55:48.503771  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:48.504372  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:48.504399  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:48.504790  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:48.505036  351369 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:55:48.506775  351369 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:55:48.506792  351369 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:48.507123  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:48.507158  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:48.522467  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34971

	I0803 23:55:48.522941  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:48.523497  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:48.523524  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:48.523902  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:48.524118  351369 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:55:48.526922  351369 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:48.527371  351369 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:48.527394  351369 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:48.527545  351369 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:48.527947  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:48.528000  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:48.544240  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34801

	I0803 23:55:48.544696  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:48.545241  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:48.545262  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:48.545591  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:48.545786  351369 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:55:48.545946  351369 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:48.545962  351369 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:55:48.548851  351369 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:48.549297  351369 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:48.549334  351369 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:48.549550  351369 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:55:48.549744  351369 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:55:48.549931  351369 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:55:48.550070  351369 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:51.633791  351369 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:51.633888  351369 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:51.633908  351369 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:51.633919  351369 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:51.633948  351369 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:51.633959  351369 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:51.634431  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:51.634509  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:51.651705  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36241

	I0803 23:55:51.652250  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:51.652775  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:51.652801  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:51.653094  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:51.653333  351369 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:51.655037  351369 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:51.655056  351369 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:51.655350  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:51.655392  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:51.671187  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38299

	I0803 23:55:51.671727  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:51.672218  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:51.672238  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:51.672558  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:51.672777  351369 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:51.675876  351369 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:51.676379  351369 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:51.676406  351369 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:51.676551  351369 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:51.676908  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:51.676960  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:51.693396  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35277

	I0803 23:55:51.693949  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:51.694458  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:51.694480  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:51.694783  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:51.694948  351369 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:51.695116  351369 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:51.695136  351369 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:51.698192  351369 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:51.698676  351369 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:51.698711  351369 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:51.698884  351369 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:51.699097  351369 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:51.699235  351369 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:51.699362  351369 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:51.791745  351369 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:51.809487  351369 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:51.809551  351369 api_server.go:166] Checking apiserver status ...

	I0803 23:55:51.809594  351369 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:51.825497  351369 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:51.836751  351369 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:51.836822  351369 ssh_runner.go:195] Run: ls

	I0803 23:55:51.841526  351369 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:51.846023  351369 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:51.846049  351369 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:51.846061  351369 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:51.846082  351369 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:51.846399  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:51.846445  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:51.862215  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33591

	I0803 23:55:51.862725  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:51.863220  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:51.863243  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:51.863616  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:51.863848  351369 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:51.865709  351369 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:51.865734  351369 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:51.866021  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:51.866061  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:51.882200  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33523

	I0803 23:55:51.882685  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:51.883189  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:51.883244  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:51.883593  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:51.883846  351369 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:51.886769  351369 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:51.887188  351369 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:51.887215  351369 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:51.887410  351369 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:51.887831  351369 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:51.887886  351369 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:51.903287  351369 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38089

	I0803 23:55:51.903725  351369 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:51.904213  351369 main.go:141] libmachine: Using API Version  1

	I0803 23:55:51.904235  351369 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:51.904577  351369 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:51.904795  351369 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:51.904996  351369 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:51.905025  351369 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:51.908007  351369 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:51.908446  351369 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:51.908477  351369 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:51.908606  351369 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:51.908806  351369 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:51.908955  351369 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:51.909124  351369 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:51.989185  351369 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:52.004522  351369 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 3 (3.757555583s)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:55:56.024893  351470 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:55:56.025055  351470 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:56.025065  351470 out.go:304] Setting ErrFile to fd 2...

	I0803 23:55:56.025070  351470 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:55:56.025346  351470 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:55:56.025620  351470 out.go:298] Setting JSON to false

	I0803 23:55:56.025663  351470 mustload.go:65] Loading cluster: ha-349588

	I0803 23:55:56.025713  351470 notify.go:220] Checking for updates...

	I0803 23:55:56.026127  351470 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:55:56.026146  351470 status.go:255] checking status of ha-349588 ...

	I0803 23:55:56.026592  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:56.026654  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:56.042582  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44525

	I0803 23:55:56.043034  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:56.043704  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:56.043740  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:56.044114  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:56.044320  351470 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:55:56.046019  351470 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:55:56.046041  351470 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:56.046337  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:56.046375  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:56.063319  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40665

	I0803 23:55:56.063792  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:56.064303  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:56.064329  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:56.064620  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:56.064859  351470 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:55:56.067835  351470 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:56.068412  351470 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:56.068472  351470 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:56.068701  351470 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:55:56.069125  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:56.069186  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:56.084948  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40165

	I0803 23:55:56.085430  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:56.085962  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:56.085981  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:56.086336  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:56.086538  351470 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:55:56.086759  351470 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:56.086807  351470 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:55:56.089784  351470 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:56.090186  351470 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:55:56.090208  351470 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:55:56.090341  351470 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:55:56.090543  351470 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:55:56.090710  351470 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:55:56.090861  351470 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:55:56.169905  351470 ssh_runner.go:195] Run: systemctl --version

	I0803 23:55:56.176713  351470 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:56.202453  351470 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:56.202489  351470 api_server.go:166] Checking apiserver status ...

	I0803 23:55:56.202526  351470 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:56.219816  351470 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:55:56.230723  351470 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:56.230792  351470 ssh_runner.go:195] Run: ls

	I0803 23:55:56.236502  351470 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:56.240978  351470 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:56.241020  351470 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:55:56.241034  351470 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:56.241078  351470 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:55:56.241398  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:56.241450  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:56.258571  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37165

	I0803 23:55:56.259060  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:56.259606  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:56.259639  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:56.259985  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:56.260252  351470 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:55:56.262084  351470 status.go:330] ha-349588-m02 host status = "Running" (err=<nil>)

	I0803 23:55:56.262101  351470 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:56.262418  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:56.262461  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:56.277866  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40295

	I0803 23:55:56.278405  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:56.278991  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:56.279014  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:56.279359  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:56.279620  351470 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:55:56.282617  351470 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:56.283137  351470 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:56.283159  351470 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:56.283306  351470 host.go:66] Checking if "ha-349588-m02" exists ...

	I0803 23:55:56.283667  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:56.283721  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:56.300130  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44325

	I0803 23:55:56.300696  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:56.301282  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:56.301309  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:56.301676  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:56.301888  351470 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:55:56.302079  351470 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:56.302101  351470 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:55:56.304647  351470 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:56.305182  351470 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:55:56.305209  351470 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:55:56.305368  351470 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:55:56.305571  351470 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:55:56.305745  351470 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:55:56.305924  351470 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	W0803 23:55:59.373781  351470 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.67:22: connect: no route to host

	W0803 23:55:59.373919  351470 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	E0803 23:55:59.373958  351470 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:59.373968  351470 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0803 23:55:59.373995  351470 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.67:22: connect: no route to host

	I0803 23:55:59.374009  351470 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:55:59.374637  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:59.374737  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:59.390678  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42719

	I0803 23:55:59.391213  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:59.391805  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:59.391828  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:59.392171  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:59.392376  351470 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:55:59.394316  351470 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:55:59.394351  351470 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:59.394676  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:59.394723  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:59.409970  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45645

	I0803 23:55:59.410510  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:59.411174  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:59.411203  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:59.411549  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:59.411773  351470 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:55:59.414778  351470 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:59.415359  351470 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:59.415402  351470 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:59.415504  351470 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:55:59.415902  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:59.415947  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:59.431207  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43921

	I0803 23:55:59.431598  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:59.432146  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:59.432168  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:59.432485  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:59.432700  351470 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:55:59.432888  351470 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:59.432914  351470 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:55:59.435754  351470 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:59.436145  351470 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:55:59.436199  351470 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:55:59.436316  351470 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:55:59.436513  351470 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:55:59.436647  351470 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:55:59.436790  351470 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:55:59.521487  351470 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:59.538153  351470 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:55:59.538185  351470 api_server.go:166] Checking apiserver status ...

	I0803 23:55:59.538226  351470 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:55:59.553072  351470 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:55:59.563143  351470 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:55:59.563200  351470 ssh_runner.go:195] Run: ls

	I0803 23:55:59.568051  351470 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:55:59.574448  351470 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:55:59.574475  351470 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:55:59.574485  351470 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:55:59.574500  351470 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:55:59.574819  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:59.574853  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:59.591538  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34269

	I0803 23:55:59.592064  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:59.592578  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:59.592606  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:59.593003  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:59.593231  351470 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:55:59.594951  351470 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:55:59.594967  351470 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:59.595251  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:59.595285  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:59.611944  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41795

	I0803 23:55:59.612444  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:59.612944  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:59.612969  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:59.613296  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:59.613484  351470 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:55:59.616323  351470 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:59.616783  351470 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:59.616808  351470 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:59.616949  351470 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:55:59.617251  351470 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:55:59.617293  351470 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:55:59.633803  351470 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32951

	I0803 23:55:59.634245  351470 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:55:59.634742  351470 main.go:141] libmachine: Using API Version  1

	I0803 23:55:59.634767  351470 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:55:59.635207  351470 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:55:59.635462  351470 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:55:59.635680  351470 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:55:59.635707  351470 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:55:59.638636  351470 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:59.639084  351470 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:55:59.639112  351470 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:55:59.639280  351470 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:55:59.639454  351470 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:55:59.639638  351470 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:55:59.639818  351470 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:55:59.721150  351470 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:55:59.737546  351470 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr: exit status 7 (646.219618ms)

-- stdout --

	ha-349588

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-349588-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-349588-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0803 23:56:06.618883  351622 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:56:06.619180  351622 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:56:06.619192  351622 out.go:304] Setting ErrFile to fd 2...

	I0803 23:56:06.619198  351622 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:56:06.619376  351622 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:56:06.619578  351622 out.go:298] Setting JSON to false

	I0803 23:56:06.619614  351622 mustload.go:65] Loading cluster: ha-349588

	I0803 23:56:06.619663  351622 notify.go:220] Checking for updates...

	I0803 23:56:06.620111  351622 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:56:06.620137  351622 status.go:255] checking status of ha-349588 ...

	I0803 23:56:06.620569  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.620654  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.636125  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38121

	I0803 23:56:06.636622  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.637244  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.637266  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.637784  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.638017  351622 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:56:06.640015  351622 status.go:330] ha-349588 host status = "Running" (err=<nil>)

	I0803 23:56:06.640035  351622 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:56:06.640467  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.640523  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.656195  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36735

	I0803 23:56:06.656625  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.657105  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.657132  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.657457  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.657686  351622 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:56:06.660621  351622 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:56:06.661066  351622 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:56:06.661102  351622 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:56:06.661230  351622 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:56:06.661558  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.661594  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.677280  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45511

	I0803 23:56:06.677787  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.678270  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.678293  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.678601  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.678814  351622 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:56:06.679039  351622 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:56:06.679064  351622 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:56:06.682236  351622 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:56:06.682752  351622 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:56:06.682795  351622 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:56:06.682959  351622 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:56:06.683131  351622 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:56:06.683267  351622 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:56:06.683407  351622 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:56:06.762480  351622 ssh_runner.go:195] Run: systemctl --version

	I0803 23:56:06.768895  351622 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:56:06.786157  351622 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:56:06.786193  351622 api_server.go:166] Checking apiserver status ...

	I0803 23:56:06.786230  351622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:56:06.806673  351622 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup

	W0803 23:56:06.816845  351622 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1202/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:56:06.816903  351622 ssh_runner.go:195] Run: ls

	I0803 23:56:06.822105  351622 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:56:06.832511  351622 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:56:06.832552  351622 status.go:422] ha-349588 apiserver status = Running (err=<nil>)

	I0803 23:56:06.832563  351622 status.go:257] ha-349588 status: &{Name:ha-349588 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:56:06.832587  351622 status.go:255] checking status of ha-349588-m02 ...

	I0803 23:56:06.832936  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.832980  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.848530  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35771

	I0803 23:56:06.849105  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.849742  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.849775  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.850201  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.850406  351622 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:56:06.852234  351622 status.go:330] ha-349588-m02 host status = "Stopped" (err=<nil>)

	I0803 23:56:06.852253  351622 status.go:343] host is not running, skipping remaining checks

	I0803 23:56:06.852262  351622 status.go:257] ha-349588-m02 status: &{Name:ha-349588-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:56:06.852286  351622 status.go:255] checking status of ha-349588-m03 ...

	I0803 23:56:06.852642  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.852691  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.868791  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38809

	I0803 23:56:06.869310  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.869810  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.869836  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.870165  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.870355  351622 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:56:06.872015  351622 status.go:330] ha-349588-m03 host status = "Running" (err=<nil>)

	I0803 23:56:06.872037  351622 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:56:06.872344  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.872377  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.888602  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34037

	I0803 23:56:06.889127  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.889654  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.889682  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.890040  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.890274  351622 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:56:06.893322  351622 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:56:06.893737  351622 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:56:06.893767  351622 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:56:06.893902  351622 host.go:66] Checking if "ha-349588-m03" exists ...

	I0803 23:56:06.894239  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:06.894286  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:06.911226  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40883

	I0803 23:56:06.911698  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:06.912205  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:06.912227  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:06.912517  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:06.912696  351622 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:56:06.912870  351622 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:56:06.912891  351622 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:56:06.915762  351622 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:56:06.916208  351622 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:56:06.916233  351622 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:56:06.916351  351622 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:56:06.916503  351622 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:56:06.916661  351622 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:56:06.916864  351622 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:56:07.007039  351622 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:56:07.021947  351622 kubeconfig.go:125] found "ha-349588" server: "https://192.168.39.254:8443"

	I0803 23:56:07.021991  351622 api_server.go:166] Checking apiserver status ...

	I0803 23:56:07.022050  351622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:56:07.037638  351622 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup

	W0803 23:56:07.048071  351622 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1567/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0803 23:56:07.048152  351622 ssh_runner.go:195] Run: ls

	I0803 23:56:07.053135  351622 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0803 23:56:07.057560  351622 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0803 23:56:07.057590  351622 status.go:422] ha-349588-m03 apiserver status = Running (err=<nil>)

	I0803 23:56:07.057599  351622 status.go:257] ha-349588-m03 status: &{Name:ha-349588-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0803 23:56:07.057616  351622 status.go:255] checking status of ha-349588-m04 ...

	I0803 23:56:07.057908  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:07.057948  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:07.073787  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33331

	I0803 23:56:07.074309  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:07.074836  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:07.074879  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:07.075226  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:07.075439  351622 main.go:141] libmachine: (ha-349588-m04) Calling .GetState

	I0803 23:56:07.077075  351622 status.go:330] ha-349588-m04 host status = "Running" (err=<nil>)

	I0803 23:56:07.077093  351622 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:56:07.077389  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:07.077451  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:07.093561  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36485

	I0803 23:56:07.094124  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:07.094611  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:07.094637  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:07.094941  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:07.095121  351622 main.go:141] libmachine: (ha-349588-m04) Calling .GetIP

	I0803 23:56:07.097940  351622 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:56:07.098409  351622 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:56:07.098450  351622 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:56:07.098607  351622 host.go:66] Checking if "ha-349588-m04" exists ...

	I0803 23:56:07.098915  351622 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:56:07.098957  351622 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:56:07.115797  351622 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35653

	I0803 23:56:07.116252  351622 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:56:07.116792  351622 main.go:141] libmachine: Using API Version  1

	I0803 23:56:07.116817  351622 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:56:07.117111  351622 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:56:07.117304  351622 main.go:141] libmachine: (ha-349588-m04) Calling .DriverName

	I0803 23:56:07.117531  351622 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0803 23:56:07.117553  351622 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHHostname

	I0803 23:56:07.120364  351622 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:56:07.120785  351622 main.go:141] libmachine: (ha-349588-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:15:3e:82", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:51:59 +0000 UTC Type:0 Mac:52:54:00:15:3e:82 Iaid: IPaddr:192.168.39.61 Prefix:24 Hostname:ha-349588-m04 Clientid:01:52:54:00:15:3e:82}

	I0803 23:56:07.120815  351622 main.go:141] libmachine: (ha-349588-m04) DBG | domain ha-349588-m04 has defined IP address 192.168.39.61 and MAC address 52:54:00:15:3e:82 in network mk-ha-349588

	I0803 23:56:07.120951  351622 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHPort

	I0803 23:56:07.121140  351622 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHKeyPath

	I0803 23:56:07.121311  351622 main.go:141] libmachine: (ha-349588-m04) Calling .GetSSHUsername

	I0803 23:56:07.121453  351622 sshutil.go:53] new ssh client: &{IP:192.168.39.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m04/id_rsa Username:docker}

	I0803 23:56:07.201252  351622 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:56:07.218085  351622 status.go:257] ha-349588-m04 status: &{Name:ha-349588-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-349588 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-349588 -n ha-349588

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-349588 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-349588 logs -n 25: (1.461286122s)

helpers_test.go:252: TestMultiControlPlane/serial/RestartSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588:/home/docker/cp-test_ha-349588-m03_ha-349588.txt                       |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588 sudo cat                                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m03_ha-349588.txt                                 |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m02:/home/docker/cp-test_ha-349588-m03_ha-349588-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m02 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m03_ha-349588-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m03:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04:/home/docker/cp-test_ha-349588-m03_ha-349588-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m04 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m03_ha-349588-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-349588 cp testdata/cp-test.txt                                                | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1280567125/001/cp-test_ha-349588-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588:/home/docker/cp-test_ha-349588-m04_ha-349588.txt                       |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588 sudo cat                                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m04_ha-349588.txt                                 |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m02:/home/docker/cp-test_ha-349588-m04_ha-349588-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m02 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m04_ha-349588-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-349588 cp ha-349588-m04:/home/docker/cp-test.txt                              | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m03:/home/docker/cp-test_ha-349588-m04_ha-349588-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n                                                                 | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | ha-349588-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-349588 ssh -n ha-349588-m03 sudo cat                                          | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC | 03 Aug 24 23:52 UTC |

	|         | /home/docker/cp-test_ha-349588-m04_ha-349588-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-349588 node stop m02 -v=7                                                     | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:52 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-349588 node start m02 -v=7                                                    | ha-349588 | jenkins | v1.33.1 | 03 Aug 24 23:55 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/03 23:48:09

	Running on machine: ubuntu-20-agent-13

	Binary: Built with gc go1.22.5 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0803 23:48:09.418625  346092 out.go:291] Setting OutFile to fd 1 ...

	I0803 23:48:09.418752  346092 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:48:09.418762  346092 out.go:304] Setting ErrFile to fd 2...

	I0803 23:48:09.418768  346092 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0803 23:48:09.418971  346092 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19370-323890/.minikube/bin

	I0803 23:48:09.419574  346092 out.go:298] Setting JSON to false

	I0803 23:48:09.420569  346092 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":30637,"bootTime":1722698252,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0803 23:48:09.420633  346092 start.go:139] virtualization: kvm guest

	I0803 23:48:09.422786  346092 out.go:177] * [ha-349588] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0803 23:48:09.424092  346092 out.go:177]   - MINIKUBE_LOCATION=19370

	I0803 23:48:09.424144  346092 notify.go:220] Checking for updates...

	I0803 23:48:09.426416  346092 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0803 23:48:09.427707  346092 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:48:09.429120  346092 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:48:09.430526  346092 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0803 23:48:09.431632  346092 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0803 23:48:09.432954  346092 driver.go:392] Setting default libvirt URI to qemu:///system

	I0803 23:48:09.470138  346092 out.go:177] * Using the kvm2 driver based on user configuration

	I0803 23:48:09.471317  346092 start.go:297] selected driver: kvm2

	I0803 23:48:09.471334  346092 start.go:901] validating driver "kvm2" against <nil>

	I0803 23:48:09.471347  346092 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0803 23:48:09.472158  346092 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0803 23:48:09.472262  346092 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19370-323890/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0803 23:48:09.488603  346092 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0803 23:48:09.488655  346092 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0803 23:48:09.488888  346092 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:48:09.488957  346092 cni.go:84] Creating CNI manager for ""

	I0803 23:48:09.488969  346092 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0803 23:48:09.488977  346092 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0803 23:48:09.489047  346092 start.go:340] cluster config:

	{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0803 23:48:09.489163  346092 iso.go:125] acquiring lock: {Name:mke18ad45a0f8e7ec51adacd21c7952f17bf0357 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0803 23:48:09.490895  346092 out.go:177] * Starting "ha-349588" primary control-plane node in "ha-349588" cluster

	I0803 23:48:09.491984  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:48:09.492039  346092 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4

	I0803 23:48:09.492063  346092 cache.go:56] Caching tarball of preloaded images

	I0803 23:48:09.492163  346092 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:48:09.492174  346092 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:48:09.492520  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:48:09.492548  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json: {Name:mk903cfda9df964846737e7e0ecec8ea46a5827c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:09.492717  346092 start.go:360] acquireMachinesLock for ha-349588: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:48:09.492747  346092 start.go:364] duration metric: took 17.293µs to acquireMachinesLock for "ha-349588"

	I0803 23:48:09.492765  346092 start.go:93] Provisioning new machine with config: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:48:09.492824  346092 start.go:125] createHost starting for "" (driver="kvm2")

	I0803 23:48:09.494421  346092 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0803 23:48:09.494578  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:48:09.494618  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:48:09.509993  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38087

	I0803 23:48:09.510451  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:48:09.511049  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:48:09.511070  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:48:09.511439  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:48:09.511701  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:09.511862  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:09.512020  346092 start.go:159] libmachine.API.Create for "ha-349588" (driver="kvm2")

	I0803 23:48:09.512050  346092 client.go:168] LocalClient.Create starting

	I0803 23:48:09.512089  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:48:09.512149  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:48:09.512174  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:48:09.512252  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:48:09.512279  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:48:09.512295  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:48:09.512320  346092 main.go:141] libmachine: Running pre-create checks...

	I0803 23:48:09.512339  346092 main.go:141] libmachine: (ha-349588) Calling .PreCreateCheck

	I0803 23:48:09.512682  346092 main.go:141] libmachine: (ha-349588) Calling .GetConfigRaw

	I0803 23:48:09.513102  346092 main.go:141] libmachine: Creating machine...

	I0803 23:48:09.513120  346092 main.go:141] libmachine: (ha-349588) Calling .Create

	I0803 23:48:09.513250  346092 main.go:141] libmachine: (ha-349588) Creating KVM machine...

	I0803 23:48:09.514581  346092 main.go:141] libmachine: (ha-349588) DBG | found existing default KVM network

	I0803 23:48:09.515280  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.515113  346115 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00012d990}

	I0803 23:48:09.515306  346092 main.go:141] libmachine: (ha-349588) DBG | created network xml: 

	I0803 23:48:09.515319  346092 main.go:141] libmachine: (ha-349588) DBG | <network>

	I0803 23:48:09.515327  346092 main.go:141] libmachine: (ha-349588) DBG |   <name>mk-ha-349588</name>

	I0803 23:48:09.515341  346092 main.go:141] libmachine: (ha-349588) DBG |   <dns enable='no'/>

	I0803 23:48:09.515351  346092 main.go:141] libmachine: (ha-349588) DBG |   

	I0803 23:48:09.515360  346092 main.go:141] libmachine: (ha-349588) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0803 23:48:09.515366  346092 main.go:141] libmachine: (ha-349588) DBG |     <dhcp>

	I0803 23:48:09.515374  346092 main.go:141] libmachine: (ha-349588) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0803 23:48:09.515391  346092 main.go:141] libmachine: (ha-349588) DBG |     </dhcp>

	I0803 23:48:09.515412  346092 main.go:141] libmachine: (ha-349588) DBG |   </ip>

	I0803 23:48:09.515424  346092 main.go:141] libmachine: (ha-349588) DBG |   

	I0803 23:48:09.515430  346092 main.go:141] libmachine: (ha-349588) DBG | </network>

	I0803 23:48:09.515435  346092 main.go:141] libmachine: (ha-349588) DBG | 

	I0803 23:48:09.520559  346092 main.go:141] libmachine: (ha-349588) DBG | trying to create private KVM network mk-ha-349588 192.168.39.0/24...

	I0803 23:48:09.590357  346092 main.go:141] libmachine: (ha-349588) DBG | private KVM network mk-ha-349588 192.168.39.0/24 created

	I0803 23:48:09.590389  346092 main.go:141] libmachine: (ha-349588) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588 ...

	I0803 23:48:09.590434  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.590305  346115 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:48:09.590461  346092 main.go:141] libmachine: (ha-349588) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:48:09.590489  346092 main.go:141] libmachine: (ha-349588) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:48:09.872162  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.871931  346115 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa...

	I0803 23:48:09.925823  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.925663  346115 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/ha-349588.rawdisk...

	I0803 23:48:09.925875  346092 main.go:141] libmachine: (ha-349588) DBG | Writing magic tar header

	I0803 23:48:09.925892  346092 main.go:141] libmachine: (ha-349588) DBG | Writing SSH key tar header

	I0803 23:48:09.925900  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:09.925798  346115 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588 ...

	I0803 23:48:09.925912  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588

	I0803 23:48:09.925995  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588 (perms=drwx------)

	I0803 23:48:09.926018  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:48:09.926030  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:48:09.926051  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:48:09.926063  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:48:09.926077  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:48:09.926086  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:48:09.926094  346092 main.go:141] libmachine: (ha-349588) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:48:09.926102  346092 main.go:141] libmachine: (ha-349588) Creating domain...

	I0803 23:48:09.926112  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:48:09.926120  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:48:09.926126  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:48:09.926135  346092 main.go:141] libmachine: (ha-349588) DBG | Checking permissions on dir: /home

	I0803 23:48:09.926168  346092 main.go:141] libmachine: (ha-349588) DBG | Skipping /home - not owner

	I0803 23:48:09.927340  346092 main.go:141] libmachine: (ha-349588) define libvirt domain using xml: 

	I0803 23:48:09.927363  346092 main.go:141] libmachine: (ha-349588) <domain type='kvm'>

	I0803 23:48:09.927373  346092 main.go:141] libmachine: (ha-349588)   <name>ha-349588</name>

	I0803 23:48:09.927384  346092 main.go:141] libmachine: (ha-349588)   <memory unit='MiB'>2200</memory>

	I0803 23:48:09.927393  346092 main.go:141] libmachine: (ha-349588)   <vcpu>2</vcpu>

	I0803 23:48:09.927402  346092 main.go:141] libmachine: (ha-349588)   <features>

	I0803 23:48:09.927414  346092 main.go:141] libmachine: (ha-349588)     <acpi/>

	I0803 23:48:09.927420  346092 main.go:141] libmachine: (ha-349588)     <apic/>

	I0803 23:48:09.927429  346092 main.go:141] libmachine: (ha-349588)     <pae/>

	I0803 23:48:09.927443  346092 main.go:141] libmachine: (ha-349588)     

	I0803 23:48:09.927452  346092 main.go:141] libmachine: (ha-349588)   </features>

	I0803 23:48:09.927466  346092 main.go:141] libmachine: (ha-349588)   <cpu mode='host-passthrough'>

	I0803 23:48:09.927474  346092 main.go:141] libmachine: (ha-349588)   

	I0803 23:48:09.927485  346092 main.go:141] libmachine: (ha-349588)   </cpu>

	I0803 23:48:09.927493  346092 main.go:141] libmachine: (ha-349588)   <os>

	I0803 23:48:09.927500  346092 main.go:141] libmachine: (ha-349588)     <type>hvm</type>

	I0803 23:48:09.927509  346092 main.go:141] libmachine: (ha-349588)     <boot dev='cdrom'/>

	I0803 23:48:09.927519  346092 main.go:141] libmachine: (ha-349588)     <boot dev='hd'/>

	I0803 23:48:09.927528  346092 main.go:141] libmachine: (ha-349588)     <bootmenu enable='no'/>

	I0803 23:48:09.927541  346092 main.go:141] libmachine: (ha-349588)   </os>

	I0803 23:48:09.927557  346092 main.go:141] libmachine: (ha-349588)   <devices>

	I0803 23:48:09.927567  346092 main.go:141] libmachine: (ha-349588)     <disk type='file' device='cdrom'>

	I0803 23:48:09.927580  346092 main.go:141] libmachine: (ha-349588)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/boot2docker.iso'/>

	I0803 23:48:09.927595  346092 main.go:141] libmachine: (ha-349588)       <target dev='hdc' bus='scsi'/>

	I0803 23:48:09.927606  346092 main.go:141] libmachine: (ha-349588)       <readonly/>

	I0803 23:48:09.927615  346092 main.go:141] libmachine: (ha-349588)     </disk>

	I0803 23:48:09.927625  346092 main.go:141] libmachine: (ha-349588)     <disk type='file' device='disk'>

	I0803 23:48:09.927637  346092 main.go:141] libmachine: (ha-349588)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:48:09.927655  346092 main.go:141] libmachine: (ha-349588)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/ha-349588.rawdisk'/>

	I0803 23:48:09.927670  346092 main.go:141] libmachine: (ha-349588)       <target dev='hda' bus='virtio'/>

	I0803 23:48:09.927681  346092 main.go:141] libmachine: (ha-349588)     </disk>

	I0803 23:48:09.927691  346092 main.go:141] libmachine: (ha-349588)     <interface type='network'>

	I0803 23:48:09.927707  346092 main.go:141] libmachine: (ha-349588)       <source network='mk-ha-349588'/>

	I0803 23:48:09.927717  346092 main.go:141] libmachine: (ha-349588)       <model type='virtio'/>

	I0803 23:48:09.927728  346092 main.go:141] libmachine: (ha-349588)     </interface>

	I0803 23:48:09.927743  346092 main.go:141] libmachine: (ha-349588)     <interface type='network'>

	I0803 23:48:09.927756  346092 main.go:141] libmachine: (ha-349588)       <source network='default'/>

	I0803 23:48:09.927766  346092 main.go:141] libmachine: (ha-349588)       <model type='virtio'/>

	I0803 23:48:09.927776  346092 main.go:141] libmachine: (ha-349588)     </interface>

	I0803 23:48:09.927786  346092 main.go:141] libmachine: (ha-349588)     <serial type='pty'>

	I0803 23:48:09.927795  346092 main.go:141] libmachine: (ha-349588)       <target port='0'/>

	I0803 23:48:09.927804  346092 main.go:141] libmachine: (ha-349588)     </serial>

	I0803 23:48:09.927829  346092 main.go:141] libmachine: (ha-349588)     <console type='pty'>

	I0803 23:48:09.927851  346092 main.go:141] libmachine: (ha-349588)       <target type='serial' port='0'/>

	I0803 23:48:09.927862  346092 main.go:141] libmachine: (ha-349588)     </console>

	I0803 23:48:09.927868  346092 main.go:141] libmachine: (ha-349588)     <rng model='virtio'>

	I0803 23:48:09.927877  346092 main.go:141] libmachine: (ha-349588)       <backend model='random'>/dev/random</backend>

	I0803 23:48:09.927883  346092 main.go:141] libmachine: (ha-349588)     </rng>

	I0803 23:48:09.927888  346092 main.go:141] libmachine: (ha-349588)     

	I0803 23:48:09.927892  346092 main.go:141] libmachine: (ha-349588)     

	I0803 23:48:09.927898  346092 main.go:141] libmachine: (ha-349588)   </devices>

	I0803 23:48:09.927904  346092 main.go:141] libmachine: (ha-349588) </domain>

	I0803 23:48:09.927911  346092 main.go:141] libmachine: (ha-349588) 

	I0803 23:48:09.932195  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:c8:e6:c5 in network default

	I0803 23:48:09.932825  346092 main.go:141] libmachine: (ha-349588) Ensuring networks are active...

	I0803 23:48:09.932848  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:09.933616  346092 main.go:141] libmachine: (ha-349588) Ensuring network default is active

	I0803 23:48:09.933995  346092 main.go:141] libmachine: (ha-349588) Ensuring network mk-ha-349588 is active

	I0803 23:48:09.934553  346092 main.go:141] libmachine: (ha-349588) Getting domain xml...

	I0803 23:48:09.935413  346092 main.go:141] libmachine: (ha-349588) Creating domain...

	I0803 23:48:11.143458  346092 main.go:141] libmachine: (ha-349588) Waiting to get IP...

	I0803 23:48:11.144201  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.144600  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.144647  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.144590  346115 retry.go:31] will retry after 217.821157ms: waiting for machine to come up

	I0803 23:48:11.364303  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.364800  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.364827  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.364747  346115 retry.go:31] will retry after 290.305806ms: waiting for machine to come up

	I0803 23:48:11.656462  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.656882  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.656915  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.656819  346115 retry.go:31] will retry after 307.829475ms: waiting for machine to come up

	I0803 23:48:11.966421  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:11.966824  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:11.966854  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:11.966778  346115 retry.go:31] will retry after 424.675082ms: waiting for machine to come up

	I0803 23:48:12.393572  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:12.394043  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:12.394075  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:12.393985  346115 retry.go:31] will retry after 469.819501ms: waiting for machine to come up

	I0803 23:48:12.865672  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:12.866068  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:12.866113  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:12.866030  346115 retry.go:31] will retry after 703.183302ms: waiting for machine to come up

	I0803 23:48:13.571033  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:13.571450  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:13.571536  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:13.571432  346115 retry.go:31] will retry after 1.123702351s: waiting for machine to come up

	I0803 23:48:14.696577  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:14.697000  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:14.697052  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:14.696947  346115 retry.go:31] will retry after 1.12664628s: waiting for machine to come up

	I0803 23:48:15.824971  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:15.825444  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:15.825471  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:15.825370  346115 retry.go:31] will retry after 1.337432737s: waiting for machine to come up

	I0803 23:48:17.164972  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:17.165341  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:17.165365  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:17.165301  346115 retry.go:31] will retry after 1.584311544s: waiting for machine to come up

	I0803 23:48:18.752092  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:18.752563  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:18.752599  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:18.752497  346115 retry.go:31] will retry after 2.404172369s: waiting for machine to come up

	I0803 23:48:21.159266  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:21.159722  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:21.159746  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:21.159660  346115 retry.go:31] will retry after 3.566530198s: waiting for machine to come up

	I0803 23:48:24.727868  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:24.728217  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:24.728244  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:24.728197  346115 retry.go:31] will retry after 4.050810748s: waiting for machine to come up

	I0803 23:48:28.782752  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:28.783279  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find current IP address of domain ha-349588 in network mk-ha-349588

	I0803 23:48:28.783306  346092 main.go:141] libmachine: (ha-349588) DBG | I0803 23:48:28.783240  346115 retry.go:31] will retry after 4.340405118s: waiting for machine to come up

	I0803 23:48:33.126682  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:33.127152  346092 main.go:141] libmachine: (ha-349588) Found IP for machine: 192.168.39.168

	I0803 23:48:33.127176  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has current primary IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:33.127210  346092 main.go:141] libmachine: (ha-349588) Reserving static IP address...

	I0803 23:48:33.127440  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find host DHCP lease matching {name: "ha-349588", mac: "52:54:00:d9:f9:50", ip: "192.168.39.168"} in network mk-ha-349588

	I0803 23:48:33.206830  346092 main.go:141] libmachine: (ha-349588) DBG | Getting to WaitForSSH function...

	I0803 23:48:33.206864  346092 main.go:141] libmachine: (ha-349588) Reserved static IP address: 192.168.39.168

	I0803 23:48:33.206877  346092 main.go:141] libmachine: (ha-349588) Waiting for SSH to be available...

	I0803 23:48:33.209538  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:33.209926  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588

	I0803 23:48:33.209953  346092 main.go:141] libmachine: (ha-349588) DBG | unable to find defined IP address of network mk-ha-349588 interface with MAC address 52:54:00:d9:f9:50

	I0803 23:48:33.210115  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH client type: external

	I0803 23:48:33.210168  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa (-rw-------)

	I0803 23:48:33.210224  346092 main.go:141] libmachine: (ha-349588) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:48:33.210244  346092 main.go:141] libmachine: (ha-349588) DBG | About to run SSH command:

	I0803 23:48:33.210260  346092 main.go:141] libmachine: (ha-349588) DBG | exit 0

	I0803 23:48:33.214010  346092 main.go:141] libmachine: (ha-349588) DBG | SSH cmd err, output: exit status 255: 

	I0803 23:48:33.214077  346092 main.go:141] libmachine: (ha-349588) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0803 23:48:33.214103  346092 main.go:141] libmachine: (ha-349588) DBG | command : exit 0

	I0803 23:48:33.214117  346092 main.go:141] libmachine: (ha-349588) DBG | err     : exit status 255

	I0803 23:48:33.214129  346092 main.go:141] libmachine: (ha-349588) DBG | output  : 

	I0803 23:48:36.215923  346092 main.go:141] libmachine: (ha-349588) DBG | Getting to WaitForSSH function...

	I0803 23:48:36.218572  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.218985  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.219013  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.219082  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH client type: external

	I0803 23:48:36.219103  346092 main.go:141] libmachine: (ha-349588) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa (-rw-------)

	I0803 23:48:36.219141  346092 main.go:141] libmachine: (ha-349588) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.168 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:48:36.219157  346092 main.go:141] libmachine: (ha-349588) DBG | About to run SSH command:

	I0803 23:48:36.219170  346092 main.go:141] libmachine: (ha-349588) DBG | exit 0

	I0803 23:48:36.337862  346092 main.go:141] libmachine: (ha-349588) DBG | SSH cmd err, output: <nil>: 

	I0803 23:48:36.338165  346092 main.go:141] libmachine: (ha-349588) KVM machine creation complete!

	I0803 23:48:36.338513  346092 main.go:141] libmachine: (ha-349588) Calling .GetConfigRaw

	I0803 23:48:36.339091  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:36.339286  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:36.339413  346092 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:48:36.339424  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:48:36.340646  346092 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:48:36.340662  346092 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:48:36.340669  346092 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:48:36.340676  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.342849  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.343214  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.343243  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.343346  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.343540  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.343678  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.343794  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.343956  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.344188  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.344202  346092 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:48:36.441183  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:48:36.441208  346092 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:48:36.441216  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.443990  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.444394  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.444424  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.444612  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.444811  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.444973  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.445104  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.445241  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.445426  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.445437  346092 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:48:36.542286  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:48:36.542365  346092 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:48:36.542371  346092 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:48:36.542384  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:36.542688  346092 buildroot.go:166] provisioning hostname "ha-349588"

	I0803 23:48:36.542739  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:36.542966  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.545919  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.546337  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.546368  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.546552  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.546755  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.546913  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.547066  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.547213  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.547411  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.547426  346092 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-349588 && echo "ha-349588" | sudo tee /etc/hostname

	I0803 23:48:36.660783  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-349588

	I0803 23:48:36.660811  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.663757  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.664197  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.664222  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.664426  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.664653  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.664851  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.664993  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.665167  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:36.665347  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:36.665362  346092 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-349588' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-349588/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-349588' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:48:36.771045  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:48:36.771076  346092 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:48:36.771125  346092 buildroot.go:174] setting up certificates

	I0803 23:48:36.771143  346092 provision.go:84] configureAuth start

	I0803 23:48:36.771157  346092 main.go:141] libmachine: (ha-349588) Calling .GetMachineName

	I0803 23:48:36.771474  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:36.774122  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.774504  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.774536  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.774645  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.776986  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.777284  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.777333  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.777497  346092 provision.go:143] copyHostCerts

	I0803 23:48:36.777544  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:48:36.777581  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem, removing ...

	I0803 23:48:36.777591  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:48:36.777659  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:48:36.777742  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:48:36.777760  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem, removing ...

	I0803 23:48:36.777766  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:48:36.777790  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:48:36.777832  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:48:36.777848  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem, removing ...

	I0803 23:48:36.777854  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:48:36.777874  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:48:36.777921  346092 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.ha-349588 san=[127.0.0.1 192.168.39.168 ha-349588 localhost minikube]

	I0803 23:48:36.891183  346092 provision.go:177] copyRemoteCerts

	I0803 23:48:36.891251  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:48:36.891279  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:36.894188  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.894510  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:36.894544  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:36.894727  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:36.894957  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:36.895157  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:36.895313  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:36.978456  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0803 23:48:36.978533  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:48:37.004096  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0803 23:48:37.004172  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0803 23:48:37.028761  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0803 23:48:37.028864  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0803 23:48:37.053090  346092 provision.go:87] duration metric: took 281.906542ms to configureAuth

	I0803 23:48:37.053131  346092 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:48:37.053320  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:48:37.053406  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.056081  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.056541  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.056567  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.056725  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.056959  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.057168  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.057334  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.057499  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:37.057703  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:37.057719  346092 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:48:37.329708  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:48:37.329744  346092 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:48:37.329755  346092 main.go:141] libmachine: (ha-349588) Calling .GetURL

	I0803 23:48:37.331027  346092 main.go:141] libmachine: (ha-349588) DBG | Using libvirt version 6000000

	I0803 23:48:37.333248  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.333780  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.333808  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.333977  346092 main.go:141] libmachine: Docker is up and running!

	I0803 23:48:37.333999  346092 main.go:141] libmachine: Reticulating splines...

	I0803 23:48:37.334010  346092 client.go:171] duration metric: took 27.821945455s to LocalClient.Create

	I0803 23:48:37.334044  346092 start.go:167] duration metric: took 27.822025189s to libmachine.API.Create "ha-349588"

	I0803 23:48:37.334056  346092 start.go:293] postStartSetup for "ha-349588" (driver="kvm2")

	I0803 23:48:37.334065  346092 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:48:37.334081  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.334393  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:48:37.334417  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.336642  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.336927  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.336953  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.337119  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.337290  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.337446  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.337616  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:37.416116  346092 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:48:37.420420  346092 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:48:37.420451  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:48:37.420522  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:48:37.420630  346092 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> 3310972.pem in /etc/ssl/certs

	I0803 23:48:37.420645  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /etc/ssl/certs/3310972.pem

	I0803 23:48:37.420778  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0803 23:48:37.430694  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:48:37.459257  346092 start.go:296] duration metric: took 125.186102ms for postStartSetup

	I0803 23:48:37.459317  346092 main.go:141] libmachine: (ha-349588) Calling .GetConfigRaw

	I0803 23:48:37.459978  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:37.463817  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.464170  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.464194  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.464482  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:48:37.464696  346092 start.go:128] duration metric: took 27.971861416s to createHost

	I0803 23:48:37.464731  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.466929  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.467283  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.467311  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.467442  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.467641  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.467814  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.467939  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.468075  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:48:37.468271  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.168 22 <nil> <nil>}

	I0803 23:48:37.468281  346092 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0803 23:48:37.566205  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722728917.546761844

	I0803 23:48:37.566231  346092 fix.go:216] guest clock: 1722728917.546761844

	I0803 23:48:37.566238  346092 fix.go:229] Guest: 2024-08-03 23:48:37.546761844 +0000 UTC Remote: 2024-08-03 23:48:37.464710805 +0000 UTC m=+28.082129480 (delta=82.051039ms)

	I0803 23:48:37.566259  346092 fix.go:200] guest clock delta is within tolerance: 82.051039ms

	I0803 23:48:37.566264  346092 start.go:83] releasing machines lock for "ha-349588", held for 28.07350849s

	I0803 23:48:37.566282  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.566552  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:37.569332  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.569715  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.569744  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.569912  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.570398  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.570564  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:48:37.570663  346092 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:48:37.570703  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.570820  346092 ssh_runner.go:195] Run: cat /version.json

	I0803 23:48:37.570846  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:48:37.573409  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.573687  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.573810  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.573834  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.573988  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.574087  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:37.574132  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:37.574275  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:48:37.574307  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.574464  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.574495  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:48:37.574606  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:48:37.574618  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:37.574770  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:48:37.668834  346092 ssh_runner.go:195] Run: systemctl --version

	I0803 23:48:37.675150  346092 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:48:37.834421  346092 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:48:37.840819  346092 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:48:37.840914  346092 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:48:37.857582  346092 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:48:37.857616  346092 start.go:495] detecting cgroup driver to use...

	I0803 23:48:37.857725  346092 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:48:37.875286  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:48:37.891205  346092 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:48:37.891287  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:48:37.906903  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:48:37.922814  346092 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:48:38.040844  346092 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:48:38.187910  346092 docker.go:233] disabling docker service ...

	I0803 23:48:38.187983  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:48:38.203041  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:48:38.216953  346092 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:48:38.356540  346092 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:48:38.471367  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:48:38.485586  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:48:38.504903  346092 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:48:38.504998  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.515915  346092 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:48:38.515993  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.527084  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.538078  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.549280  346092 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:48:38.560636  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.571734  346092 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.589785  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:48:38.600819  346092 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:48:38.610949  346092 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:48:38.611026  346092 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:48:38.624934  346092 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:48:38.635005  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:48:38.748298  346092 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:48:38.887792  346092 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:48:38.887892  346092 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:48:38.892998  346092 start.go:563] Will wait 60s for crictl version

	I0803 23:48:38.893081  346092 ssh_runner.go:195] Run: which crictl

	I0803 23:48:38.897088  346092 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:48:38.935449  346092 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:48:38.935539  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:48:38.965015  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:48:38.995381  346092 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:48:38.996902  346092 main.go:141] libmachine: (ha-349588) Calling .GetIP

	I0803 23:48:38.999775  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:39.000151  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:48:39.000175  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:48:39.000430  346092 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:48:39.004744  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:48:39.019060  346092 kubeadm.go:883] updating cluster {Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cl

usterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0803 23:48:39.019244  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:48:39.019542  346092 ssh_runner.go:195] Run: sudo crictl images --output json

	I0803 23:48:39.058144  346092 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.3". assuming images are not preloaded.

	I0803 23:48:39.058231  346092 ssh_runner.go:195] Run: which lz4

	I0803 23:48:39.062491  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0803 23:48:39.062602  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0803 23:48:39.066958  346092 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0803 23:48:39.067007  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (406200976 bytes)

	I0803 23:48:40.528763  346092 crio.go:462] duration metric: took 1.466185715s to copy over tarball

	I0803 23:48:40.528870  346092 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0803 23:48:42.691815  346092 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.162903819s)

	I0803 23:48:42.691850  346092 crio.go:469] duration metric: took 2.163033059s to extract the tarball

	I0803 23:48:42.691861  346092 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0803 23:48:42.730485  346092 ssh_runner.go:195] Run: sudo crictl images --output json

	I0803 23:48:42.778939  346092 crio.go:514] all images are preloaded for cri-o runtime.

	I0803 23:48:42.778965  346092 cache_images.go:84] Images are preloaded, skipping loading

	I0803 23:48:42.778978  346092 kubeadm.go:934] updating node { 192.168.39.168 8443 v1.30.3 crio true true} ...

	I0803 23:48:42.779117  346092 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-349588 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.168

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:48:42.779205  346092 ssh_runner.go:195] Run: crio config

	I0803 23:48:42.828670  346092 cni.go:84] Creating CNI manager for ""

	I0803 23:48:42.828702  346092 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0803 23:48:42.828719  346092 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0803 23:48:42.828744  346092 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.168 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-349588 NodeName:ha-349588 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.168"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.168 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0803 23:48:42.828899  346092 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.168

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-349588"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.168

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.168"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0803 23:48:42.828929  346092 kube-vip.go:115] generating kube-vip config ...

	I0803 23:48:42.828978  346092 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0803 23:48:42.847620  346092 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0803 23:48:42.847740  346092 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0803 23:48:42.847794  346092 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:48:42.858826  346092 binaries.go:44] Found k8s binaries, skipping transfer

	I0803 23:48:42.858911  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0803 23:48:42.869873  346092 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0803 23:48:42.888649  346092 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:48:42.906568  346092 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0803 23:48:42.924948  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0803 23:48:42.942182  346092 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0803 23:48:42.946393  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:48:42.959877  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:48:43.090573  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:48:43.109673  346092 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588 for IP: 192.168.39.168

	I0803 23:48:43.109707  346092 certs.go:194] generating shared ca certs ...

	I0803 23:48:43.109736  346092 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.109935  346092 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:48:43.109995  346092 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:48:43.110016  346092 certs.go:256] generating profile certs ...

	I0803 23:48:43.110095  346092 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key

	I0803 23:48:43.110115  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt with IP's: []

	I0803 23:48:43.176202  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt ...

	I0803 23:48:43.176243  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt: {Name:mk8846af52ab7192f012806995ca5756c43d9aa4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.176414  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key ...

	I0803 23:48:43.176426  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key: {Name:mk3c59388753fea20f89d92bf03bdfc970c14c5e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.176505  346092 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad

	I0803 23:48:43.176520  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.168 192.168.39.254]

	I0803 23:48:43.323353  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad ...

	I0803 23:48:43.323387  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad: {Name:mk8daf6ee6cbba709dc68563d6432752e9aeecab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.323547  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad ...

	I0803 23:48:43.323560  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad: {Name:mkbb0f47da156ebcc5042f70a6f380500f1cb64c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.323633  346092 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.92d048ad -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt

	I0803 23:48:43.323725  346092 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.92d048ad -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key

	I0803 23:48:43.323784  346092 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key

	I0803 23:48:43.323798  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt with IP's: []

	I0803 23:48:43.488751  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt ...

	I0803 23:48:43.488786  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt: {Name:mk0d9fb306df1ed4b7eeba1f21c32111bb96f6c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.488947  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key ...

	I0803 23:48:43.488958  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key: {Name:mkb23eaf410419e953894e823db49217d4b5f172 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:48:43.489031  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0803 23:48:43.489065  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0803 23:48:43.489088  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0803 23:48:43.489102  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0803 23:48:43.489116  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0803 23:48:43.489130  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0803 23:48:43.489142  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0803 23:48:43.489155  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0803 23:48:43.489236  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem (1338 bytes)

	W0803 23:48:43.489273  346092 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097_empty.pem, impossibly tiny 0 bytes

	I0803 23:48:43.489282  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:48:43.489304  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:48:43.489326  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:48:43.489346  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:48:43.489382  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:48:43.489420  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem -> /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.489441  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.489453  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.490082  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:48:43.517725  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:48:43.543526  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:48:43.568742  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:48:43.594201  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0803 23:48:43.620048  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0803 23:48:43.644985  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:48:43.677146  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0803 23:48:43.703176  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem --> /usr/share/ca-certificates/331097.pem (1338 bytes)

	I0803 23:48:43.727682  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /usr/share/ca-certificates/3310972.pem (1708 bytes)

	I0803 23:48:43.752318  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:48:43.777458  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0803 23:48:43.794903  346092 ssh_runner.go:195] Run: openssl version

	I0803 23:48:43.801030  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/331097.pem && ln -fs /usr/share/ca-certificates/331097.pem /etc/ssl/certs/331097.pem"

	I0803 23:48:43.812834  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.817558  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  3 23:44 /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.817619  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/331097.pem

	I0803 23:48:43.823759  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/331097.pem /etc/ssl/certs/51391683.0"

	I0803 23:48:43.834807  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3310972.pem && ln -fs /usr/share/ca-certificates/3310972.pem /etc/ssl/certs/3310972.pem"

	I0803 23:48:43.845824  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.850583  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  3 23:44 /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.850645  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3310972.pem

	I0803 23:48:43.856639  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3310972.pem /etc/ssl/certs/3ec20f2e.0"

	I0803 23:48:43.868327  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:48:43.880525  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.885320  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.885395  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:48:43.891760  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:48:43.906642  346092 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:48:43.916110  346092 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:48:43.916210  346092 kubeadm.go:392] StartCluster: {Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Clust

erName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:48:43.916326  346092 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0803 23:48:43.916400  346092 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0803 23:48:43.980609  346092 cri.go:89] found id: ""

	I0803 23:48:43.980701  346092 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0803 23:48:43.996519  346092 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0803 23:48:44.010446  346092 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0803 23:48:44.024303  346092 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0803 23:48:44.024325  346092 kubeadm.go:157] found existing configuration files:

	I0803 23:48:44.024387  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0803 23:48:44.034689  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0803 23:48:44.034769  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0803 23:48:44.045767  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0803 23:48:44.056709  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0803 23:48:44.056781  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0803 23:48:44.067638  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0803 23:48:44.077701  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0803 23:48:44.077809  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0803 23:48:44.088461  346092 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0803 23:48:44.098545  346092 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0803 23:48:44.098609  346092 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0803 23:48:44.109113  346092 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0803 23:48:44.215580  346092 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3

	I0803 23:48:44.215831  346092 kubeadm.go:310] [preflight] Running pre-flight checks

	I0803 23:48:44.347666  346092 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0803 23:48:44.347842  346092 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0803 23:48:44.348003  346092 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0803 23:48:44.559912  346092 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0803 23:48:44.623290  346092 out.go:204]   - Generating certificates and keys ...

	I0803 23:48:44.623399  346092 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0803 23:48:44.623498  346092 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0803 23:48:44.677872  346092 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0803 23:48:45.161412  346092 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0803 23:48:45.359698  346092 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0803 23:48:45.509093  346092 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0803 23:48:45.735838  346092 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0803 23:48:45.736073  346092 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-349588 localhost] and IPs [192.168.39.168 127.0.0.1 ::1]

	I0803 23:48:45.868983  346092 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0803 23:48:45.869145  346092 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-349588 localhost] and IPs [192.168.39.168 127.0.0.1 ::1]

	I0803 23:48:45.939849  346092 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0803 23:48:46.488546  346092 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0803 23:48:46.609445  346092 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0803 23:48:46.609584  346092 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0803 23:48:46.913292  346092 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0803 23:48:47.075011  346092 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0803 23:48:47.280716  346092 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0803 23:48:47.381369  346092 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0803 23:48:47.425104  346092 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0803 23:48:47.425771  346092 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0803 23:48:47.430790  346092 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0803 23:48:47.432462  346092 out.go:204]   - Booting up control plane ...

	I0803 23:48:47.432572  346092 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0803 23:48:47.432670  346092 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0803 23:48:47.432761  346092 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0803 23:48:47.451505  346092 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0803 23:48:47.452518  346092 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0803 23:48:47.452610  346092 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0803 23:48:47.581671  346092 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0803 23:48:47.581778  346092 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0803 23:48:48.582643  346092 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001457349s

	I0803 23:48:48.582750  346092 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0803 23:48:54.290536  346092 kubeadm.go:310] [api-check] The API server is healthy after 5.710287165s

	I0803 23:48:54.303491  346092 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0803 23:48:54.323699  346092 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0803 23:48:54.354226  346092 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0803 23:48:54.354458  346092 kubeadm.go:310] [mark-control-plane] Marking the node ha-349588 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0803 23:48:54.369768  346092 kubeadm.go:310] [bootstrap-token] Using token: vmd729.4ijgfu3uo5k2v1gw

	I0803 23:48:54.371222  346092 out.go:204]   - Configuring RBAC rules ...

	I0803 23:48:54.371383  346092 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0803 23:48:54.384821  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0803 23:48:54.400057  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0803 23:48:54.403731  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0803 23:48:54.408140  346092 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0803 23:48:54.416162  346092 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0803 23:48:54.701480  346092 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0803 23:48:55.157420  346092 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0803 23:48:55.698866  346092 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0803 23:48:55.698893  346092 kubeadm.go:310] 

	I0803 23:48:55.699005  346092 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0803 23:48:55.699032  346092 kubeadm.go:310] 

	I0803 23:48:55.699132  346092 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0803 23:48:55.699142  346092 kubeadm.go:310] 

	I0803 23:48:55.699181  346092 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0803 23:48:55.699255  346092 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0803 23:48:55.699320  346092 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0803 23:48:55.699330  346092 kubeadm.go:310] 

	I0803 23:48:55.699410  346092 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0803 23:48:55.699418  346092 kubeadm.go:310] 

	I0803 23:48:55.699495  346092 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0803 23:48:55.699514  346092 kubeadm.go:310] 

	I0803 23:48:55.699557  346092 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0803 23:48:55.699622  346092 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0803 23:48:55.699684  346092 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0803 23:48:55.699690  346092 kubeadm.go:310] 

	I0803 23:48:55.699764  346092 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0803 23:48:55.699833  346092 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0803 23:48:55.699839  346092 kubeadm.go:310] 

	I0803 23:48:55.699954  346092 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token vmd729.4ijgfu3uo5k2v1gw \

	I0803 23:48:55.700069  346092 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c \

	I0803 23:48:55.700090  346092 kubeadm.go:310] 	--control-plane 

	I0803 23:48:55.700094  346092 kubeadm.go:310] 

	I0803 23:48:55.700168  346092 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0803 23:48:55.700181  346092 kubeadm.go:310] 

	I0803 23:48:55.700261  346092 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token vmd729.4ijgfu3uo5k2v1gw \

	I0803 23:48:55.700368  346092 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c 

	I0803 23:48:55.701070  346092 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0803 23:48:55.701096  346092 cni.go:84] Creating CNI manager for ""

	I0803 23:48:55.701103  346092 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0803 23:48:55.702841  346092 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0803 23:48:55.704052  346092 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0803 23:48:55.709875  346092 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...

	I0803 23:48:55.709897  346092 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0803 23:48:55.735301  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0803 23:48:56.119562  346092 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0803 23:48:56.119694  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-349588 minikube.k8s.io/updated_at=2024_08_03T23_48_56_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=ha-349588 minikube.k8s.io/primary=true

	I0803 23:48:56.119699  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:56.147094  346092 ops.go:34] apiserver oom_adj: -16

	I0803 23:48:56.339836  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:56.840689  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:57.339892  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:57.840550  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:58.340862  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:58.840451  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:59.339991  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:48:59.840655  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:00.340322  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:00.840255  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:01.340913  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:01.840915  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:02.340929  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:02.840491  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:03.339993  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:03.840488  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:04.340852  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:04.840324  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:05.339902  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:05.840734  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:06.339995  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:06.840443  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:07.340744  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:07.840499  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0803 23:49:07.945567  346092 kubeadm.go:1113] duration metric: took 11.825936372s to wait for elevateKubeSystemPrivileges

	I0803 23:49:07.945620  346092 kubeadm.go:394] duration metric: took 24.029418072s to StartCluster

	I0803 23:49:07.945649  346092 settings.go:142] acquiring lock: {Name:mk918fd72253bf33e8bae308fd36ed8b1c353763 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:07.945731  346092 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:49:07.946576  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/kubeconfig: {Name:mkd789cdd11c6330d283dbc76129ed198eb15398 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:07.946821  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0803 23:49:07.946833  346092 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:49:07.946857  346092 start.go:241] waiting for startup goroutines ...

	I0803 23:49:07.946870  346092 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0803 23:49:07.946934  346092 addons.go:69] Setting storage-provisioner=true in profile "ha-349588"

	I0803 23:49:07.946952  346092 addons.go:69] Setting default-storageclass=true in profile "ha-349588"

	I0803 23:49:07.946967  346092 addons.go:234] Setting addon storage-provisioner=true in "ha-349588"

	I0803 23:49:07.946981  346092 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-349588"

	I0803 23:49:07.946996  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:07.947103  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:07.947486  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.947486  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.947519  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.947532  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.963361  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36977

	I0803 23:49:07.963699  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33815

	I0803 23:49:07.963950  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.964258  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.964486  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.964506  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.964822  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.964843  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.964892  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.965113  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:07.965322  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.965886  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.965916  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.967448  346092 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:49:07.967821  346092 kapi.go:59] client config for ha-349588: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt", KeyFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key", CAFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02f40), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0803 23:49:07.968419  346092 cert_rotation.go:137] Starting client certificate rotation controller

	I0803 23:49:07.968706  346092 addons.go:234] Setting addon default-storageclass=true in "ha-349588"

	I0803 23:49:07.968758  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:07.969038  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.969082  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.981268  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43065

	I0803 23:49:07.981760  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.982406  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.982449  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.982806  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.983026  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:07.984863  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:07.984975  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43115

	I0803 23:49:07.985529  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:07.986001  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:07.986021  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:07.986315  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:07.986782  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:07.986817  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:07.986999  346092 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0803 23:49:07.988373  346092 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0803 23:49:07.988390  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0803 23:49:07.988406  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:07.991634  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:07.992145  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:07.992175  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:07.992401  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:07.992624  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:07.992802  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:07.992977  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:08.004028  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41705

	I0803 23:49:08.004521  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:08.004986  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:08.005008  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:08.005356  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:08.005562  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:08.007175  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:08.007434  346092 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0803 23:49:08.007453  346092 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0803 23:49:08.007479  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:08.010032  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:08.010474  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:08.010504  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:08.010667  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:08.010853  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:08.011029  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:08.011165  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:08.072504  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0803 23:49:08.190173  346092 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0803 23:49:08.206987  346092 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0803 23:49:08.632401  346092 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0803 23:49:09.027910  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.027947  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.027987  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.028010  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.028254  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028269  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028278  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.028285  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.028315  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028333  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028343  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.028350  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.028534  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028546  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028690  346092 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0803 23:49:09.028698  346092 round_trippers.go:469] Request Headers:

	I0803 23:49:09.028710  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:49:09.028714  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:49:09.028850  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.028876  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.028916  346092 main.go:141] libmachine: (ha-349588) DBG | Closing plugin on server side

	I0803 23:49:09.058640  346092 round_trippers.go:574] Response Status: 200 OK in 29 milliseconds

	I0803 23:49:09.059232  346092 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0803 23:49:09.059248  346092 round_trippers.go:469] Request Headers:

	I0803 23:49:09.059257  346092 round_trippers.go:473]     Content-Type: application/json

	I0803 23:49:09.059262  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:49:09.059267  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:49:09.065033  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:49:09.065333  346092 main.go:141] libmachine: Making call to close driver server

	I0803 23:49:09.065358  346092 main.go:141] libmachine: (ha-349588) Calling .Close

	I0803 23:49:09.065669  346092 main.go:141] libmachine: Successfully made call to close driver server

	I0803 23:49:09.065690  346092 main.go:141] libmachine: Making call to close connection to plugin binary

	I0803 23:49:09.067539  346092 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0803 23:49:09.068807  346092 addons.go:510] duration metric: took 1.121931039s for enable addons: enabled=[storage-provisioner default-storageclass]

	I0803 23:49:09.068867  346092 start.go:246] waiting for cluster config update ...

	I0803 23:49:09.068886  346092 start.go:255] writing updated cluster config ...

	I0803 23:49:09.070612  346092 out.go:177] 

	I0803 23:49:09.072304  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:09.072402  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:49:09.074300  346092 out.go:177] * Starting "ha-349588-m02" control-plane node in "ha-349588" cluster

	I0803 23:49:09.075715  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:49:09.075749  346092 cache.go:56] Caching tarball of preloaded images

	I0803 23:49:09.075867  346092 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:49:09.075882  346092 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:49:09.075999  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:49:09.076295  346092 start.go:360] acquireMachinesLock for ha-349588-m02: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:49:09.076362  346092 start.go:364] duration metric: took 35.831µs to acquireMachinesLock for "ha-349588-m02"

	I0803 23:49:09.076384  346092 start.go:93] Provisioning new machine with config: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:49:09.076493  346092 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0803 23:49:09.079072  346092 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0803 23:49:09.079194  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:09.079228  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:09.095204  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33787

	I0803 23:49:09.095749  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:09.096322  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:09.096359  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:09.096849  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:09.097061  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:09.097232  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:09.097411  346092 start.go:159] libmachine.API.Create for "ha-349588" (driver="kvm2")

	I0803 23:49:09.097439  346092 client.go:168] LocalClient.Create starting

	I0803 23:49:09.097476  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:49:09.097545  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:49:09.097588  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:49:09.097649  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:49:09.097670  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:49:09.097681  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:49:09.097699  346092 main.go:141] libmachine: Running pre-create checks...

	I0803 23:49:09.097715  346092 main.go:141] libmachine: (ha-349588-m02) Calling .PreCreateCheck

	I0803 23:49:09.097887  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetConfigRaw

	I0803 23:49:09.098333  346092 main.go:141] libmachine: Creating machine...

	I0803 23:49:09.098349  346092 main.go:141] libmachine: (ha-349588-m02) Calling .Create

	I0803 23:49:09.098480  346092 main.go:141] libmachine: (ha-349588-m02) Creating KVM machine...

	I0803 23:49:09.099793  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found existing default KVM network

	I0803 23:49:09.099966  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found existing private KVM network mk-ha-349588

	I0803 23:49:09.100121  346092 main.go:141] libmachine: (ha-349588-m02) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02 ...

	I0803 23:49:09.100150  346092 main.go:141] libmachine: (ha-349588-m02) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:49:09.100241  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.100120  346511 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:49:09.100390  346092 main.go:141] libmachine: (ha-349588-m02) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:49:09.392884  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.392736  346511 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa...

	I0803 23:49:09.506019  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.505833  346511 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/ha-349588-m02.rawdisk...

	I0803 23:49:09.506078  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Writing magic tar header

	I0803 23:49:09.506097  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Writing SSH key tar header

	I0803 23:49:09.506110  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:09.505972  346511 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02 ...

	I0803 23:49:09.506140  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02

	I0803 23:49:09.506180  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:49:09.506197  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02 (perms=drwx------)

	I0803 23:49:09.506214  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:49:09.506255  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:49:09.506271  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:49:09.506284  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:49:09.506299  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:49:09.506311  346092 main.go:141] libmachine: (ha-349588-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:49:09.506322  346092 main.go:141] libmachine: (ha-349588-m02) Creating domain...

	I0803 23:49:09.506337  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:49:09.506348  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:49:09.506358  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:49:09.506369  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Checking permissions on dir: /home

	I0803 23:49:09.506379  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Skipping /home - not owner

	I0803 23:49:09.507461  346092 main.go:141] libmachine: (ha-349588-m02) define libvirt domain using xml: 

	I0803 23:49:09.507488  346092 main.go:141] libmachine: (ha-349588-m02) <domain type='kvm'>

	I0803 23:49:09.507498  346092 main.go:141] libmachine: (ha-349588-m02)   <name>ha-349588-m02</name>

	I0803 23:49:09.507513  346092 main.go:141] libmachine: (ha-349588-m02)   <memory unit='MiB'>2200</memory>

	I0803 23:49:09.507523  346092 main.go:141] libmachine: (ha-349588-m02)   <vcpu>2</vcpu>

	I0803 23:49:09.507530  346092 main.go:141] libmachine: (ha-349588-m02)   <features>

	I0803 23:49:09.507539  346092 main.go:141] libmachine: (ha-349588-m02)     <acpi/>

	I0803 23:49:09.507547  346092 main.go:141] libmachine: (ha-349588-m02)     <apic/>

	I0803 23:49:09.507555  346092 main.go:141] libmachine: (ha-349588-m02)     <pae/>

	I0803 23:49:09.507564  346092 main.go:141] libmachine: (ha-349588-m02)     

	I0803 23:49:09.507572  346092 main.go:141] libmachine: (ha-349588-m02)   </features>

	I0803 23:49:09.507586  346092 main.go:141] libmachine: (ha-349588-m02)   <cpu mode='host-passthrough'>

	I0803 23:49:09.507596  346092 main.go:141] libmachine: (ha-349588-m02)   

	I0803 23:49:09.507604  346092 main.go:141] libmachine: (ha-349588-m02)   </cpu>

	I0803 23:49:09.507615  346092 main.go:141] libmachine: (ha-349588-m02)   <os>

	I0803 23:49:09.507625  346092 main.go:141] libmachine: (ha-349588-m02)     <type>hvm</type>

	I0803 23:49:09.507633  346092 main.go:141] libmachine: (ha-349588-m02)     <boot dev='cdrom'/>

	I0803 23:49:09.507643  346092 main.go:141] libmachine: (ha-349588-m02)     <boot dev='hd'/>

	I0803 23:49:09.507655  346092 main.go:141] libmachine: (ha-349588-m02)     <bootmenu enable='no'/>

	I0803 23:49:09.507688  346092 main.go:141] libmachine: (ha-349588-m02)   </os>

	I0803 23:49:09.507701  346092 main.go:141] libmachine: (ha-349588-m02)   <devices>

	I0803 23:49:09.507709  346092 main.go:141] libmachine: (ha-349588-m02)     <disk type='file' device='cdrom'>

	I0803 23:49:09.507752  346092 main.go:141] libmachine: (ha-349588-m02)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/boot2docker.iso'/>

	I0803 23:49:09.507779  346092 main.go:141] libmachine: (ha-349588-m02)       <target dev='hdc' bus='scsi'/>

	I0803 23:49:09.507793  346092 main.go:141] libmachine: (ha-349588-m02)       <readonly/>

	I0803 23:49:09.507804  346092 main.go:141] libmachine: (ha-349588-m02)     </disk>

	I0803 23:49:09.507816  346092 main.go:141] libmachine: (ha-349588-m02)     <disk type='file' device='disk'>

	I0803 23:49:09.507829  346092 main.go:141] libmachine: (ha-349588-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:49:09.507845  346092 main.go:141] libmachine: (ha-349588-m02)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/ha-349588-m02.rawdisk'/>

	I0803 23:49:09.507856  346092 main.go:141] libmachine: (ha-349588-m02)       <target dev='hda' bus='virtio'/>

	I0803 23:49:09.507867  346092 main.go:141] libmachine: (ha-349588-m02)     </disk>

	I0803 23:49:09.507877  346092 main.go:141] libmachine: (ha-349588-m02)     <interface type='network'>

	I0803 23:49:09.507891  346092 main.go:141] libmachine: (ha-349588-m02)       <source network='mk-ha-349588'/>

	I0803 23:49:09.507916  346092 main.go:141] libmachine: (ha-349588-m02)       <model type='virtio'/>

	I0803 23:49:09.507946  346092 main.go:141] libmachine: (ha-349588-m02)     </interface>

	I0803 23:49:09.507967  346092 main.go:141] libmachine: (ha-349588-m02)     <interface type='network'>

	I0803 23:49:09.507982  346092 main.go:141] libmachine: (ha-349588-m02)       <source network='default'/>

	I0803 23:49:09.507992  346092 main.go:141] libmachine: (ha-349588-m02)       <model type='virtio'/>

	I0803 23:49:09.508003  346092 main.go:141] libmachine: (ha-349588-m02)     </interface>

	I0803 23:49:09.508013  346092 main.go:141] libmachine: (ha-349588-m02)     <serial type='pty'>

	I0803 23:49:09.508026  346092 main.go:141] libmachine: (ha-349588-m02)       <target port='0'/>

	I0803 23:49:09.508041  346092 main.go:141] libmachine: (ha-349588-m02)     </serial>

	I0803 23:49:09.508068  346092 main.go:141] libmachine: (ha-349588-m02)     <console type='pty'>

	I0803 23:49:09.508087  346092 main.go:141] libmachine: (ha-349588-m02)       <target type='serial' port='0'/>

	I0803 23:49:09.508100  346092 main.go:141] libmachine: (ha-349588-m02)     </console>

	I0803 23:49:09.508108  346092 main.go:141] libmachine: (ha-349588-m02)     <rng model='virtio'>

	I0803 23:49:09.508122  346092 main.go:141] libmachine: (ha-349588-m02)       <backend model='random'>/dev/random</backend>

	I0803 23:49:09.508132  346092 main.go:141] libmachine: (ha-349588-m02)     </rng>

	I0803 23:49:09.508140  346092 main.go:141] libmachine: (ha-349588-m02)     

	I0803 23:49:09.508149  346092 main.go:141] libmachine: (ha-349588-m02)     

	I0803 23:49:09.508162  346092 main.go:141] libmachine: (ha-349588-m02)   </devices>

	I0803 23:49:09.508174  346092 main.go:141] libmachine: (ha-349588-m02) </domain>

	I0803 23:49:09.508186  346092 main.go:141] libmachine: (ha-349588-m02) 

	I0803 23:49:09.515269  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:7a:63:bd in network default

	I0803 23:49:09.515943  346092 main.go:141] libmachine: (ha-349588-m02) Ensuring networks are active...

	I0803 23:49:09.515967  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:09.516868  346092 main.go:141] libmachine: (ha-349588-m02) Ensuring network default is active

	I0803 23:49:09.517308  346092 main.go:141] libmachine: (ha-349588-m02) Ensuring network mk-ha-349588 is active

	I0803 23:49:09.517724  346092 main.go:141] libmachine: (ha-349588-m02) Getting domain xml...

	I0803 23:49:09.518644  346092 main.go:141] libmachine: (ha-349588-m02) Creating domain...

	I0803 23:49:10.755347  346092 main.go:141] libmachine: (ha-349588-m02) Waiting to get IP...

	I0803 23:49:10.756208  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:10.756617  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:10.756647  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:10.756592  346511 retry.go:31] will retry after 196.457708ms: waiting for machine to come up

	I0803 23:49:10.955123  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:10.955579  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:10.955605  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:10.955538  346511 retry.go:31] will retry after 314.513004ms: waiting for machine to come up

	I0803 23:49:11.272300  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:11.272803  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:11.272840  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:11.272737  346511 retry.go:31] will retry after 311.291518ms: waiting for machine to come up

	I0803 23:49:11.585254  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:11.585799  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:11.585830  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:11.585723  346511 retry.go:31] will retry after 523.229806ms: waiting for machine to come up

	I0803 23:49:12.110649  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:12.111090  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:12.111117  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:12.111031  346511 retry.go:31] will retry after 594.349932ms: waiting for machine to come up

	I0803 23:49:12.706604  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:12.707015  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:12.707046  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:12.706950  346511 retry.go:31] will retry after 579.421708ms: waiting for machine to come up

	I0803 23:49:13.287722  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:13.288146  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:13.288173  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:13.288098  346511 retry.go:31] will retry after 832.78526ms: waiting for machine to come up

	I0803 23:49:14.122636  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:14.123072  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:14.123097  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:14.123032  346511 retry.go:31] will retry after 1.40942689s: waiting for machine to come up

	I0803 23:49:15.534952  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:15.535443  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:15.535483  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:15.535391  346511 retry.go:31] will retry after 1.773682348s: waiting for machine to come up

	I0803 23:49:17.310303  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:17.310693  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:17.310720  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:17.310649  346511 retry.go:31] will retry after 2.230324158s: waiting for machine to come up

	I0803 23:49:19.542820  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:19.543326  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:19.543357  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:19.543274  346511 retry.go:31] will retry after 2.161656606s: waiting for machine to come up

	I0803 23:49:21.706940  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:21.707447  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:21.707472  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:21.707412  346511 retry.go:31] will retry after 2.578584432s: waiting for machine to come up

	I0803 23:49:24.287397  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:24.287819  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:24.287849  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:24.287767  346511 retry.go:31] will retry after 3.341759682s: waiting for machine to come up

	I0803 23:49:27.633275  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:27.633768  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find current IP address of domain ha-349588-m02 in network mk-ha-349588

	I0803 23:49:27.634003  346092 main.go:141] libmachine: (ha-349588-m02) DBG | I0803 23:49:27.633715  346511 retry.go:31] will retry after 4.956950166s: waiting for machine to come up

	I0803 23:49:32.592015  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.592451  346092 main.go:141] libmachine: (ha-349588-m02) Found IP for machine: 192.168.39.67

	I0803 23:49:32.592471  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has current primary IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.592477  346092 main.go:141] libmachine: (ha-349588-m02) Reserving static IP address...

	I0803 23:49:32.592850  346092 main.go:141] libmachine: (ha-349588-m02) DBG | unable to find host DHCP lease matching {name: "ha-349588-m02", mac: "52:54:00:c5:a2:30", ip: "192.168.39.67"} in network mk-ha-349588

	I0803 23:49:32.671097  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Getting to WaitForSSH function...

	I0803 23:49:32.671127  346092 main.go:141] libmachine: (ha-349588-m02) Reserved static IP address: 192.168.39.67

	I0803 23:49:32.671140  346092 main.go:141] libmachine: (ha-349588-m02) Waiting for SSH to be available...

	I0803 23:49:32.674109  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.674564  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:32.674591  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.674755  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Using SSH client type: external

	I0803 23:49:32.674775  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa (-rw-------)

	I0803 23:49:32.674832  346092 main.go:141] libmachine: (ha-349588-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.67 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:49:32.674867  346092 main.go:141] libmachine: (ha-349588-m02) DBG | About to run SSH command:

	I0803 23:49:32.674884  346092 main.go:141] libmachine: (ha-349588-m02) DBG | exit 0

	I0803 23:49:32.797788  346092 main.go:141] libmachine: (ha-349588-m02) DBG | SSH cmd err, output: <nil>: 

	I0803 23:49:32.798082  346092 main.go:141] libmachine: (ha-349588-m02) KVM machine creation complete!

	I0803 23:49:32.798388  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetConfigRaw

	I0803 23:49:32.798971  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:32.799188  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:32.799417  346092 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:49:32.799435  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetState

	I0803 23:49:32.800912  346092 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:49:32.800962  346092 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:49:32.800974  346092 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:49:32.800983  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:32.803140  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.803577  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:32.803607  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.803746  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:32.803953  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.804142  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.804329  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:32.804496  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:32.804723  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:32.804734  346092 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:49:32.905099  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:49:32.905127  346092 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:49:32.905135  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:32.908228  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.908609  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:32.908632  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:32.908801  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:32.909041  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.909218  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:32.909340  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:32.909571  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:32.909828  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:32.909842  346092 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:49:33.015154  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:49:33.015233  346092 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:49:33.015243  346092 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:49:33.015251  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:33.015518  346092 buildroot.go:166] provisioning hostname "ha-349588-m02"

	I0803 23:49:33.015547  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:33.015814  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.018501  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.018958  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.018992  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.019139  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.019322  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.019503  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.019644  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.019793  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:33.019965  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:33.019979  346092 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-349588-m02 && echo "ha-349588-m02" | sudo tee /etc/hostname

	I0803 23:49:33.137434  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-349588-m02

	I0803 23:49:33.137463  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.140293  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.140675  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.140702  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.140906  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.141108  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.141288  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.141456  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.141647  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:33.141861  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:33.141889  346092 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-349588-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-349588-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-349588-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:49:33.255392  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:49:33.255436  346092 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:49:33.255459  346092 buildroot.go:174] setting up certificates

	I0803 23:49:33.255472  346092 provision.go:84] configureAuth start

	I0803 23:49:33.255487  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetMachineName

	I0803 23:49:33.255787  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:33.258331  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.258649  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.258678  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.258872  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.260786  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.261093  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.261133  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.261245  346092 provision.go:143] copyHostCerts

	I0803 23:49:33.261291  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:49:33.261335  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem, removing ...

	I0803 23:49:33.261348  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:49:33.261441  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:49:33.261586  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:49:33.261610  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem, removing ...

	I0803 23:49:33.261617  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:49:33.261649  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:49:33.261693  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:49:33.261709  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem, removing ...

	I0803 23:49:33.261715  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:49:33.261736  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:49:33.261796  346092 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.ha-349588-m02 san=[127.0.0.1 192.168.39.67 ha-349588-m02 localhost minikube]

	I0803 23:49:33.513319  346092 provision.go:177] copyRemoteCerts

	I0803 23:49:33.513401  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:49:33.513438  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.516462  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.516819  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.516856  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.517011  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.517238  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.517393  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.517618  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:33.600517  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0803 23:49:33.600605  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:49:33.630035  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0803 23:49:33.630119  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0803 23:49:33.659132  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0803 23:49:33.659199  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0803 23:49:33.693181  346092 provision.go:87] duration metric: took 437.692464ms to configureAuth

	I0803 23:49:33.693210  346092 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:49:33.693426  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:33.693563  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.696446  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.696934  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.696969  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.697212  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.697497  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.697727  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.698031  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.698216  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:33.698403  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:33.698424  346092 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:49:33.959540  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:49:33.959581  346092 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:49:33.959593  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetURL

	I0803 23:49:33.960929  346092 main.go:141] libmachine: (ha-349588-m02) DBG | Using libvirt version 6000000

	I0803 23:49:33.963512  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.963899  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.963929  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.964106  346092 main.go:141] libmachine: Docker is up and running!

	I0803 23:49:33.964121  346092 main.go:141] libmachine: Reticulating splines...

	I0803 23:49:33.964130  346092 client.go:171] duration metric: took 24.866682664s to LocalClient.Create

	I0803 23:49:33.964160  346092 start.go:167] duration metric: took 24.866749901s to libmachine.API.Create "ha-349588"

	I0803 23:49:33.964172  346092 start.go:293] postStartSetup for "ha-349588-m02" (driver="kvm2")

	I0803 23:49:33.964187  346092 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:49:33.964221  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:33.964513  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:49:33.964545  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:33.966907  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.967233  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:33.967264  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:33.967403  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:33.967604  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:33.967771  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:33.967915  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:34.048442  346092 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:49:34.052707  346092 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:49:34.052737  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:49:34.052818  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:49:34.052927  346092 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> 3310972.pem in /etc/ssl/certs

	I0803 23:49:34.052941  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /etc/ssl/certs/3310972.pem

	I0803 23:49:34.053050  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0803 23:49:34.063171  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:49:34.087600  346092 start.go:296] duration metric: took 123.413254ms for postStartSetup

	I0803 23:49:34.087662  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetConfigRaw

	I0803 23:49:34.088269  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:34.091450  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.091855  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.091886  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.092198  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:49:34.092466  346092 start.go:128] duration metric: took 25.015961226s to createHost

	I0803 23:49:34.092491  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:34.094844  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.095181  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.095213  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.095338  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:34.095493  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.095609  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.095704  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:34.095817  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:49:34.096032  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.67 22 <nil> <nil>}

	I0803 23:49:34.096044  346092 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0803 23:49:34.198875  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722728974.174689570

	I0803 23:49:34.198914  346092 fix.go:216] guest clock: 1722728974.174689570

	I0803 23:49:34.198924  346092 fix.go:229] Guest: 2024-08-03 23:49:34.17468957 +0000 UTC Remote: 2024-08-03 23:49:34.092479911 +0000 UTC m=+84.709898585 (delta=82.209659ms)

	I0803 23:49:34.198942  346092 fix.go:200] guest clock delta is within tolerance: 82.209659ms

	I0803 23:49:34.198947  346092 start.go:83] releasing machines lock for "ha-349588-m02", held for 25.122576839s

	I0803 23:49:34.198968  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.199261  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:34.202135  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.202517  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.202542  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.204728  346092 out.go:177] * Found network options:

	I0803 23:49:34.206084  346092 out.go:177]   - NO_PROXY=192.168.39.168

	W0803 23:49:34.207413  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:49:34.207457  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.208191  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.208417  346092 main.go:141] libmachine: (ha-349588-m02) Calling .DriverName

	I0803 23:49:34.208530  346092 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:49:34.208577  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	W0803 23:49:34.208720  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:49:34.208822  346092 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:49:34.208847  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHHostname

	I0803 23:49:34.211895  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.211921  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.212318  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.212350  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:34.212374  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.212388  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:34.212549  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:34.212667  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHPort

	I0803 23:49:34.212745  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.212837  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHKeyPath

	I0803 23:49:34.212868  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:34.212971  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetSSHUsername

	I0803 23:49:34.213014  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:34.213205  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.67 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m02/id_rsa Username:docker}

	I0803 23:49:34.447882  346092 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:49:34.454498  346092 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:49:34.454573  346092 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:49:34.471269  346092 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:49:34.471295  346092 start.go:495] detecting cgroup driver to use...

	I0803 23:49:34.471359  346092 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:49:34.488153  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:49:34.503703  346092 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:49:34.503780  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:49:34.518917  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:49:34.534021  346092 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:49:34.650977  346092 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:49:34.798998  346092 docker.go:233] disabling docker service ...

	I0803 23:49:34.799082  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:49:34.814209  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:49:34.828385  346092 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:49:34.970942  346092 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:49:35.098562  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:49:35.113143  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:49:35.132472  346092 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:49:35.132547  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.143835  346092 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:49:35.143943  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.155440  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.167348  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.178602  346092 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:49:35.190200  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.201259  346092 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.220070  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:49:35.231425  346092 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:49:35.241477  346092 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:49:35.241554  346092 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:49:35.255830  346092 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:49:35.265769  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:49:35.386227  346092 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:49:35.520835  346092 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:49:35.520906  346092 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:49:35.526284  346092 start.go:563] Will wait 60s for crictl version

	I0803 23:49:35.526385  346092 ssh_runner.go:195] Run: which crictl

	I0803 23:49:35.530619  346092 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:49:35.572868  346092 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:49:35.572976  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:49:35.602425  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:49:35.633811  346092 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:49:35.634957  346092 out.go:177]   - env NO_PROXY=192.168.39.168

	I0803 23:49:35.636018  346092 main.go:141] libmachine: (ha-349588-m02) Calling .GetIP

	I0803 23:49:35.638807  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:35.639117  346092 main.go:141] libmachine: (ha-349588-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:a2:30", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:49:24 +0000 UTC Type:0 Mac:52:54:00:c5:a2:30 Iaid: IPaddr:192.168.39.67 Prefix:24 Hostname:ha-349588-m02 Clientid:01:52:54:00:c5:a2:30}

	I0803 23:49:35.639150  346092 main.go:141] libmachine: (ha-349588-m02) DBG | domain ha-349588-m02 has defined IP address 192.168.39.67 and MAC address 52:54:00:c5:a2:30 in network mk-ha-349588

	I0803 23:49:35.639321  346092 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:49:35.643666  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:49:35.656809  346092 mustload.go:65] Loading cluster: ha-349588

	I0803 23:49:35.657051  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:49:35.657322  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:35.657356  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:35.673016  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40289

	I0803 23:49:35.673600  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:35.674137  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:35.674163  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:35.674524  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:35.674729  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:49:35.676374  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:35.676762  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:35.676801  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:35.692471  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46379

	I0803 23:49:35.692902  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:35.693448  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:35.693472  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:35.693833  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:35.694035  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:35.694192  346092 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588 for IP: 192.168.39.67

	I0803 23:49:35.694204  346092 certs.go:194] generating shared ca certs ...

	I0803 23:49:35.694223  346092 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:35.694426  346092 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:49:35.694494  346092 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:49:35.694507  346092 certs.go:256] generating profile certs ...

	I0803 23:49:35.694605  346092 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key

	I0803 23:49:35.694640  346092 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71

	I0803 23:49:35.694659  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.168 192.168.39.67 192.168.39.254]

	I0803 23:49:35.917497  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71 ...

	I0803 23:49:35.917544  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71: {Name:mke951f82b9c8987c94f55cf17d3747067a5c196 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:35.917758  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71 ...

	I0803 23:49:35.917774  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71: {Name:mk02505c8ddb9ca87fb327815bc5ef9322277b2e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:49:35.917868  346092 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.22f6dd71 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt

	I0803 23:49:35.918007  346092 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.22f6dd71 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key

	I0803 23:49:35.918138  346092 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key

	I0803 23:49:35.918156  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0803 23:49:35.918172  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0803 23:49:35.918186  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0803 23:49:35.918202  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0803 23:49:35.918215  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0803 23:49:35.918227  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0803 23:49:35.918239  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0803 23:49:35.918251  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0803 23:49:35.918299  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem (1338 bytes)

	W0803 23:49:35.918329  346092 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097_empty.pem, impossibly tiny 0 bytes

	I0803 23:49:35.918338  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:49:35.918360  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:49:35.918384  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:49:35.918404  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:49:35.918441  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:49:35.918466  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem -> /usr/share/ca-certificates/331097.pem

	I0803 23:49:35.918480  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /usr/share/ca-certificates/3310972.pem

	I0803 23:49:35.918490  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:35.918524  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:35.921612  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:35.922060  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:35.922086  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:35.922268  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:35.922528  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:35.922696  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:35.922862  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:35.993968  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0803 23:49:35.999189  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0803 23:49:36.012984  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0803 23:49:36.017711  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0803 23:49:36.030643  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0803 23:49:36.035338  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0803 23:49:36.046723  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0803 23:49:36.051542  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0803 23:49:36.063687  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0803 23:49:36.068111  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0803 23:49:36.079721  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0803 23:49:36.084574  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0803 23:49:36.097214  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:49:36.123871  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:49:36.150504  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:49:36.176044  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:49:36.201207  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0803 23:49:36.226385  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0803 23:49:36.251236  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:49:36.276179  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0803 23:49:36.300943  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem --> /usr/share/ca-certificates/331097.pem (1338 bytes)

	I0803 23:49:36.326134  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /usr/share/ca-certificates/3310972.pem (1708 bytes)

	I0803 23:49:36.351169  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:49:36.376713  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0803 23:49:36.394851  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0803 23:49:36.412839  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0803 23:49:36.429967  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0803 23:49:36.447330  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0803 23:49:36.465224  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0803 23:49:36.484948  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0803 23:49:36.504399  346092 ssh_runner.go:195] Run: openssl version

	I0803 23:49:36.510609  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:49:36.522136  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:36.527204  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:36.527286  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:49:36.533370  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:49:36.545165  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/331097.pem && ln -fs /usr/share/ca-certificates/331097.pem /etc/ssl/certs/331097.pem"

	I0803 23:49:36.557561  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/331097.pem

	I0803 23:49:36.562446  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  3 23:44 /usr/share/ca-certificates/331097.pem

	I0803 23:49:36.562514  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/331097.pem

	I0803 23:49:36.568768  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/331097.pem /etc/ssl/certs/51391683.0"

	I0803 23:49:36.580483  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3310972.pem && ln -fs /usr/share/ca-certificates/3310972.pem /etc/ssl/certs/3310972.pem"

	I0803 23:49:36.592809  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3310972.pem

	I0803 23:49:36.598103  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  3 23:44 /usr/share/ca-certificates/3310972.pem

	I0803 23:49:36.598176  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3310972.pem

	I0803 23:49:36.604409  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3310972.pem /etc/ssl/certs/3ec20f2e.0"

	I0803 23:49:36.616058  346092 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:49:36.620743  346092 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:49:36.620797  346092 kubeadm.go:934] updating node {m02 192.168.39.67 8443 v1.30.3 crio true true} ...

	I0803 23:49:36.620884  346092 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-349588-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.67

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:49:36.620910  346092 kube-vip.go:115] generating kube-vip config ...

	I0803 23:49:36.620954  346092 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0803 23:49:36.638507  346092 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0803 23:49:36.638607  346092 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0803 23:49:36.638675  346092 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:49:36.649343  346092 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0803 23:49:36.649405  346092 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0803 23:49:36.661547  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0803 23:49:36.661580  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:49:36.661674  346092 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet

	I0803 23:49:36.661683  346092 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm

	I0803 23:49:36.661689  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:49:36.666174  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0803 23:49:36.666213  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0803 23:49:37.652314  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:49:37.669824  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:49:37.669973  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:49:37.674869  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0803 23:49:37.674913  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0803 23:49:39.850597  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:49:39.850682  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:49:39.855926  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0803 23:49:39.855963  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0803 23:49:40.108212  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0803 23:49:40.119630  346092 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0803 23:49:40.137422  346092 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:49:40.154245  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0803 23:49:40.171440  346092 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0803 23:49:40.175867  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:49:40.189078  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:49:40.320235  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:49:40.338074  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:49:40.338438  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:49:40.338480  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:49:40.354264  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41067

	I0803 23:49:40.354726  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:49:40.355217  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:49:40.355240  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:49:40.355602  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:49:40.355803  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:49:40.355978  346092 start.go:317] joinCluster: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration

:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:49:40.356124  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0803 23:49:40.356168  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:49:40.359343  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:40.359840  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:49:40.359873  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:49:40.360005  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:49:40.360235  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:49:40.360419  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:49:40.360578  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:49:40.515090  346092 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:49:40.515146  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token wojua7.acwoc7lubp2sjzye --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m02 --control-plane --apiserver-advertise-address=192.168.39.67 --apiserver-bind-port=8443"

	I0803 23:50:02.946975  346092 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token wojua7.acwoc7lubp2sjzye --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m02 --control-plane --apiserver-advertise-address=192.168.39.67 --apiserver-bind-port=8443": (22.431790037s)

	I0803 23:50:02.947019  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0803 23:50:03.446614  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-349588-m02 minikube.k8s.io/updated_at=2024_08_03T23_50_03_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=ha-349588 minikube.k8s.io/primary=false

	I0803 23:50:03.609385  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-349588-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0803 23:50:03.735531  346092 start.go:319] duration metric: took 23.379547866s to joinCluster

	I0803 23:50:03.735696  346092 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:50:03.735969  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:03.737123  346092 out.go:177] * Verifying Kubernetes components...

	I0803 23:50:03.738194  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:50:04.021548  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:50:04.087375  346092 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:50:04.087738  346092 kapi.go:59] client config for ha-349588: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt", KeyFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key", CAFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02f40), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0803 23:50:04.087825  346092 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.168:8443

	I0803 23:50:04.088155  346092 node_ready.go:35] waiting up to 6m0s for node "ha-349588-m02" to be "Ready" ...

	I0803 23:50:04.088267  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:04.088279  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:04.088289  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:04.088293  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:04.101608  346092 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0803 23:50:04.588793  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:04.588824  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:04.588835  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:04.588842  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:04.598391  346092 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0803 23:50:05.088603  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:05.088654  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:05.088667  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:05.088672  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:05.101983  346092 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0803 23:50:05.588487  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:05.588512  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:05.588520  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:05.588524  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:05.594895  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:50:06.088958  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:06.088993  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:06.089006  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:06.089013  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:06.093121  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:06.093903  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:06.589007  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:06.589034  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:06.589043  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:06.589049  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:06.592751  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:07.088728  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:07.088755  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:07.088765  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:07.088769  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:07.092603  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:07.588467  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:07.588494  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:07.588503  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:07.588507  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:07.592369  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:08.088806  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:08.088832  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:08.088842  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:08.088847  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:08.341203  346092 round_trippers.go:574] Response Status: 200 OK in 252 milliseconds

	I0803 23:50:08.341873  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:08.588741  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:08.588769  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:08.588784  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:08.588791  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:08.593035  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:09.088693  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:09.088718  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:09.088727  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:09.088730  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:09.092569  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:09.589160  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:09.589184  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:09.589193  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:09.589196  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:09.593032  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:10.088752  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:10.088778  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:10.088786  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:10.088790  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:10.093525  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:10.588993  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:10.589018  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:10.589026  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:10.589030  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:10.593009  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:10.593688  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:11.089324  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:11.089353  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:11.089364  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:11.089369  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:11.092666  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:11.588626  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:11.588652  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:11.588661  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:11.588665  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:11.592229  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:12.088688  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:12.088717  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:12.088728  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:12.088735  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:12.092442  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:12.588482  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:12.588508  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:12.588519  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:12.588525  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:12.592800  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:13.089159  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:13.089183  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:13.089192  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:13.089197  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:13.093008  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:13.093622  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:13.588880  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:13.588905  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:13.588914  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:13.588920  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:13.592486  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:14.088375  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:14.088400  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:14.088409  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:14.088413  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:14.092385  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:14.588835  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:14.588868  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:14.588877  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:14.588881  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:14.592420  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:15.089024  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:15.089047  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:15.089057  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:15.089061  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:15.094639  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:50:15.095247  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:15.589208  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:15.589235  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:15.589249  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:15.589255  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:15.592801  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:16.089093  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:16.089119  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:16.089127  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:16.089132  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:16.093269  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:16.588406  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:16.588436  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:16.588445  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:16.588448  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:16.592508  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:17.088496  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:17.088524  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:17.088532  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:17.088537  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:17.092475  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:17.588414  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:17.588441  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:17.588450  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:17.588454  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:17.591618  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:17.592274  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:18.088769  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:18.088799  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:18.088810  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:18.088815  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:18.092770  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:18.588849  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:18.588880  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:18.588891  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:18.588896  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:18.596556  346092 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0803 23:50:19.089425  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:19.089451  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:19.089460  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:19.089465  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:19.093449  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:19.588574  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:19.588600  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:19.588608  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:19.588611  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:19.592387  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:19.593033  346092 node_ready.go:53] node "ha-349588-m02" has status "Ready":"False"

	I0803 23:50:20.089327  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.089353  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.089365  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.089371  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.092714  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.093273  346092 node_ready.go:49] node "ha-349588-m02" has status "Ready":"True"

	I0803 23:50:20.093308  346092 node_ready.go:38] duration metric: took 16.005118223s for node "ha-349588-m02" to be "Ready" ...

	I0803 23:50:20.093320  346092 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:50:20.093433  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:20.093448  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.093462  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.093469  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.100038  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:50:20.105890  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.105983  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-fzmtg

	I0803 23:50:20.105993  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.106000  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.106006  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.109203  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.110030  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.110048  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.110059  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.110065  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.113001  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.113519  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.113536  346092 pod_ready.go:81] duration metric: took 7.615549ms for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.113545  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.113609  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-z8qt6

	I0803 23:50:20.113616  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.113623  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.113630  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.116416  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.117033  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.117048  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.117055  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.117058  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.119946  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.120560  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.120579  346092 pod_ready.go:81] duration metric: took 7.024999ms for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.120591  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.120656  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588

	I0803 23:50:20.120666  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.120676  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.120683  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.122841  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.123473  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.123488  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.123495  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.123500  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.125721  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.126110  346092 pod_ready.go:92] pod "etcd-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.126125  346092 pod_ready.go:81] duration metric: took 5.526947ms for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.126134  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.126181  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m02

	I0803 23:50:20.126188  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.126194  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.126198  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.128291  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.128736  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.128749  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.128756  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.128759  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.130925  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:50:20.131570  346092 pod_ready.go:92] pod "etcd-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.131587  346092 pod_ready.go:81] duration metric: took 5.446889ms for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.131599  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.290056  346092 request.go:629] Waited for 158.368975ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:50:20.290126  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:50:20.290132  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.290140  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.290145  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.293571  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.489637  346092 request.go:629] Waited for 195.390522ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.489707  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:20.489712  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.489720  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.489725  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.492984  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.493434  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.493454  346092 pod_ready.go:81] duration metric: took 361.848401ms for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.493467  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.689358  346092 request.go:629] Waited for 195.783846ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:50:20.689430  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:50:20.689438  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.689456  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.689465  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.693618  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:20.889724  346092 request.go:629] Waited for 195.310872ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.889787  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:20.889792  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:20.889800  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:20.889804  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:20.893536  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:20.894217  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:20.894238  346092 pod_ready.go:81] duration metric: took 400.764562ms for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:20.894248  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.090421  346092 request.go:629] Waited for 196.080925ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:50:21.090509  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:50:21.090516  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.090534  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.090543  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.094083  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.290154  346092 request.go:629] Waited for 195.368168ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:21.290234  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:21.290238  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.290246  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.290250  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.293525  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.294206  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:21.294224  346092 pod_ready.go:81] duration metric: took 399.970486ms for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.294234  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.490360  346092 request.go:629] Waited for 196.055949ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:50:21.490451  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:50:21.490456  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.490465  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.490468  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.494025  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.690145  346092 request.go:629] Waited for 195.384727ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:21.690220  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:21.690228  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.690240  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.690248  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.693529  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:21.694169  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:21.694192  346092 pod_ready.go:81] duration metric: took 399.951921ms for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.694202  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:21.890179  346092 request.go:629] Waited for 195.854387ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:50:21.890259  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:50:21.890265  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:21.890274  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:21.890279  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:21.893716  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.089910  346092 request.go:629] Waited for 195.371972ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.090002  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.090008  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.090016  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.090027  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.093738  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.094479  346092 pod_ready.go:92] pod "kube-proxy-bbzdt" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:22.094500  346092 pod_ready.go:81] duration metric: took 400.291536ms for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.094509  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.289594  346092 request.go:629] Waited for 195.006002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:50:22.289686  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:50:22.289694  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.289702  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.289707  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.293120  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.490210  346092 request.go:629] Waited for 196.420033ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:22.490278  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:22.490283  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.490291  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.490294  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.493680  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.494297  346092 pod_ready.go:92] pod "kube-proxy-gbg5q" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:22.494322  346092 pod_ready.go:81] duration metric: took 399.806171ms for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.494332  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.689376  346092 request.go:629] Waited for 194.960002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:50:22.689464  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:50:22.689470  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.689478  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.689482  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.693104  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.890297  346092 request.go:629] Waited for 196.361011ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.890391  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:50:22.890399  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:22.890411  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:22.890420  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:22.893697  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:22.894373  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:22.894394  346092 pod_ready.go:81] duration metric: took 400.055147ms for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:22.894407  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:23.089430  346092 request.go:629] Waited for 194.917023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:50:23.089499  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:50:23.089515  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.089526  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.089531  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.093012  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:23.290011  346092 request.go:629] Waited for 196.376685ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:23.290074  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:50:23.290079  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.290087  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.290094  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.293439  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:23.293983  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:50:23.294011  346092 pod_ready.go:81] duration metric: took 399.595842ms for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:50:23.294023  346092 pod_ready.go:38] duration metric: took 3.200674416s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:50:23.294047  346092 api_server.go:52] waiting for apiserver process to appear ...

	I0803 23:50:23.294103  346092 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:50:23.311925  346092 api_server.go:72] duration metric: took 19.57618176s to wait for apiserver process to appear ...

	I0803 23:50:23.311959  346092 api_server.go:88] waiting for apiserver healthz status ...

	I0803 23:50:23.311986  346092 api_server.go:253] Checking apiserver healthz at https://192.168.39.168:8443/healthz ...

	I0803 23:50:23.316404  346092 api_server.go:279] https://192.168.39.168:8443/healthz returned 200:

	ok

	I0803 23:50:23.316479  346092 round_trippers.go:463] GET https://192.168.39.168:8443/version

	I0803 23:50:23.316488  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.316496  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.316500  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.317421  346092 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0803 23:50:23.317614  346092 api_server.go:141] control plane version: v1.30.3

	I0803 23:50:23.317642  346092 api_server.go:131] duration metric: took 5.676569ms to wait for apiserver health ...

	I0803 23:50:23.317651  346092 system_pods.go:43] waiting for kube-system pods to appear ...

	I0803 23:50:23.489822  346092 request.go:629] Waited for 172.098571ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.489889  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.489894  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.489904  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.489909  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.495307  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:50:23.500631  346092 system_pods.go:59] 17 kube-system pods found

	I0803 23:50:23.500677  346092 system_pods.go:61] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:50:23.500684  346092 system_pods.go:61] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:50:23.500688  346092 system_pods.go:61] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:50:23.500691  346092 system_pods.go:61] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:50:23.500698  346092 system_pods.go:61] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:50:23.500701  346092 system_pods.go:61] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:50:23.500704  346092 system_pods.go:61] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:50:23.500708  346092 system_pods.go:61] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:50:23.500713  346092 system_pods.go:61] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:50:23.500718  346092 system_pods.go:61] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:50:23.500722  346092 system_pods.go:61] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:50:23.500727  346092 system_pods.go:61] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:50:23.500731  346092 system_pods.go:61] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:50:23.500736  346092 system_pods.go:61] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:50:23.500744  346092 system_pods.go:61] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:50:23.500748  346092 system_pods.go:61] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:50:23.500760  346092 system_pods.go:61] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:50:23.500774  346092 system_pods.go:74] duration metric: took 183.114377ms to wait for pod list to return data ...

	I0803 23:50:23.500785  346092 default_sa.go:34] waiting for default service account to be created ...

	I0803 23:50:23.690294  346092 request.go:629] Waited for 189.403835ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:50:23.690372  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:50:23.690379  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.690387  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.690390  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.693867  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:50:23.694134  346092 default_sa.go:45] found service account: "default"

	I0803 23:50:23.694155  346092 default_sa.go:55] duration metric: took 193.358105ms for default service account to be created ...

	I0803 23:50:23.694165  346092 system_pods.go:116] waiting for k8s-apps to be running ...

	I0803 23:50:23.889572  346092 request.go:629] Waited for 195.298844ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.889643  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:50:23.889648  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:23.889656  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:23.889667  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:23.895176  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:50:23.899132  346092 system_pods.go:86] 17 kube-system pods found

	I0803 23:50:23.899162  346092 system_pods.go:89] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:50:23.899168  346092 system_pods.go:89] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:50:23.899173  346092 system_pods.go:89] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:50:23.899177  346092 system_pods.go:89] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:50:23.899180  346092 system_pods.go:89] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:50:23.899184  346092 system_pods.go:89] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:50:23.899188  346092 system_pods.go:89] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:50:23.899191  346092 system_pods.go:89] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:50:23.899196  346092 system_pods.go:89] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:50:23.899199  346092 system_pods.go:89] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:50:23.899203  346092 system_pods.go:89] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:50:23.899206  346092 system_pods.go:89] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:50:23.899210  346092 system_pods.go:89] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:50:23.899214  346092 system_pods.go:89] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:50:23.899218  346092 system_pods.go:89] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:50:23.899221  346092 system_pods.go:89] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:50:23.899224  346092 system_pods.go:89] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:50:23.899232  346092 system_pods.go:126] duration metric: took 205.059563ms to wait for k8s-apps to be running ...

	I0803 23:50:23.899241  346092 system_svc.go:44] waiting for kubelet service to be running ....

	I0803 23:50:23.899289  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:50:23.918586  346092 system_svc.go:56] duration metric: took 19.330492ms WaitForService to wait for kubelet

	I0803 23:50:23.918619  346092 kubeadm.go:582] duration metric: took 20.182883458s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:50:23.918639  346092 node_conditions.go:102] verifying NodePressure condition ...

	I0803 23:50:24.090107  346092 request.go:629] Waited for 171.389393ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes

	I0803 23:50:24.090194  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes

	I0803 23:50:24.090202  346092 round_trippers.go:469] Request Headers:

	I0803 23:50:24.090213  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:50:24.090218  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:50:24.094436  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:50:24.095386  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:50:24.095419  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:50:24.095433  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:50:24.095439  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:50:24.095445  346092 node_conditions.go:105] duration metric: took 176.80069ms to run NodePressure ...

	I0803 23:50:24.095460  346092 start.go:241] waiting for startup goroutines ...

	I0803 23:50:24.095497  346092 start.go:255] writing updated cluster config ...

	I0803 23:50:24.097766  346092 out.go:177] 

	I0803 23:50:24.099166  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:24.099285  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:50:24.101394  346092 out.go:177] * Starting "ha-349588-m03" control-plane node in "ha-349588" cluster

	I0803 23:50:24.102673  346092 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0803 23:50:24.102710  346092 cache.go:56] Caching tarball of preloaded images

	I0803 23:50:24.102810  346092 preload.go:172] Found /home/jenkins/minikube-integration/19370-323890/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0803 23:50:24.102821  346092 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0803 23:50:24.102925  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:50:24.103193  346092 start.go:360] acquireMachinesLock for ha-349588-m03: {Name:mk5ba202e04f74356b5f17ea45c4c5cbbb1b10e3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0803 23:50:24.103240  346092 start.go:364] duration metric: took 27.2µs to acquireMachinesLock for "ha-349588-m03"

	I0803 23:50:24.103261  346092 start.go:93] Provisioning new machine with config: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-d

ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:50:24.103356  346092 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0803 23:50:24.104783  346092 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0803 23:50:24.104893  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:24.104933  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:24.121746  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44259

	I0803 23:50:24.122292  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:24.122833  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:24.122857  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:24.123219  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:24.123424  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:24.123599  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:24.123792  346092 start.go:159] libmachine.API.Create for "ha-349588" (driver="kvm2")

	I0803 23:50:24.123823  346092 client.go:168] LocalClient.Create starting

	I0803 23:50:24.123860  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem

	I0803 23:50:24.123907  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:50:24.123930  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:50:24.124006  346092 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem

	I0803 23:50:24.124033  346092 main.go:141] libmachine: Decoding PEM data...

	I0803 23:50:24.124049  346092 main.go:141] libmachine: Parsing certificate...

	I0803 23:50:24.124078  346092 main.go:141] libmachine: Running pre-create checks...

	I0803 23:50:24.124089  346092 main.go:141] libmachine: (ha-349588-m03) Calling .PreCreateCheck

	I0803 23:50:24.124263  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetConfigRaw

	I0803 23:50:24.124674  346092 main.go:141] libmachine: Creating machine...

	I0803 23:50:24.124688  346092 main.go:141] libmachine: (ha-349588-m03) Calling .Create

	I0803 23:50:24.124837  346092 main.go:141] libmachine: (ha-349588-m03) Creating KVM machine...

	I0803 23:50:24.126236  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found existing default KVM network

	I0803 23:50:24.126409  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found existing private KVM network mk-ha-349588

	I0803 23:50:24.126593  346092 main.go:141] libmachine: (ha-349588-m03) Setting up store path in /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03 ...

	I0803 23:50:24.126610  346092 main.go:141] libmachine: (ha-349588-m03) Building disk image from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0803 23:50:24.126756  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.126596  346924 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:50:24.126786  346092 main.go:141] libmachine: (ha-349588-m03) Downloading /home/jenkins/minikube-integration/19370-323890/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19370-323890/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0803 23:50:24.399033  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.398884  346924 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa...

	I0803 23:50:24.516914  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.516772  346924 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/ha-349588-m03.rawdisk...

	I0803 23:50:24.516953  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Writing magic tar header

	I0803 23:50:24.516982  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Writing SSH key tar header

	I0803 23:50:24.516996  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:24.516895  346924 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03 ...

	I0803 23:50:24.517016  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03

	I0803 23:50:24.517113  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube/machines

	I0803 23:50:24.517143  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03 (perms=drwx------)

	I0803 23:50:24.517162  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890/.minikube

	I0803 23:50:24.517179  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube/machines (perms=drwxr-xr-x)

	I0803 23:50:24.517197  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890/.minikube (perms=drwxr-xr-x)

	I0803 23:50:24.517211  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration/19370-323890 (perms=drwxrwxr-x)

	I0803 23:50:24.517226  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19370-323890

	I0803 23:50:24.517243  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0803 23:50:24.517254  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home/jenkins

	I0803 23:50:24.517267  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Checking permissions on dir: /home

	I0803 23:50:24.517278  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Skipping /home - not owner

	I0803 23:50:24.517290  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0803 23:50:24.517307  346092 main.go:141] libmachine: (ha-349588-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0803 23:50:24.517318  346092 main.go:141] libmachine: (ha-349588-m03) Creating domain...

	I0803 23:50:24.518387  346092 main.go:141] libmachine: (ha-349588-m03) define libvirt domain using xml: 

	I0803 23:50:24.518416  346092 main.go:141] libmachine: (ha-349588-m03) <domain type='kvm'>

	I0803 23:50:24.518427  346092 main.go:141] libmachine: (ha-349588-m03)   <name>ha-349588-m03</name>

	I0803 23:50:24.518438  346092 main.go:141] libmachine: (ha-349588-m03)   <memory unit='MiB'>2200</memory>

	I0803 23:50:24.518445  346092 main.go:141] libmachine: (ha-349588-m03)   <vcpu>2</vcpu>

	I0803 23:50:24.518453  346092 main.go:141] libmachine: (ha-349588-m03)   <features>

	I0803 23:50:24.518464  346092 main.go:141] libmachine: (ha-349588-m03)     <acpi/>

	I0803 23:50:24.518474  346092 main.go:141] libmachine: (ha-349588-m03)     <apic/>

	I0803 23:50:24.518485  346092 main.go:141] libmachine: (ha-349588-m03)     <pae/>

	I0803 23:50:24.518498  346092 main.go:141] libmachine: (ha-349588-m03)     

	I0803 23:50:24.518509  346092 main.go:141] libmachine: (ha-349588-m03)   </features>

	I0803 23:50:24.518523  346092 main.go:141] libmachine: (ha-349588-m03)   <cpu mode='host-passthrough'>

	I0803 23:50:24.518533  346092 main.go:141] libmachine: (ha-349588-m03)   

	I0803 23:50:24.518543  346092 main.go:141] libmachine: (ha-349588-m03)   </cpu>

	I0803 23:50:24.518553  346092 main.go:141] libmachine: (ha-349588-m03)   <os>

	I0803 23:50:24.518563  346092 main.go:141] libmachine: (ha-349588-m03)     <type>hvm</type>

	I0803 23:50:24.518575  346092 main.go:141] libmachine: (ha-349588-m03)     <boot dev='cdrom'/>

	I0803 23:50:24.518584  346092 main.go:141] libmachine: (ha-349588-m03)     <boot dev='hd'/>

	I0803 23:50:24.518594  346092 main.go:141] libmachine: (ha-349588-m03)     <bootmenu enable='no'/>

	I0803 23:50:24.518607  346092 main.go:141] libmachine: (ha-349588-m03)   </os>

	I0803 23:50:24.518618  346092 main.go:141] libmachine: (ha-349588-m03)   <devices>

	I0803 23:50:24.518629  346092 main.go:141] libmachine: (ha-349588-m03)     <disk type='file' device='cdrom'>

	I0803 23:50:24.518647  346092 main.go:141] libmachine: (ha-349588-m03)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/boot2docker.iso'/>

	I0803 23:50:24.518657  346092 main.go:141] libmachine: (ha-349588-m03)       <target dev='hdc' bus='scsi'/>

	I0803 23:50:24.518670  346092 main.go:141] libmachine: (ha-349588-m03)       <readonly/>

	I0803 23:50:24.518683  346092 main.go:141] libmachine: (ha-349588-m03)     </disk>

	I0803 23:50:24.518726  346092 main.go:141] libmachine: (ha-349588-m03)     <disk type='file' device='disk'>

	I0803 23:50:24.518753  346092 main.go:141] libmachine: (ha-349588-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0803 23:50:24.518781  346092 main.go:141] libmachine: (ha-349588-m03)       <source file='/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/ha-349588-m03.rawdisk'/>

	I0803 23:50:24.518793  346092 main.go:141] libmachine: (ha-349588-m03)       <target dev='hda' bus='virtio'/>

	I0803 23:50:24.518802  346092 main.go:141] libmachine: (ha-349588-m03)     </disk>

	I0803 23:50:24.518813  346092 main.go:141] libmachine: (ha-349588-m03)     <interface type='network'>

	I0803 23:50:24.518823  346092 main.go:141] libmachine: (ha-349588-m03)       <source network='mk-ha-349588'/>

	I0803 23:50:24.518836  346092 main.go:141] libmachine: (ha-349588-m03)       <model type='virtio'/>

	I0803 23:50:24.518878  346092 main.go:141] libmachine: (ha-349588-m03)     </interface>

	I0803 23:50:24.518907  346092 main.go:141] libmachine: (ha-349588-m03)     <interface type='network'>

	I0803 23:50:24.518942  346092 main.go:141] libmachine: (ha-349588-m03)       <source network='default'/>

	I0803 23:50:24.518960  346092 main.go:141] libmachine: (ha-349588-m03)       <model type='virtio'/>

	I0803 23:50:24.518970  346092 main.go:141] libmachine: (ha-349588-m03)     </interface>

	I0803 23:50:24.518978  346092 main.go:141] libmachine: (ha-349588-m03)     <serial type='pty'>

	I0803 23:50:24.518990  346092 main.go:141] libmachine: (ha-349588-m03)       <target port='0'/>

	I0803 23:50:24.519000  346092 main.go:141] libmachine: (ha-349588-m03)     </serial>

	I0803 23:50:24.519008  346092 main.go:141] libmachine: (ha-349588-m03)     <console type='pty'>

	I0803 23:50:24.519020  346092 main.go:141] libmachine: (ha-349588-m03)       <target type='serial' port='0'/>

	I0803 23:50:24.519029  346092 main.go:141] libmachine: (ha-349588-m03)     </console>

	I0803 23:50:24.519045  346092 main.go:141] libmachine: (ha-349588-m03)     <rng model='virtio'>

	I0803 23:50:24.519059  346092 main.go:141] libmachine: (ha-349588-m03)       <backend model='random'>/dev/random</backend>

	I0803 23:50:24.519065  346092 main.go:141] libmachine: (ha-349588-m03)     </rng>

	I0803 23:50:24.519077  346092 main.go:141] libmachine: (ha-349588-m03)     

	I0803 23:50:24.519084  346092 main.go:141] libmachine: (ha-349588-m03)     

	I0803 23:50:24.519098  346092 main.go:141] libmachine: (ha-349588-m03)   </devices>

	I0803 23:50:24.519106  346092 main.go:141] libmachine: (ha-349588-m03) </domain>

	I0803 23:50:24.519124  346092 main.go:141] libmachine: (ha-349588-m03) 

	I0803 23:50:24.526713  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:ab:a3:ea in network default

	I0803 23:50:24.527228  346092 main.go:141] libmachine: (ha-349588-m03) Ensuring networks are active...

	I0803 23:50:24.527253  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:24.527861  346092 main.go:141] libmachine: (ha-349588-m03) Ensuring network default is active

	I0803 23:50:24.528200  346092 main.go:141] libmachine: (ha-349588-m03) Ensuring network mk-ha-349588 is active

	I0803 23:50:24.528499  346092 main.go:141] libmachine: (ha-349588-m03) Getting domain xml...

	I0803 23:50:24.529299  346092 main.go:141] libmachine: (ha-349588-m03) Creating domain...

	I0803 23:50:25.809639  346092 main.go:141] libmachine: (ha-349588-m03) Waiting to get IP...

	I0803 23:50:25.810693  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:25.811149  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:25.811200  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:25.811127  346924 retry.go:31] will retry after 239.766839ms: waiting for machine to come up

	I0803 23:50:26.052890  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:26.053455  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:26.053526  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:26.053417  346924 retry.go:31] will retry after 350.096869ms: waiting for machine to come up

	I0803 23:50:26.404999  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:26.405425  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:26.405450  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:26.405378  346924 retry.go:31] will retry after 426.316752ms: waiting for machine to come up

	I0803 23:50:26.832924  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:26.833346  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:26.833377  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:26.833286  346924 retry.go:31] will retry after 468.911288ms: waiting for machine to come up

	I0803 23:50:27.303717  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:27.304186  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:27.304209  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:27.304153  346924 retry.go:31] will retry after 588.198491ms: waiting for machine to come up

	I0803 23:50:27.893918  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:27.894345  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:27.894376  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:27.894289  346924 retry.go:31] will retry after 756.527198ms: waiting for machine to come up

	I0803 23:50:28.652222  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:28.652692  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:28.652722  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:28.652635  346924 retry.go:31] will retry after 956.618375ms: waiting for machine to come up

	I0803 23:50:29.610577  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:29.611053  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:29.611081  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:29.611003  346924 retry.go:31] will retry after 894.193355ms: waiting for machine to come up

	I0803 23:50:30.506910  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:30.507443  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:30.507475  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:30.507383  346924 retry.go:31] will retry after 1.475070752s: waiting for machine to come up

	I0803 23:50:31.984363  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:31.984792  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:31.984823  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:31.984738  346924 retry.go:31] will retry after 1.96830202s: waiting for machine to come up

	I0803 23:50:33.954805  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:33.955250  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:33.955283  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:33.955190  346924 retry.go:31] will retry after 2.345601343s: waiting for machine to come up

	I0803 23:50:36.302961  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:36.303447  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:36.303478  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:36.303397  346924 retry.go:31] will retry after 2.267010238s: waiting for machine to come up

	I0803 23:50:38.571635  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:38.572141  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:38.572165  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:38.572088  346924 retry.go:31] will retry after 4.429291681s: waiting for machine to come up

	I0803 23:50:43.003156  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:43.003613  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find current IP address of domain ha-349588-m03 in network mk-ha-349588

	I0803 23:50:43.003638  346092 main.go:141] libmachine: (ha-349588-m03) DBG | I0803 23:50:43.003558  346924 retry.go:31] will retry after 3.48372957s: waiting for machine to come up

	I0803 23:50:46.490110  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.490603  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has current primary IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.490633  346092 main.go:141] libmachine: (ha-349588-m03) Found IP for machine: 192.168.39.79

	I0803 23:50:46.490655  346092 main.go:141] libmachine: (ha-349588-m03) Reserving static IP address...

	I0803 23:50:46.491072  346092 main.go:141] libmachine: (ha-349588-m03) DBG | unable to find host DHCP lease matching {name: "ha-349588-m03", mac: "52:54:00:1d:c9:03", ip: "192.168.39.79"} in network mk-ha-349588

	I0803 23:50:46.573000  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Getting to WaitForSSH function...

	I0803 23:50:46.573036  346092 main.go:141] libmachine: (ha-349588-m03) Reserved static IP address: 192.168.39.79

	I0803 23:50:46.573049  346092 main.go:141] libmachine: (ha-349588-m03) Waiting for SSH to be available...

	I0803 23:50:46.575539  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.575870  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.575901  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.576123  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Using SSH client type: external

	I0803 23:50:46.576160  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa (-rw-------)

	I0803 23:50:46.576188  346092 main.go:141] libmachine: (ha-349588-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.79 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0803 23:50:46.576201  346092 main.go:141] libmachine: (ha-349588-m03) DBG | About to run SSH command:

	I0803 23:50:46.576213  346092 main.go:141] libmachine: (ha-349588-m03) DBG | exit 0

	I0803 23:50:46.710090  346092 main.go:141] libmachine: (ha-349588-m03) DBG | SSH cmd err, output: <nil>: 

	I0803 23:50:46.710376  346092 main.go:141] libmachine: (ha-349588-m03) KVM machine creation complete!

	I0803 23:50:46.710702  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetConfigRaw

	I0803 23:50:46.711288  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:46.711523  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:46.711699  346092 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0803 23:50:46.711715  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetState

	I0803 23:50:46.713405  346092 main.go:141] libmachine: Detecting operating system of created instance...

	I0803 23:50:46.713420  346092 main.go:141] libmachine: Waiting for SSH to be available...

	I0803 23:50:46.713426  346092 main.go:141] libmachine: Getting to WaitForSSH function...

	I0803 23:50:46.713432  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:46.715823  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.716240  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.716262  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.716392  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:46.716587  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.716764  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.716943  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:46.717168  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:46.717414  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:46.717426  346092 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0803 23:50:46.833008  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:50:46.833043  346092 main.go:141] libmachine: Detecting the provisioner...

	I0803 23:50:46.833055  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:46.836050  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.836542  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.836581  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.836685  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:46.836896  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.837102  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.837277  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:46.837427  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:46.837659  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:46.837674  346092 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0803 23:50:46.954626  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0803 23:50:46.954732  346092 main.go:141] libmachine: found compatible host: buildroot

	I0803 23:50:46.954746  346092 main.go:141] libmachine: Provisioning with buildroot...

	I0803 23:50:46.954761  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:46.955024  346092 buildroot.go:166] provisioning hostname "ha-349588-m03"

	I0803 23:50:46.955054  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:46.955260  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:46.958280  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.958653  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:46.958677  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:46.958827  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:46.959018  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.959199  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:46.959356  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:46.959528  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:46.959713  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:46.959727  346092 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-349588-m03 && echo "ha-349588-m03" | sudo tee /etc/hostname

	I0803 23:50:47.091774  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-349588-m03

	I0803 23:50:47.091816  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.095084  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.095475  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.095509  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.095705  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.095912  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.096140  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.096327  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.096531  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:47.096732  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:47.096764  346092 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-349588-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-349588-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-349588-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0803 23:50:47.224450  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0803 23:50:47.224503  346092 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19370-323890/.minikube CaCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19370-323890/.minikube}

	I0803 23:50:47.224536  346092 buildroot.go:174] setting up certificates

	I0803 23:50:47.224547  346092 provision.go:84] configureAuth start

	I0803 23:50:47.224561  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetMachineName

	I0803 23:50:47.224940  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:47.228138  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.228514  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.228544  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.228711  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.231105  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.231425  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.231449  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.231559  346092 provision.go:143] copyHostCerts

	I0803 23:50:47.231597  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:50:47.231642  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem, removing ...

	I0803 23:50:47.231680  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem

	I0803 23:50:47.231784  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/ca.pem (1078 bytes)

	I0803 23:50:47.231887  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:50:47.231914  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem, removing ...

	I0803 23:50:47.231924  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem

	I0803 23:50:47.231961  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/cert.pem (1123 bytes)

	I0803 23:50:47.232050  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:50:47.232071  346092 exec_runner.go:144] found /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem, removing ...

	I0803 23:50:47.232075  346092 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem

	I0803 23:50:47.232099  346092 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19370-323890/.minikube/key.pem (1675 bytes)

	I0803 23:50:47.232148  346092 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem org=jenkins.ha-349588-m03 san=[127.0.0.1 192.168.39.79 ha-349588-m03 localhost minikube]

	I0803 23:50:47.399469  346092 provision.go:177] copyRemoteCerts

	I0803 23:50:47.399534  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0803 23:50:47.399562  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.402686  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.403211  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.403235  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.403420  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.403606  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.403793  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.403925  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:47.492467  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0803 23:50:47.492566  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0803 23:50:47.517280  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0803 23:50:47.517354  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0803 23:50:47.542649  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0803 23:50:47.542733  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0803 23:50:47.568029  346092 provision.go:87] duration metric: took 343.464982ms to configureAuth

	I0803 23:50:47.568066  346092 buildroot.go:189] setting minikube options for container-runtime

	I0803 23:50:47.568348  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:47.568459  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.571724  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.572147  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.572177  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.572434  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.572661  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.572844  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.573018  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.573266  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:47.573499  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:47.573552  346092 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0803 23:50:47.853244  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0803 23:50:47.853276  346092 main.go:141] libmachine: Checking connection to Docker...

	I0803 23:50:47.853285  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetURL

	I0803 23:50:47.854683  346092 main.go:141] libmachine: (ha-349588-m03) DBG | Using libvirt version 6000000

	I0803 23:50:47.856880  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.857234  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.857272  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.857396  346092 main.go:141] libmachine: Docker is up and running!

	I0803 23:50:47.857411  346092 main.go:141] libmachine: Reticulating splines...

	I0803 23:50:47.857419  346092 client.go:171] duration metric: took 23.733587583s to LocalClient.Create

	I0803 23:50:47.857445  346092 start.go:167] duration metric: took 23.733655538s to libmachine.API.Create "ha-349588"

	I0803 23:50:47.857455  346092 start.go:293] postStartSetup for "ha-349588-m03" (driver="kvm2")

	I0803 23:50:47.857465  346092 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0803 23:50:47.857481  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:47.857750  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0803 23:50:47.857787  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.859967  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.860290  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.860314  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.860473  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.860661  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.860856  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:47.861033  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:47.950131  346092 ssh_runner.go:195] Run: cat /etc/os-release

	I0803 23:50:47.954819  346092 info.go:137] Remote host: Buildroot 2023.02.9

	I0803 23:50:47.954849  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/addons for local assets ...

	I0803 23:50:47.954920  346092 filesync.go:126] Scanning /home/jenkins/minikube-integration/19370-323890/.minikube/files for local assets ...

	I0803 23:50:47.955013  346092 filesync.go:149] local asset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> 3310972.pem in /etc/ssl/certs

	I0803 23:50:47.955026  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /etc/ssl/certs/3310972.pem

	I0803 23:50:47.955136  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0803 23:50:47.965629  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:50:47.991355  346092 start.go:296] duration metric: took 133.884824ms for postStartSetup

	I0803 23:50:47.991428  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetConfigRaw

	I0803 23:50:47.992144  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:47.995389  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.995867  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.995892  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.996186  346092 profile.go:143] Saving config to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/config.json ...

	I0803 23:50:47.996383  346092 start.go:128] duration metric: took 23.893015539s to createHost

	I0803 23:50:47.996409  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:47.998754  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.999113  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:47.999143  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:47.999287  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:47.999474  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.999669  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:47.999821  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:48.000025  346092 main.go:141] libmachine: Using SSH client type: native

	I0803 23:50:48.000233  346092 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.79 22 <nil> <nil>}

	I0803 23:50:48.000247  346092 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0803 23:50:48.118642  346092 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722729048.091068532

	I0803 23:50:48.118694  346092 fix.go:216] guest clock: 1722729048.091068532

	I0803 23:50:48.118704  346092 fix.go:229] Guest: 2024-08-03 23:50:48.091068532 +0000 UTC Remote: 2024-08-03 23:50:47.996396829 +0000 UTC m=+158.613815502 (delta=94.671703ms)

	I0803 23:50:48.118730  346092 fix.go:200] guest clock delta is within tolerance: 94.671703ms

	I0803 23:50:48.118739  346092 start.go:83] releasing machines lock for "ha-349588-m03", held for 24.015487886s

	I0803 23:50:48.118770  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.119061  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:48.121626  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.121930  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:48.121964  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.124323  346092 out.go:177] * Found network options:

	I0803 23:50:48.126077  346092 out.go:177]   - NO_PROXY=192.168.39.168,192.168.39.67

	W0803 23:50:48.127478  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	W0803 23:50:48.127501  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:50:48.127518  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.128153  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.128346  346092 main.go:141] libmachine: (ha-349588-m03) Calling .DriverName

	I0803 23:50:48.128449  346092 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0803 23:50:48.128485  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	W0803 23:50:48.128555  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	W0803 23:50:48.128576  346092 proxy.go:119] fail to check proxy env: Error ip not in block

	I0803 23:50:48.128633  346092 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0803 23:50:48.128650  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHHostname

	I0803 23:50:48.131323  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.131347  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.131817  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:48.131848  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.131891  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:48.131906  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:48.132081  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:48.132094  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHPort

	I0803 23:50:48.132320  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:48.132324  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHKeyPath

	I0803 23:50:48.132523  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:48.132533  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetSSHUsername

	I0803 23:50:48.132701  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:48.132773  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.79 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588-m03/id_rsa Username:docker}

	I0803 23:50:48.389379  346092 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0803 23:50:48.395859  346092 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0803 23:50:48.395928  346092 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0803 23:50:48.415300  346092 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0803 23:50:48.415326  346092 start.go:495] detecting cgroup driver to use...

	I0803 23:50:48.415389  346092 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0803 23:50:48.434790  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0803 23:50:48.449942  346092 docker.go:217] disabling cri-docker service (if available) ...

	I0803 23:50:48.450002  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0803 23:50:48.464339  346092 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0803 23:50:48.479343  346092 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0803 23:50:48.598044  346092 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0803 23:50:48.771836  346092 docker.go:233] disabling docker service ...

	I0803 23:50:48.771936  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0803 23:50:48.786743  346092 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0803 23:50:48.800909  346092 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0803 23:50:48.929721  346092 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0803 23:50:49.070946  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0803 23:50:49.085981  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0803 23:50:49.107145  346092 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0803 23:50:49.107204  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.118494  346092 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0803 23:50:49.118562  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.129818  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.141337  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.152936  346092 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0803 23:50:49.165557  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.176476  346092 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.195609  346092 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0803 23:50:49.206645  346092 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0803 23:50:49.216707  346092 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0803 23:50:49.216779  346092 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0803 23:50:49.229560  346092 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0803 23:50:49.240199  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:50:49.363339  346092 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0803 23:50:49.509934  346092 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0803 23:50:49.510026  346092 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0803 23:50:49.515470  346092 start.go:563] Will wait 60s for crictl version

	I0803 23:50:49.515551  346092 ssh_runner.go:195] Run: which crictl

	I0803 23:50:49.519688  346092 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0803 23:50:49.558552  346092 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0803 23:50:49.558653  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:50:49.588140  346092 ssh_runner.go:195] Run: crio --version

	I0803 23:50:49.618274  346092 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0803 23:50:49.619575  346092 out.go:177]   - env NO_PROXY=192.168.39.168

	I0803 23:50:49.620837  346092 out.go:177]   - env NO_PROXY=192.168.39.168,192.168.39.67

	I0803 23:50:49.622108  346092 main.go:141] libmachine: (ha-349588-m03) Calling .GetIP

	I0803 23:50:49.624763  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:49.625127  346092 main.go:141] libmachine: (ha-349588-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:c9:03", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:50:38 +0000 UTC Type:0 Mac:52:54:00:1d:c9:03 Iaid: IPaddr:192.168.39.79 Prefix:24 Hostname:ha-349588-m03 Clientid:01:52:54:00:1d:c9:03}

	I0803 23:50:49.625156  346092 main.go:141] libmachine: (ha-349588-m03) DBG | domain ha-349588-m03 has defined IP address 192.168.39.79 and MAC address 52:54:00:1d:c9:03 in network mk-ha-349588

	I0803 23:50:49.625361  346092 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0803 23:50:49.629549  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:50:49.642294  346092 mustload.go:65] Loading cluster: ha-349588

	I0803 23:50:49.642557  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:50:49.642856  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:49.642907  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:49.661314  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33485

	I0803 23:50:49.661775  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:49.662267  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:49.662289  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:49.662672  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:49.662927  346092 main.go:141] libmachine: (ha-349588) Calling .GetState

	I0803 23:50:49.664647  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:50:49.665078  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:49.665123  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:49.681650  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37001

	I0803 23:50:49.682116  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:49.682716  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:49.682741  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:49.683105  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:49.683339  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:50:49.683495  346092 certs.go:68] Setting up /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588 for IP: 192.168.39.79

	I0803 23:50:49.683508  346092 certs.go:194] generating shared ca certs ...

	I0803 23:50:49.683525  346092 certs.go:226] acquiring lock for ca certs: {Name:mkccfc094433554f42346833b79ab0114e5aec2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:50:49.683695  346092 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key

	I0803 23:50:49.683752  346092 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key

	I0803 23:50:49.683765  346092 certs.go:256] generating profile certs ...

	I0803 23:50:49.683876  346092 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key

	I0803 23:50:49.683910  346092 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80

	I0803 23:50:49.683937  346092 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.168 192.168.39.67 192.168.39.79 192.168.39.254]

	I0803 23:50:49.893374  346092 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80 ...

	I0803 23:50:49.893411  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80: {Name:mkdc2fe11503b9f1d1c4c6c90e0b1df90eefa7ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:50:49.893608  346092 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80 ...

	I0803 23:50:49.893627  346092 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80: {Name:mk4257b808aff31998eea42cc17d84d4d90cd6cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0803 23:50:49.893730  346092 certs.go:381] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt.24a7ca80 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt

	I0803 23:50:49.893899  346092 certs.go:385] copying /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key.24a7ca80 -> /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key

	I0803 23:50:49.894070  346092 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key

	I0803 23:50:49.894092  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0803 23:50:49.894112  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0803 23:50:49.894132  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0803 23:50:49.894149  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0803 23:50:49.894168  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0803 23:50:49.894188  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0803 23:50:49.894206  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0803 23:50:49.894225  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0803 23:50:49.894291  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem (1338 bytes)

	W0803 23:50:49.894333  346092 certs.go:480] ignoring /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097_empty.pem, impossibly tiny 0 bytes

	I0803 23:50:49.894348  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca-key.pem (1679 bytes)

	I0803 23:50:49.894383  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/ca.pem (1078 bytes)

	I0803 23:50:49.894416  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/cert.pem (1123 bytes)

	I0803 23:50:49.894447  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/key.pem (1675 bytes)

	I0803 23:50:49.894501  346092 certs.go:484] found cert: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem (1708 bytes)

	I0803 23:50:49.894539  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem -> /usr/share/ca-certificates/3310972.pem

	I0803 23:50:49.894563  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:49.894581  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem -> /usr/share/ca-certificates/331097.pem

	I0803 23:50:49.894629  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:50:49.897587  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:49.897949  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:50:49.897980  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:49.898200  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:50:49.898435  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:50:49.898608  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:50:49.898763  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:50:49.969917  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0803 23:50:49.975416  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0803 23:50:49.988587  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0803 23:50:49.995102  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0803 23:50:50.010263  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0803 23:50:50.015483  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0803 23:50:50.027162  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0803 23:50:50.031962  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0803 23:50:50.043075  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0803 23:50:50.047433  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0803 23:50:50.061685  346092 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0803 23:50:50.066714  346092 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0803 23:50:50.078785  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0803 23:50:50.107115  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0803 23:50:50.132767  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0803 23:50:50.158356  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0803 23:50:50.183481  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0803 23:50:50.208890  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0803 23:50:50.233259  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0803 23:50:50.258319  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0803 23:50:50.283420  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/files/etc/ssl/certs/3310972.pem --> /usr/share/ca-certificates/3310972.pem (1708 bytes)

	I0803 23:50:50.308734  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0803 23:50:50.332877  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/certs/331097.pem --> /usr/share/ca-certificates/331097.pem (1338 bytes)

	I0803 23:50:50.358589  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0803 23:50:50.378002  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0803 23:50:50.397027  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0803 23:50:50.415515  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0803 23:50:50.432653  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0803 23:50:50.451386  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0803 23:50:50.469186  346092 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0803 23:50:50.487462  346092 ssh_runner.go:195] Run: openssl version

	I0803 23:50:50.494163  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0803 23:50:50.506441  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:50.511410  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  3 23:03 /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:50.511508  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0803 23:50:50.518230  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0803 23:50:50.529617  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/331097.pem && ln -fs /usr/share/ca-certificates/331097.pem /etc/ssl/certs/331097.pem"

	I0803 23:50:50.541105  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/331097.pem

	I0803 23:50:50.545860  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  3 23:44 /usr/share/ca-certificates/331097.pem

	I0803 23:50:50.545931  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/331097.pem

	I0803 23:50:50.551998  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/331097.pem /etc/ssl/certs/51391683.0"

	I0803 23:50:50.563960  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3310972.pem && ln -fs /usr/share/ca-certificates/3310972.pem /etc/ssl/certs/3310972.pem"

	I0803 23:50:50.575845  346092 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3310972.pem

	I0803 23:50:50.580600  346092 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  3 23:44 /usr/share/ca-certificates/3310972.pem

	I0803 23:50:50.580681  346092 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3310972.pem

	I0803 23:50:50.586680  346092 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3310972.pem /etc/ssl/certs/3ec20f2e.0"

	I0803 23:50:50.598021  346092 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0803 23:50:50.602251  346092 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0803 23:50:50.602313  346092 kubeadm.go:934] updating node {m03 192.168.39.79 8443 v1.30.3 crio true true} ...

	I0803 23:50:50.602404  346092 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-349588-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.79

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0803 23:50:50.602429  346092 kube-vip.go:115] generating kube-vip config ...

	I0803 23:50:50.602467  346092 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0803 23:50:50.619648  346092 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0803 23:50:50.619721  346092 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0803 23:50:50.619777  346092 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0803 23:50:50.630085  346092 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0803 23:50:50.630144  346092 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0803 23:50:50.640083  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0803 23:50:50.640126  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:50:50.640138  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256

	I0803 23:50:50.640144  346092 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256

	I0803 23:50:50.640152  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:50:50.640196  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:50:50.640219  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0803 23:50:50.640219  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0803 23:50:50.658556  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0803 23:50:50.658604  346092 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:50:50.658606  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0803 23:50:50.658650  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0803 23:50:50.658680  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0803 23:50:50.658723  346092 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0803 23:50:50.690959  346092 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0803 23:50:50.691012  346092 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19370-323890/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0803 23:50:51.642253  346092 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0803 23:50:51.652555  346092 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0803 23:50:51.670949  346092 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0803 23:50:51.689089  346092 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0803 23:50:51.706834  346092 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0803 23:50:51.711106  346092 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0803 23:50:51.724182  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:50:51.847681  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:50:51.869416  346092 host.go:66] Checking if "ha-349588" exists ...

	I0803 23:50:51.869884  346092 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0803 23:50:51.869941  346092 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0803 23:50:51.886556  346092 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39421

	I0803 23:50:51.888144  346092 main.go:141] libmachine: () Calling .GetVersion

	I0803 23:50:51.888782  346092 main.go:141] libmachine: Using API Version  1

	I0803 23:50:51.888815  346092 main.go:141] libmachine: () Calling .SetConfigRaw

	I0803 23:50:51.889193  346092 main.go:141] libmachine: () Calling .GetMachineName

	I0803 23:50:51.889432  346092 main.go:141] libmachine: (ha-349588) Calling .DriverName

	I0803 23:50:51.889615  346092 start.go:317] joinCluster: &{Name:ha-349588 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-349588 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.168 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.67 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.79 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false in

spektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt

imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0803 23:50:51.889756  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0803 23:50:51.889775  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHHostname

	I0803 23:50:51.893005  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:51.893469  346092 main.go:141] libmachine: (ha-349588) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d9:f9:50", ip: ""} in network mk-ha-349588: {Iface:virbr1 ExpiryTime:2024-08-04 00:48:24 +0000 UTC Type:0 Mac:52:54:00:d9:f9:50 Iaid: IPaddr:192.168.39.168 Prefix:24 Hostname:ha-349588 Clientid:01:52:54:00:d9:f9:50}

	I0803 23:50:51.893519  346092 main.go:141] libmachine: (ha-349588) DBG | domain ha-349588 has defined IP address 192.168.39.168 and MAC address 52:54:00:d9:f9:50 in network mk-ha-349588

	I0803 23:50:51.893703  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHPort

	I0803 23:50:51.893926  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHKeyPath

	I0803 23:50:51.894096  346092 main.go:141] libmachine: (ha-349588) Calling .GetSSHUsername

	I0803 23:50:51.894277  346092 sshutil.go:53] new ssh client: &{IP:192.168.39.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19370-323890/.minikube/machines/ha-349588/id_rsa Username:docker}

	I0803 23:50:52.068131  346092 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.79 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:50:52.068197  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token jhmyct.fs9mmu6drhozseqf --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m03 --control-plane --apiserver-advertise-address=192.168.39.79 --apiserver-bind-port=8443"

	I0803 23:51:16.339682  346092 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token jhmyct.fs9mmu6drhozseqf --discovery-token-ca-cert-hash sha256:11781423ede4edadd0063d77ce291f4baa18e593b8841b475f33d9aa1697c33c --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-349588-m03 --control-plane --apiserver-advertise-address=192.168.39.79 --apiserver-bind-port=8443": (24.271445189s)

	I0803 23:51:16.339733  346092 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0803 23:51:17.004233  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-349588-m03 minikube.k8s.io/updated_at=2024_08_03T23_51_17_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf minikube.k8s.io/name=ha-349588 minikube.k8s.io/primary=false

	I0803 23:51:17.133330  346092 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-349588-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0803 23:51:17.258692  346092 start.go:319] duration metric: took 25.369072533s to joinCluster

	I0803 23:51:17.258795  346092 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.79 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0803 23:51:17.259136  346092 config.go:182] Loaded profile config "ha-349588": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0803 23:51:17.260411  346092 out.go:177] * Verifying Kubernetes components...

	I0803 23:51:17.261728  346092 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0803 23:51:17.568914  346092 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0803 23:51:17.612603  346092 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19370-323890/kubeconfig

	I0803 23:51:17.613015  346092 kapi.go:59] client config for ha-349588: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.crt", KeyFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/profiles/ha-349588/client.key", CAFile:"/home/jenkins/minikube-integration/19370-323890/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02f40), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0803 23:51:17.613118  346092 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.168:8443

	I0803 23:51:17.613361  346092 node_ready.go:35] waiting up to 6m0s for node "ha-349588-m03" to be "Ready" ...

	I0803 23:51:17.613453  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:17.613464  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:17.613472  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:17.613477  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:17.616902  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:18.113863  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:18.113893  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:18.113905  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:18.113910  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:18.117470  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:18.613693  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:18.613717  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:18.613727  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:18.613735  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:18.617494  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:19.114494  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:19.114519  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:19.114528  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:19.114533  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:19.118484  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:19.614244  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:19.614267  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:19.614278  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:19.614289  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:19.618392  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:19.619001  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:20.114427  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:20.114450  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:20.114458  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:20.114463  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:20.118888  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:20.614464  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:20.614496  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:20.614509  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:20.614515  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:20.620459  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:51:21.114661  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:21.114690  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:21.114701  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:21.114706  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:21.119029  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:21.613753  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:21.613779  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:21.613788  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:21.613794  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:21.617083  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:22.114520  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:22.114548  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:22.114559  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:22.114564  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:22.117991  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:22.118703  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:22.614188  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:22.614211  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:22.614220  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:22.614223  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:22.617880  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:23.113699  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:23.113732  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:23.113741  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:23.113747  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:23.117692  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:23.613659  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:23.613686  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:23.613695  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:23.613698  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:23.617919  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:24.113692  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:24.113722  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:24.113731  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:24.113735  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:24.117496  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:24.613911  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:24.613936  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:24.613945  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:24.613951  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:24.617695  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:24.618387  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:25.113589  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:25.113615  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:25.113622  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:25.113625  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:25.117040  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:25.614494  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:25.614518  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:25.614527  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:25.614530  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:25.618351  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:26.114570  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:26.114600  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:26.114613  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:26.114617  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:26.117984  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:26.613722  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:26.613752  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:26.613762  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:26.613765  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:26.617091  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:27.113607  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:27.113636  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:27.113646  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:27.113651  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:27.116932  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:27.117575  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:27.613684  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:27.613707  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:27.613716  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:27.613719  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:27.617010  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:28.114036  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:28.114061  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:28.114072  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:28.114077  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:28.117689  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:28.613694  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:28.613717  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:28.613727  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:28.613731  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:28.617175  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:29.114486  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:29.114516  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:29.114528  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:29.114534  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:29.117960  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:29.118584  346092 node_ready.go:53] node "ha-349588-m03" has status "Ready":"False"

	I0803 23:51:29.614581  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:29.614606  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:29.614615  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:29.614619  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:29.618157  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:30.113701  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:30.113728  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:30.113738  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:30.113745  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:30.118868  346092 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0803 23:51:30.614474  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:30.614503  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:30.614516  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:30.614522  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:30.618005  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.113747  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:31.113773  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.113784  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.113789  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.117249  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.117818  346092 node_ready.go:49] node "ha-349588-m03" has status "Ready":"True"

	I0803 23:51:31.117844  346092 node_ready.go:38] duration metric: took 13.504465294s for node "ha-349588-m03" to be "Ready" ...

	I0803 23:51:31.117857  346092 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:51:31.117936  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:31.117948  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.117957  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.117963  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.125096  346092 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0803 23:51:31.132659  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.132757  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-fzmtg

	I0803 23:51:31.132765  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.132773  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.132777  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.136446  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.137409  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.137425  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.137433  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.137437  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.140711  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.141628  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.141652  346092 pod_ready.go:81] duration metric: took 8.959263ms for pod "coredns-7db6d8ff4d-fzmtg" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.141664  346092 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.141746  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-z8qt6

	I0803 23:51:31.141756  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.141766  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.141774  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.144612  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.145703  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.145717  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.145724  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.145729  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.148882  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.149402  346092 pod_ready.go:92] pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.149422  346092 pod_ready.go:81] duration metric: took 7.748921ms for pod "coredns-7db6d8ff4d-z8qt6" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.149433  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.149524  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588

	I0803 23:51:31.149537  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.149547  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.149554  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.151974  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.152558  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.152572  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.152579  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.152583  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.154985  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.155502  346092 pod_ready.go:92] pod "etcd-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.155526  346092 pod_ready.go:81] duration metric: took 6.085151ms for pod "etcd-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.155537  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.155596  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m02

	I0803 23:51:31.155603  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.155610  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.155613  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.158896  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.159772  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:31.159786  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.159793  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.159797  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.162550  346092 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0803 23:51:31.163470  346092 pod_ready.go:92] pod "etcd-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.163488  346092 pod_ready.go:81] duration metric: took 7.945539ms for pod "etcd-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.163497  346092 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.313805  346092 request.go:629] Waited for 150.235244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m03

	I0803 23:51:31.313887  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/etcd-ha-349588-m03

	I0803 23:51:31.313894  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.313903  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.313910  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.316950  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.514235  346092 request.go:629] Waited for 196.41936ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:31.514342  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:31.514350  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.514360  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.514370  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.517499  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.518373  346092 pod_ready.go:92] pod "etcd-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.518391  346092 pod_ready.go:81] duration metric: took 354.888561ms for pod "etcd-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.518408  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.714574  346092 request.go:629] Waited for 196.078655ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:51:31.714640  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588

	I0803 23:51:31.714645  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.714654  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.714660  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.718192  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:31.914516  346092 request.go:629] Waited for 195.494317ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.914594  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:31.914602  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:31.914614  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:31.914624  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:31.920699  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:31.922297  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:31.922322  346092 pod_ready.go:81] duration metric: took 403.9068ms for pod "kube-apiserver-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:31.922337  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.114309  346092 request.go:629] Waited for 191.882286ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:51:32.114410  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m02

	I0803 23:51:32.114422  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.114436  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.114446  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.118362  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:32.314850  346092 request.go:629] Waited for 195.414465ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:32.314943  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:32.314954  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.314968  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.314978  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.319424  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:32.319937  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:32.319956  346092 pod_ready.go:81] duration metric: took 397.612453ms for pod "kube-apiserver-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.319968  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.514132  346092 request.go:629] Waited for 194.066274ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m03

	I0803 23:51:32.514207  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-349588-m03

	I0803 23:51:32.514218  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.514230  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.514239  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.517826  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:32.714186  346092 request.go:629] Waited for 195.384867ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:32.714263  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:32.714268  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.714276  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.714280  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.717622  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:32.718276  346092 pod_ready.go:92] pod "kube-apiserver-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:32.718295  346092 pod_ready.go:81] duration metric: took 398.320232ms for pod "kube-apiserver-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.718305  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:32.914423  346092 request.go:629] Waited for 196.027987ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:51:32.914519  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588

	I0803 23:51:32.914531  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:32.914544  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:32.914557  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:32.918214  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.114290  346092 request.go:629] Waited for 195.385789ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:33.114354  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:33.114359  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.114367  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.114372  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.118031  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.118758  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:33.118786  346092 pod_ready.go:81] duration metric: took 400.47234ms for pod "kube-controller-manager-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.118801  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.313773  346092 request.go:629] Waited for 194.874757ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:51:33.313869  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m02

	I0803 23:51:33.313886  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.313897  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.313904  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.322352  346092 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0803 23:51:33.514604  346092 request.go:629] Waited for 191.39455ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:33.514693  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:33.514701  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.514733  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.514761  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.518436  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.519029  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:33.519057  346092 pod_ready.go:81] duration metric: took 400.246953ms for pod "kube-controller-manager-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.519070  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.714097  346092 request.go:629] Waited for 194.942392ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m03

	I0803 23:51:33.714177  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-349588-m03

	I0803 23:51:33.714183  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.714191  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.714198  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.718005  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.914140  346092 request.go:629] Waited for 195.367976ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:33.914237  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:33.914248  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:33.914260  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:33.914268  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:33.918105  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:33.918773  346092 pod_ready.go:92] pod "kube-controller-manager-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:33.918794  346092 pod_ready.go:81] duration metric: took 399.718883ms for pod "kube-controller-manager-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:33.918804  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.113900  346092 request.go:629] Waited for 194.98485ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:51:34.113982  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bbzdt

	I0803 23:51:34.113991  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.114001  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.114010  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.117261  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:34.313842  346092 request.go:629] Waited for 195.884146ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:34.313923  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:34.313928  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.313936  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.313941  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.318055  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:34.318690  346092 pod_ready.go:92] pod "kube-proxy-bbzdt" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:34.318718  346092 pod_ready.go:81] duration metric: took 399.906769ms for pod "kube-proxy-bbzdt" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.318733  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.514717  346092 request.go:629] Waited for 195.884216ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:51:34.514827  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gbg5q

	I0803 23:51:34.514837  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.514846  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.514857  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.518454  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:34.713786  346092 request.go:629] Waited for 194.249312ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:34.713853  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:34.713858  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.713867  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.713872  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.717311  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:34.718121  346092 pod_ready.go:92] pod "kube-proxy-gbg5q" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:34.718146  346092 pod_ready.go:81] duration metric: took 399.405642ms for pod "kube-proxy-gbg5q" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.718156  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gxhmd" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:34.914190  346092 request.go:629] Waited for 195.951933ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gxhmd

	I0803 23:51:34.914334  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-proxy-gxhmd

	I0803 23:51:34.914349  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:34.914359  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:34.914368  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:34.918014  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.114246  346092 request.go:629] Waited for 195.393665ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:35.114346  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:35.114351  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.114360  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.114364  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.120400  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:35.120927  346092 pod_ready.go:92] pod "kube-proxy-gxhmd" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:35.120947  346092 pod_ready.go:81] duration metric: took 402.784938ms for pod "kube-proxy-gxhmd" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.120957  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.314134  346092 request.go:629] Waited for 193.077756ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:51:35.314197  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588

	I0803 23:51:35.314204  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.314212  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.314216  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.317495  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.514753  346092 request.go:629] Waited for 196.397541ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:35.514819  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588

	I0803 23:51:35.514824  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.514832  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.514837  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.518678  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.519382  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:35.519403  346092 pod_ready.go:81] duration metric: took 398.440069ms for pod "kube-scheduler-ha-349588" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.519413  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.714054  346092 request.go:629] Waited for 194.546982ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:51:35.714123  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m02

	I0803 23:51:35.714131  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.714139  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.714143  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.717555  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.914758  346092 request.go:629] Waited for 196.375402ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:35.914818  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m02

	I0803 23:51:35.914824  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:35.914832  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:35.914836  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:35.918263  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:35.918956  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:35.918981  346092 pod_ready.go:81] duration metric: took 399.560987ms for pod "kube-scheduler-ha-349588-m02" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:35.918996  346092 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:36.114089  346092 request.go:629] Waited for 195.010266ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m03

	I0803 23:51:36.114169  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-349588-m03

	I0803 23:51:36.114176  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.114187  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.114203  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.117295  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:36.314318  346092 request.go:629] Waited for 196.362498ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:36.314391  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes/ha-349588-m03

	I0803 23:51:36.314396  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.314405  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.314408  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.317683  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:36.318319  346092 pod_ready.go:92] pod "kube-scheduler-ha-349588-m03" in "kube-system" namespace has status "Ready":"True"

	I0803 23:51:36.318338  346092 pod_ready.go:81] duration metric: took 399.336283ms for pod "kube-scheduler-ha-349588-m03" in "kube-system" namespace to be "Ready" ...

	I0803 23:51:36.318349  346092 pod_ready.go:38] duration metric: took 5.200478543s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0803 23:51:36.318365  346092 api_server.go:52] waiting for apiserver process to appear ...

	I0803 23:51:36.318431  346092 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0803 23:51:36.335947  346092 api_server.go:72] duration metric: took 19.077109461s to wait for apiserver process to appear ...

	I0803 23:51:36.335981  346092 api_server.go:88] waiting for apiserver healthz status ...

	I0803 23:51:36.336001  346092 api_server.go:253] Checking apiserver healthz at https://192.168.39.168:8443/healthz ...

	I0803 23:51:36.342426  346092 api_server.go:279] https://192.168.39.168:8443/healthz returned 200:

	ok

	I0803 23:51:36.342513  346092 round_trippers.go:463] GET https://192.168.39.168:8443/version

	I0803 23:51:36.342524  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.342534  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.342541  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.343354  346092 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0803 23:51:36.343424  346092 api_server.go:141] control plane version: v1.30.3

	I0803 23:51:36.343444  346092 api_server.go:131] duration metric: took 7.456114ms to wait for apiserver health ...

	I0803 23:51:36.343454  346092 system_pods.go:43] waiting for kube-system pods to appear ...

	I0803 23:51:36.514719  346092 request.go:629] Waited for 171.163392ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.514813  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.514819  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.514826  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.514831  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.521672  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:36.528449  346092 system_pods.go:59] 24 kube-system pods found

	I0803 23:51:36.528484  346092 system_pods.go:61] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:51:36.528488  346092 system_pods.go:61] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:51:36.528492  346092 system_pods.go:61] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:51:36.528496  346092 system_pods.go:61] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:51:36.528499  346092 system_pods.go:61] "etcd-ha-349588-m03" [b94d4e04-56f0-4892-927a-346559af3711] Running

	I0803 23:51:36.528502  346092 system_pods.go:61] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:51:36.528505  346092 system_pods.go:61] "kindnet-7sr59" [09355fc1-1a86-4f3f-be39-4e2e315e679f] Running

	I0803 23:51:36.528508  346092 system_pods.go:61] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:51:36.528511  346092 system_pods.go:61] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:51:36.528515  346092 system_pods.go:61] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:51:36.528518  346092 system_pods.go:61] "kube-apiserver-ha-349588-m03" [fb835dfe-b2d1-49ea-be6a-1c2f2c682095] Running

	I0803 23:51:36.528521  346092 system_pods.go:61] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:51:36.528524  346092 system_pods.go:61] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:51:36.528528  346092 system_pods.go:61] "kube-controller-manager-ha-349588-m03" [c4531c53-f3ca-42ef-a58b-1c30e752607b] Running

	I0803 23:51:36.528530  346092 system_pods.go:61] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:51:36.528533  346092 system_pods.go:61] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:51:36.528537  346092 system_pods.go:61] "kube-proxy-gxhmd" [4781a85e-af7c-49c2-80fb-c85db217189e] Running

	I0803 23:51:36.528540  346092 system_pods.go:61] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:51:36.528543  346092 system_pods.go:61] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:51:36.528549  346092 system_pods.go:61] "kube-scheduler-ha-349588-m03" [49495c84-d655-44a6-b732-a3520fc9e4db] Running

	I0803 23:51:36.528552  346092 system_pods.go:61] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:51:36.528555  346092 system_pods.go:61] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:51:36.528558  346092 system_pods.go:61] "kube-vip-ha-349588-m03" [17db3ee6-75d6-44a2-b663-22eb669c3916] Running

	I0803 23:51:36.528561  346092 system_pods.go:61] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:51:36.528567  346092 system_pods.go:74] duration metric: took 185.106343ms to wait for pod list to return data ...

	I0803 23:51:36.528578  346092 default_sa.go:34] waiting for default service account to be created ...

	I0803 23:51:36.714053  346092 request.go:629] Waited for 185.392294ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:51:36.714147  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/default/serviceaccounts

	I0803 23:51:36.714158  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.714167  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.714172  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.718328  346092 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0803 23:51:36.718486  346092 default_sa.go:45] found service account: "default"

	I0803 23:51:36.718504  346092 default_sa.go:55] duration metric: took 189.92038ms for default service account to be created ...

	I0803 23:51:36.718512  346092 system_pods.go:116] waiting for k8s-apps to be running ...

	I0803 23:51:36.914027  346092 request.go:629] Waited for 195.407927ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.914096  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/namespaces/kube-system/pods

	I0803 23:51:36.914102  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:36.914112  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:36.914120  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:36.920598  346092 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0803 23:51:36.927121  346092 system_pods.go:86] 24 kube-system pods found

	I0803 23:51:36.927158  346092 system_pods.go:89] "coredns-7db6d8ff4d-fzmtg" [8ac3c975-02c6-485b-9cfa-d754718d255e] Running

	I0803 23:51:36.927164  346092 system_pods.go:89] "coredns-7db6d8ff4d-z8qt6" [ab1ff267-f331-4404-8610-50fb0680a2c5] Running

	I0803 23:51:36.927168  346092 system_pods.go:89] "etcd-ha-349588" [40229bdc-5c2b-4e53-899d-7cd9cb7e7bbd] Running

	I0803 23:51:36.927172  346092 system_pods.go:89] "etcd-ha-349588-m02" [4c84efdb-de11-4c4e-9633-08cbddaa9f68] Running

	I0803 23:51:36.927176  346092 system_pods.go:89] "etcd-ha-349588-m03" [b94d4e04-56f0-4892-927a-346559af3711] Running

	I0803 23:51:36.927181  346092 system_pods.go:89] "kindnet-2q4kc" [720b92aa-c5c9-4664-a163-7c94fd5b3a4d] Running

	I0803 23:51:36.927185  346092 system_pods.go:89] "kindnet-7sr59" [09355fc1-1a86-4f3f-be39-4e2e315e679f] Running

	I0803 23:51:36.927189  346092 system_pods.go:89] "kindnet-zqhp6" [659301da-5bc8-4246-b8f4-629a92b42508] Running

	I0803 23:51:36.927192  346092 system_pods.go:89] "kube-apiserver-ha-349588" [b11bc735-7a9a-4293-bc8c-4491a7ba030d] Running

	I0803 23:51:36.927196  346092 system_pods.go:89] "kube-apiserver-ha-349588-m02" [b8ce7573-4524-428d-90bf-292bde26ce27] Running

	I0803 23:51:36.927200  346092 system_pods.go:89] "kube-apiserver-ha-349588-m03" [fb835dfe-b2d1-49ea-be6a-1c2f2c682095] Running

	I0803 23:51:36.927205  346092 system_pods.go:89] "kube-controller-manager-ha-349588" [17ccb6e0-52a2-4e7f-80f6-be5a15feae7e] Running

	I0803 23:51:36.927211  346092 system_pods.go:89] "kube-controller-manager-ha-349588-m02" [9f1b6f91-e81f-4e66-bbac-698722e26b0f] Running

	I0803 23:51:36.927217  346092 system_pods.go:89] "kube-controller-manager-ha-349588-m03" [c4531c53-f3ca-42ef-a58b-1c30e752607b] Running

	I0803 23:51:36.927222  346092 system_pods.go:89] "kube-proxy-bbzdt" [5f4d564f-843e-4284-a9fa-792241d9ba26] Running

	I0803 23:51:36.927227  346092 system_pods.go:89] "kube-proxy-gbg5q" [bf18e7f5-fe11-4421-9552-e6d6c5476aa3] Running

	I0803 23:51:36.927233  346092 system_pods.go:89] "kube-proxy-gxhmd" [4781a85e-af7c-49c2-80fb-c85db217189e] Running

	I0803 23:51:36.927239  346092 system_pods.go:89] "kube-scheduler-ha-349588" [87cf9f23-8ef4-4ac1-b408-b1b343398020] Running

	I0803 23:51:36.927246  346092 system_pods.go:89] "kube-scheduler-ha-349588-m02" [3c7bd1ea-e6e5-4876-b019-3518956f9014] Running

	I0803 23:51:36.927259  346092 system_pods.go:89] "kube-scheduler-ha-349588-m03" [49495c84-d655-44a6-b732-a3520fc9e4db] Running

	I0803 23:51:36.927264  346092 system_pods.go:89] "kube-vip-ha-349588" [b3a4c252-ee5e-4b2f-b982-a09904a9c547] Running

	I0803 23:51:36.927268  346092 system_pods.go:89] "kube-vip-ha-349588-m02" [f438bddb-41ff-46e7-9114-eba46b85d8fb] Running

	I0803 23:51:36.927275  346092 system_pods.go:89] "kube-vip-ha-349588-m03" [17db3ee6-75d6-44a2-b663-22eb669c3916] Running

	I0803 23:51:36.927285  346092 system_pods.go:89] "storage-provisioner" [e5eb5e5c-5ffb-4036-8a22-ed2204813520] Running

	I0803 23:51:36.927296  346092 system_pods.go:126] duration metric: took 208.777353ms to wait for k8s-apps to be running ...

	I0803 23:51:36.927304  346092 system_svc.go:44] waiting for kubelet service to be running ....

	I0803 23:51:36.927363  346092 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0803 23:51:36.945526  346092 system_svc.go:56] duration metric: took 18.195559ms WaitForService to wait for kubelet

	I0803 23:51:36.945565  346092 kubeadm.go:582] duration metric: took 19.686733073s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0803 23:51:36.945591  346092 node_conditions.go:102] verifying NodePressure condition ...

	I0803 23:51:37.113811  346092 request.go:629] Waited for 168.118325ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.168:8443/api/v1/nodes

	I0803 23:51:37.113911  346092 round_trippers.go:463] GET https://192.168.39.168:8443/api/v1/nodes

	I0803 23:51:37.113922  346092 round_trippers.go:469] Request Headers:

	I0803 23:51:37.113934  346092 round_trippers.go:473]     Accept: application/json, */*

	I0803 23:51:37.113943  346092 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0803 23:51:37.117855  346092 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0803 23:51:37.119104  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:51:37.119131  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:51:37.119165  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:51:37.119171  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:51:37.119180  346092 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0803 23:51:37.119185  346092 node_conditions.go:123] node cpu capacity is 2

	I0803 23:51:37.119192  346092 node_conditions.go:105] duration metric: took 173.595468ms to run NodePressure ...

	I0803 23:51:37.119210  346092 start.go:241] waiting for startup goroutines ...

	I0803 23:51:37.119240  346092 start.go:255] writing updated cluster config ...

	I0803 23:51:37.119591  346092 ssh_runner.go:195] Run: rm -f paused

	I0803 23:51:37.173652  346092 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)

	I0803 23:51:37.175744  346092 out.go:177] * Done! kubectl is now configured to use "ha-349588" cluster and "default" namespace by default

	==> CRI-O <==

	Aug 03 23:56:07 ha-349588 crio[685]: time="2024-08-03 23:56:07.990806720Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729367990780995,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=d7f31650-1547-495b-a621-bc4434d27d54 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:07 ha-349588 crio[685]: time="2024-08-03 23:56:07.991440822Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=b560884b-a03f-49da-92fc-935f61b75c22 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:07 ha-349588 crio[685]: time="2024-08-03 23:56:07.991535548Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=b560884b-a03f-49da-92fc-935f61b75c22 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:07 ha-349588 crio[685]: time="2024-08-03 23:56:07.991799217Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=b560884b-a03f-49da-92fc-935f61b75c22 name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.030248017Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=92f22224-b44d-4e5e-a559-886b29b86394 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.030341683Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=92f22224-b44d-4e5e-a559-886b29b86394 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.031526505Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=1f6c46de-4693-45ce-8448-5cc4863169d6 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.031971603Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729368031950427,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=1f6c46de-4693-45ce-8448-5cc4863169d6 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.032502808Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=e4fb7c65-2aa7-4101-9195-a2474a6eab7f name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.032574864Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=e4fb7c65-2aa7-4101-9195-a2474a6eab7f name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.032829827Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=e4fb7c65-2aa7-4101-9195-a2474a6eab7f name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.074069179Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=371daf17-d366-4851-bc94-d98ee59f4e96 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.074160416Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=371daf17-d366-4851-bc94-d98ee59f4e96 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.075747521Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=48f8e94a-9a43-4843-a89c-f7255a120359 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.076192912Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729368076169944,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=48f8e94a-9a43-4843-a89c-f7255a120359 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.077088043Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=3aef4649-bc6e-4f43-8580-42e02083c2cd name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.077192335Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3aef4649-bc6e-4f43-8580-42e02083c2cd name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.077511220Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3aef4649-bc6e-4f43-8580-42e02083c2cd name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.116874081Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=170ad7d3-f6d8-4fe7-afb9-dd9bd0504ab3 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.116945333Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=170ad7d3-f6d8-4fe7-afb9-dd9bd0504ab3 name=/runtime.v1.RuntimeService/Version

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.118636567Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=e96a1d11-b5b2-4cdd-8396-3359f4f48a14 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.119091066Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1722729368119068098,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154769,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=e96a1d11-b5b2-4cdd-8396-3359f4f48a14 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.119912581Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=7999ecb5-07d1-49a3-8acf-7737760e6e2e name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.119981478Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=7999ecb5-07d1-49a3-8acf-7737760e6e2e name=/runtime.v1.RuntimeService/ListContainers

	Aug 03 23:56:08 ha-349588 crio[685]: time="2024-08-03 23:56:08.120202162Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:c6fd002f59b0d4b372ccf9149ab1e00fad694c7a458f6506cd77b56350249948,PodSandboxId:a2e2fb00f6b54b54bf8a74ed71b0ecd454708de3f9624f4d23d2363c215330e8,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1722729099665061085,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-4mwk4,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a1f7a988-c439-426d-87ef-876b33660835,},Annotations:map[string]string{io.kubernetes.container.hash: eb796819,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ed4f0996565c3dfaad1366923d76ecce3da0cb9ddf2f33bca9ed22fca6f9c30a,PodSandboxId:c29d357fc68b0286f6e350136649a7fe57ae29e3f690e75957b3b82e7c4d5885,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1722728964608094471,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e5eb5e5c-5ffb-4036-8a22-ed2204813520,},Annotations:map[string]string{io.kubernetes.container.hash: 3ce326c5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d,PodSandboxId:37f34e1fe1b859e9f5d3379817e4cbc127e6acdf600f6094bc0b67d09bee4c0e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964592889323,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-fzmtg,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8ac3c975-02c6-485b-9cfa-d754718d255e,},Annotations:map[string]string{io.kubernetes.container.hash: 935d2143,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87,PodSandboxId:925c168e44d8368067f9cbcf5f862c0c4395f449e87fe6a3c0c3c38bd49c314e,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1722728964520215662,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-z8qt6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab1ff267-f3

31-4404-8610-50fb0680a2c5,},Annotations:map[string]string{io.kubernetes.container.hash: 56518eb1,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a,PodSandboxId:d2e5e2b102cd4b0c096afe93e00e844915505440075fe6bb8c1c436c256434fc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6f1d07c71fa0f426df75b802ec3f53ac5c1ae4110f67ab6d9a760083cc1d0f46,State:CO

NTAINER_RUNNING,CreatedAt:1722728952381271134,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-2q4kc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 720b92aa-c5c9-4664-a163-7c94fd5b3a4d,},Annotations:map[string]string{io.kubernetes.container.hash: 94032640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511,PodSandboxId:842c0109e8643daa97c5101ca1589149cf2777099bad04496a65218225a22ff2,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:172272894

8804756720,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-bbzdt,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5f4d564f-843e-4284-a9fa-792241d9ba26,},Annotations:map[string]string{io.kubernetes.container.hash: 486aaf3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4f4a81f925548f663ba6886e356f4dab3e9c5bb4b7593d9a059c653b2e42e440,PodSandboxId:c58f6f98744c895e81a8ada5022c3f2fb8af0896b21101dec18d8d51d8fb1b73,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172272893083

3943624,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abdcf69362865525f307bf3fb05e99de,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70,PodSandboxId:69dc19cc2bbff6b7aba3310ff31c0768920897fa47460362705b09bb7c58150a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1722728928936328180,Labels:map[string]string{io.kuberne

tes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2dba9e755d68dc45e521e88de3636318,},Annotations:map[string]string{io.kubernetes.container.hash: 37cdfbf8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35,PodSandboxId:5d722be95195feaa1f6a6230fbc1e971ed550ce25bbdcdac6cf5ef944be62340,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1722728928851621247,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kub

ernetes.pod.name: kube-apiserver-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d136dc55379aa8ec52be70f4c3d00d85,},Annotations:map[string]string{io.kubernetes.container.hash: 511000c3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802,PodSandboxId:16e8a700bcd71c6d318a3f80519188037f652c3828ab0377ee9a191d06bf9bdd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1722728928879059415,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9284bf34376b00a4b9834ebca6fce13d,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2,PodSandboxId:b6a89d83c0aaf537d5f720c4c0da12b315ad202a46521e585cae1f60edec52f2,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1722728928809973939,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-349588,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b38e6e3a481edaeb2d39d5c31b3f5139,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=7999ecb5-07d1-49a3-8acf-7737760e6e2e name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	c6fd002f59b0d       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   4 minutes ago       Running             busybox                   0                   a2e2fb00f6b54       busybox-fc5497c4f-4mwk4

	ed4f0996565c3       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      6 minutes ago       Running             storage-provisioner       0                   c29d357fc68b0       storage-provisioner

	c780810d93e46       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   37f34e1fe1b85       coredns-7db6d8ff4d-fzmtg

	81817890a62a6       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   925c168e44d83       coredns-7db6d8ff4d-z8qt6

	8706b763ebe33       docker.io/kindest/kindnetd@sha256:6d6071dbf83147a09972dc93b5ff84ff0103fa2231936557113757665f6195b9    6 minutes ago       Running             kindnet-cni               0                   d2e5e2b102cd4       kindnet-2q4kc

	1f48d6d5328f8       55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1                                      6 minutes ago       Running             kube-proxy                0                   842c0109e8643       kube-proxy-bbzdt

	4f4a81f925548       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     7 minutes ago       Running             kube-vip                  0                   c58f6f98744c8       kube-vip-ha-349588

	9bd785365c881       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      7 minutes ago       Running             etcd                      0                   69dc19cc2bbff       etcd-ha-349588

	f061678087351       3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2                                      7 minutes ago       Running             kube-scheduler            0                   16e8a700bcd71       kube-scheduler-ha-349588

	c7a32eac14445       1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d                                      7 minutes ago       Running             kube-apiserver            0                   5d722be95195f       kube-apiserver-ha-349588

	1b3755f3d86ea       76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e                                      7 minutes ago       Running             kube-controller-manager   0                   b6a89d83c0aaf       kube-controller-manager-ha-349588

	==> coredns [81817890a62a623e594610c06a3bf3881efbf9fbdde34bfce2ba770d70f66b87] <==

	[INFO] 10.244.0.4:58030 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146295s

	[INFO] 10.244.0.4:57522 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004292718s

	[INFO] 10.244.0.4:60466 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198733s

	[INFO] 10.244.0.4:45293 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002739449s

	[INFO] 10.244.0.4:50180 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129872s

	[INFO] 10.244.2.2:56181 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00186686s

	[INFO] 10.244.2.2:56701 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000166229s

	[INFO] 10.244.2.2:38728 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000109023s

	[INFO] 10.244.2.2:45155 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001333912s

	[INFO] 10.244.2.2:51605 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000083342s

	[INFO] 10.244.1.2:38219 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00015823s

	[INFO] 10.244.1.2:52488 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000178675s

	[INFO] 10.244.1.2:40148 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000097525s

	[INFO] 10.244.0.4:55438 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000074628s

	[INFO] 10.244.2.2:36883 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00010754s

	[INFO] 10.244.2.2:53841 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000090252s

	[INFO] 10.244.2.2:59602 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000092585s

	[INFO] 10.244.1.2:59266 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000147793s

	[INFO] 10.244.1.2:44530 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000122943s

	[INFO] 10.244.0.4:42192 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000097553s

	[INFO] 10.244.2.2:40701 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000172686s

	[INFO] 10.244.2.2:38338 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000166475s

	[INFO] 10.244.2.2:58001 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000140105s

	[INFO] 10.244.2.2:51129 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000105337s

	[INFO] 10.244.1.2:44130 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000106258s

	==> coredns [c780810d93e460c61906d4b52fb9b22ab441535b1cf319cbbb1630a5baae7c4d] <==

	[INFO] 10.244.1.2:47738 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.000122865s

	[INFO] 10.244.1.2:35251 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.000545486s

	[INFO] 10.244.0.4:59904 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000165239s

	[INFO] 10.244.0.4:38273 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000132118s

	[INFO] 10.244.0.4:49517 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00021182s

	[INFO] 10.244.2.2:39556 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000137234s

	[INFO] 10.244.2.2:60582 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000141615s

	[INFO] 10.244.2.2:36052 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000074574s

	[INFO] 10.244.1.2:36007 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00019702s

	[INFO] 10.244.1.2:39746 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001827365s

	[INFO] 10.244.1.2:47114 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000078787s

	[INFO] 10.244.1.2:38856 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198841s

	[INFO] 10.244.1.2:49149 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001428046s

	[INFO] 10.244.0.4:47461 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000104433s

	[INFO] 10.244.0.4:47790 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000083369s

	[INFO] 10.244.0.4:39525 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000161056s

	[INFO] 10.244.2.2:58034 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000169362s

	[INFO] 10.244.1.2:44282 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000187567s

	[INFO] 10.244.1.2:48438 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00016257s

	[INFO] 10.244.0.4:52544 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000142962s

	[INFO] 10.244.0.4:41203 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000152657s

	[INFO] 10.244.0.4:45953 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00009439s

	[INFO] 10.244.1.2:57136 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000160618s

	[INFO] 10.244.1.2:58739 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000139508s

	[INFO] 10.244.1.2:50023 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000125422s

	==> describe nodes <==

	Name:               ha-349588

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_03T23_48_56_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:48:52 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:56:03 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:48:51 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:48:51 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:48:51 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 03 Aug 2024 23:51:59 +0000   Sat, 03 Aug 2024 23:49:23 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.168

	  Hostname:    ha-349588

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 72ab11669b434797a5e41b5352f74be2

	  System UUID:                72ab1166-9b43-4797-a5e4-1b5352f74be2

	  Boot ID:                    e1637c60-2dbe-4ea9-949e-0f2b10f03d1b

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-4mwk4              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m30s

	  kube-system                 coredns-7db6d8ff4d-fzmtg             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     7m

	  kube-system                 coredns-7db6d8ff4d-z8qt6             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     7m

	  kube-system                 etcd-ha-349588                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         7m13s

	  kube-system                 kindnet-2q4kc                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      7m1s

	  kube-system                 kube-apiserver-ha-349588             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m14s

	  kube-system                 kube-controller-manager-ha-349588    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m15s

	  kube-system                 kube-proxy-bbzdt                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m1s

	  kube-system                 kube-scheduler-ha-349588             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m13s

	  kube-system                 kube-vip-ha-349588                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m13s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m59s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m59s  kube-proxy       

	  Normal  Starting                 7m14s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  7m13s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  7m13s  kubelet          Node ha-349588 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m13s  kubelet          Node ha-349588 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     7m13s  kubelet          Node ha-349588 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           7m1s   node-controller  Node ha-349588 event: Registered Node ha-349588 in Controller

	  Normal  NodeReady                6m45s  kubelet          Node ha-349588 status is now: NodeReady

	  Normal  RegisteredNode           5m49s  node-controller  Node ha-349588 event: Registered Node ha-349588 in Controller

	  Normal  RegisteredNode           4m37s  node-controller  Node ha-349588 event: Registered Node ha-349588 in Controller

	Name:               ha-349588-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_03T23_50_03_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:49:59 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588-m02

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:52:53 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Sat, 03 Aug 2024 23:52:02 +0000   Sat, 03 Aug 2024 23:53:36 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.67

	  Hostname:    ha-349588-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 8919c8bcbd284472a3c4b5b3ae885051

	  System UUID:                8919c8bc-bd28-4472-a3c4-b5b3ae885051

	  Boot ID:                    000b155d-14ed-4044-bb42-b52680d7292c

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-szvhv                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m30s

	  kube-system                 etcd-ha-349588-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m6s

	  kube-system                 kindnet-zqhp6                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m8s

	  kube-system                 kube-apiserver-ha-349588-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m6s

	  kube-system                 kube-controller-manager-ha-349588-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m5s

	  kube-system                 kube-proxy-gbg5q                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m8s

	  kube-system                 kube-scheduler-ha-349588-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m7s

	  kube-system                 kube-vip-ha-349588-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m5s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 6m3s                 kube-proxy       

	  Normal  NodeAllocatableEnforced  6m9s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m8s (x8 over 6m9s)  kubelet          Node ha-349588-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m8s (x8 over 6m9s)  kubelet          Node ha-349588-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m8s (x7 over 6m9s)  kubelet          Node ha-349588-m02 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m6s                 node-controller  Node ha-349588-m02 event: Registered Node ha-349588-m02 in Controller

	  Normal  RegisteredNode           5m49s                node-controller  Node ha-349588-m02 event: Registered Node ha-349588-m02 in Controller

	  Normal  RegisteredNode           4m37s                node-controller  Node ha-349588-m02 event: Registered Node ha-349588-m02 in Controller

	  Normal  NodeNotReady             2m32s                node-controller  Node ha-349588-m02 status is now: NodeNotReady

	Name:               ha-349588-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_03T23_51_17_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:51:12 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588-m03

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:55:58 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:12 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:12 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:12 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 03 Aug 2024 23:51:43 +0000   Sat, 03 Aug 2024 23:51:30 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.79

	  Hostname:    ha-349588-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 43f3523f989d4c49bec19f93fe176e08

	  System UUID:                43f3523f-989d-4c49-bec1-9f93fe176e08

	  Boot ID:                    49cb00cd-1df4-4d0c-b32a-0575118d2aca

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-mlkx9                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m30s

	  kube-system                 etcd-ha-349588-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m54s

	  kube-system                 kindnet-7sr59                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m54s

	  kube-system                 kube-apiserver-ha-349588-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m54s

	  kube-system                 kube-controller-manager-ha-349588-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m46s

	  kube-system                 kube-proxy-gxhmd                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m56s

	  kube-system                 kube-scheduler-ha-349588-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m54s

	  kube-system                 kube-vip-ha-349588-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m53s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m50s                  kube-proxy       

	  Normal  RegisteredNode           4m56s                  node-controller  Node ha-349588-m03 event: Registered Node ha-349588-m03 in Controller

	  Normal  NodeHasSufficientMemory  4m56s (x8 over 4m56s)  kubelet          Node ha-349588-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m56s (x8 over 4m56s)  kubelet          Node ha-349588-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m56s (x7 over 4m56s)  kubelet          Node ha-349588-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m56s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m54s                  node-controller  Node ha-349588-m03 event: Registered Node ha-349588-m03 in Controller

	  Normal  RegisteredNode           4m37s                  node-controller  Node ha-349588-m03 event: Registered Node ha-349588-m03 in Controller

	Name:               ha-349588-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-349588-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=2a458de372b9644e908f257fb7a6e1c2cc14d7bf

	                    minikube.k8s.io/name=ha-349588

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_03T23_52_17_0700

	                    minikube.k8s.io/version=v1.33.1

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 03 Aug 2024 23:52:16 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-349588-m04

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 03 Aug 2024 23:56:01 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 03 Aug 2024 23:52:47 +0000   Sat, 03 Aug 2024 23:52:35 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.61

	  Hostname:    ha-349588-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 4ac9326af96243febea155e979b68343

	  System UUID:                4ac9326a-f962-43fe-bea1-55e979b68343

	  Boot ID:                    e2f3d546-daab-46ec-be7d-1fdf0a72df36

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-7rfzm       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m52s

	  kube-system                 kube-proxy-2sdf6    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m52s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m46s                  kube-proxy       

	  Normal  RegisteredNode           3m52s                  node-controller  Node ha-349588-m04 event: Registered Node ha-349588-m04 in Controller

	  Normal  NodeHasSufficientMemory  3m52s (x2 over 3m52s)  kubelet          Node ha-349588-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m52s (x2 over 3m52s)  kubelet          Node ha-349588-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m52s (x2 over 3m52s)  kubelet          Node ha-349588-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m52s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m51s                  node-controller  Node ha-349588-m04 event: Registered Node ha-349588-m04 in Controller

	  Normal  RegisteredNode           3m49s                  node-controller  Node ha-349588-m04 event: Registered Node ha-349588-m04 in Controller

	  Normal  NodeReady                3m33s                  kubelet          Node ha-349588-m04 status is now: NodeReady

	==> dmesg <==

	[Aug 3 23:48] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.051792] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.040861] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.793620] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.513980] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.584703] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[ +12.778088] systemd-fstab-generator[603]: Ignoring "noauto" option for root device

	[  +0.061103] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.063697] systemd-fstab-generator[615]: Ignoring "noauto" option for root device

	[  +0.170133] systemd-fstab-generator[629]: Ignoring "noauto" option for root device

	[  +0.139803] systemd-fstab-generator[641]: Ignoring "noauto" option for root device

	[  +0.274186] systemd-fstab-generator[670]: Ignoring "noauto" option for root device

	[  +4.334862] systemd-fstab-generator[769]: Ignoring "noauto" option for root device

	[  +0.066522] kauditd_printk_skb: 130 callbacks suppressed

	[  +4.414847] systemd-fstab-generator[950]: Ignoring "noauto" option for root device

	[  +0.686183] kauditd_printk_skb: 46 callbacks suppressed

	[  +6.066614] kauditd_printk_skb: 51 callbacks suppressed

	[  +0.504623] systemd-fstab-generator[1366]: Ignoring "noauto" option for root device

	[Aug 3 23:49] kauditd_printk_skb: 15 callbacks suppressed

	[ +15.728228] kauditd_printk_skb: 38 callbacks suppressed

	[  +9.925424] kauditd_printk_skb: 24 callbacks suppressed

	==> etcd [9bd785365c88199f59eae42baf2d03dc7006a496dc210aff08c006c49fb97f70] <==

	{"level":"warn","ts":"2024-08-03T23:56:08.335279Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.385252Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.410897Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.420942Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.427577Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.450011Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.461424Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.468791Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.472994Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.475953Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.485759Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.486828Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.4932Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.499286Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.503603Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.507262Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.51513Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.521813Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.528019Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.531441Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.534503Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.539559Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.546005Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.552698Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-03T23:56:08.586537Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"e34fba8f5739efe8","from":"e34fba8f5739efe8","remote-peer-id":"af266204c5a37bea","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 23:56:08 up 7 min,  0 users,  load average: 0.37, 0.34, 0.18

	Linux ha-349588 5.10.207 #1 SMP Mon Jul 29 15:19:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [8706b763ebe33ac35526f59595133d913785087e57060b586760443295ca4c5a] <==

	I0803 23:55:33.551316       1 main.go:299] handling current node

	I0803 23:55:43.552214       1 main.go:295] Handling node with IPs: map[192.168.39.168:{}]

	I0803 23:55:43.552339       1 main.go:299] handling current node

	I0803 23:55:43.552603       1 main.go:295] Handling node with IPs: map[192.168.39.67:{}]

	I0803 23:55:43.552694       1 main.go:322] Node ha-349588-m02 has CIDR [10.244.1.0/24] 

	I0803 23:55:43.553190       1 main.go:295] Handling node with IPs: map[192.168.39.79:{}]

	I0803 23:55:43.553648       1 main.go:322] Node ha-349588-m03 has CIDR [10.244.2.0/24] 

	I0803 23:55:43.553880       1 main.go:295] Handling node with IPs: map[192.168.39.61:{}]

	I0803 23:55:43.553923       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:55:53.546317       1 main.go:295] Handling node with IPs: map[192.168.39.168:{}]

	I0803 23:55:53.546500       1 main.go:299] handling current node

	I0803 23:55:53.546536       1 main.go:295] Handling node with IPs: map[192.168.39.67:{}]

	I0803 23:55:53.546572       1 main.go:322] Node ha-349588-m02 has CIDR [10.244.1.0/24] 

	I0803 23:55:53.546734       1 main.go:295] Handling node with IPs: map[192.168.39.79:{}]

	I0803 23:55:53.546756       1 main.go:322] Node ha-349588-m03 has CIDR [10.244.2.0/24] 

	I0803 23:55:53.546822       1 main.go:295] Handling node with IPs: map[192.168.39.61:{}]

	I0803 23:55:53.546851       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:56:03.550708       1 main.go:295] Handling node with IPs: map[192.168.39.67:{}]

	I0803 23:56:03.550746       1 main.go:322] Node ha-349588-m02 has CIDR [10.244.1.0/24] 

	I0803 23:56:03.550918       1 main.go:295] Handling node with IPs: map[192.168.39.79:{}]

	I0803 23:56:03.550944       1 main.go:322] Node ha-349588-m03 has CIDR [10.244.2.0/24] 

	I0803 23:56:03.551028       1 main.go:295] Handling node with IPs: map[192.168.39.61:{}]

	I0803 23:56:03.551048       1 main.go:322] Node ha-349588-m04 has CIDR [10.244.3.0/24] 

	I0803 23:56:03.551117       1 main.go:295] Handling node with IPs: map[192.168.39.168:{}]

	I0803 23:56:03.551147       1 main.go:299] handling current node

	==> kube-apiserver [c7a32eac144452fae0664bc5434712e48a2b290dfe2be3dffcc0d329503e7c35] <==

	W0803 23:48:53.926522       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.168]

	I0803 23:48:53.927634       1 controller.go:615] quota admission added evaluator for: endpoints

	I0803 23:48:53.932255       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0803 23:48:54.119070       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0803 23:48:55.111182       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0803 23:48:55.144783       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0803 23:48:55.170847       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0803 23:49:07.575208       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0803 23:49:08.182339       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E0803 23:51:41.064985       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49338: use of closed network connection

	E0803 23:51:41.285771       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49360: use of closed network connection

	E0803 23:51:41.481817       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49368: use of closed network connection

	E0803 23:51:41.673398       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49382: use of closed network connection

	E0803 23:51:41.860608       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49400: use of closed network connection

	E0803 23:51:42.066800       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49404: use of closed network connection

	E0803 23:51:42.265786       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49410: use of closed network connection

	E0803 23:51:42.477198       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49424: use of closed network connection

	E0803 23:51:42.661794       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49434: use of closed network connection

	E0803 23:51:42.962222       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49456: use of closed network connection

	E0803 23:51:43.153260       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49474: use of closed network connection

	E0803 23:51:43.341009       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49484: use of closed network connection

	E0803 23:51:43.542718       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:49500: use of closed network connection

	E0803 23:51:43.745794       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55872: use of closed network connection

	E0803 23:51:43.941278       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55888: use of closed network connection

	W0803 23:53:03.929989       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.168 192.168.39.79]

	==> kube-controller-manager [1b3755f3d86ea7074de015bbc594c9b44955545b2b969412ddaa039635f049c2] <==

	I0803 23:51:12.392050       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-349588-m03\" does not exist"

	I0803 23:51:12.409979       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-349588-m03" podCIDRs=["10.244.2.0/24"]

	I0803 23:51:12.615890       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-349588-m03"

	I0803 23:51:38.099794       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="82.870305ms"

	I0803 23:51:38.149470       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="48.332864ms"

	I0803 23:51:38.150864       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="656.77µs"

	I0803 23:51:38.180131       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="84.73µs"

	I0803 23:51:38.336907       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="149.035867ms"

	I0803 23:51:38.494837       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="157.68925ms"

	I0803 23:51:38.552625       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="57.651091ms"

	I0803 23:51:38.552748       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="50.712µs"

	I0803 23:51:39.851012       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="38.989391ms"

	I0803 23:51:39.851245       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="90.684µs"

	I0803 23:51:39.955292       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="76.091µs"

	I0803 23:51:40.029088       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="11.487775ms"

	I0803 23:51:40.029453       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.265µs"

	I0803 23:51:40.582519       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="11.030815ms"

	I0803 23:51:40.582675       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="56.813µs"

	I0803 23:52:16.772216       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-349588-m04\" does not exist"

	I0803 23:52:16.799833       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-349588-m04" podCIDRs=["10.244.3.0/24"]

	I0803 23:52:17.978544       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-349588-m04"

	I0803 23:52:35.312225       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-349588-m04"

	I0803 23:53:36.959632       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-349588-m04"

	I0803 23:53:37.137008       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="11.48034ms"

	I0803 23:53:37.137626       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="59.676µs"

	==> kube-proxy [1f48d6d5328f8dfebbd9d6d84dd159be04c0e7999297d48c9150cd26589bf511] <==

	I0803 23:49:09.173626       1 server_linux.go:69] "Using iptables proxy"

	I0803 23:49:09.204726       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.168"]

	I0803 23:49:09.262456       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0803 23:49:09.262510       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0803 23:49:09.262529       1 server_linux.go:165] "Using iptables Proxier"

	I0803 23:49:09.265850       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0803 23:49:09.266449       1 server.go:872] "Version info" version="v1.30.3"

	I0803 23:49:09.266491       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0803 23:49:09.267962       1 config.go:192] "Starting service config controller"

	I0803 23:49:09.268231       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0803 23:49:09.268329       1 config.go:101] "Starting endpoint slice config controller"

	I0803 23:49:09.268413       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0803 23:49:09.270529       1 config.go:319] "Starting node config controller"

	I0803 23:49:09.270556       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0803 23:49:09.369309       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0803 23:49:09.369490       1 shared_informer.go:320] Caches are synced for service config

	I0803 23:49:09.372278       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [f06167808735141cd81abf99d0e9c552e6c36b01fc9a595da5c7d0b2278ca802] <==

	W0803 23:48:53.304668       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0803 23:48:53.304715       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0803 23:48:53.354479       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0803 23:48:53.354578       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0803 23:48:53.485317       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0803 23:48:53.485445       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0803 23:48:53.514811       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0803 23:48:53.514858       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0803 23:48:55.773274       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0803 23:51:12.541229       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-6mxhx\": pod kube-proxy-6mxhx is already assigned to node \"ha-349588-m03\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-6mxhx" node="ha-349588-m03"

	E0803 23:51:12.542506       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod e0f96924-b772-456b-b2f6-698af8e94038(kube-system/kube-proxy-6mxhx) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-6mxhx"

	E0803 23:51:12.543622       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-6mxhx\": pod kube-proxy-6mxhx is already assigned to node \"ha-349588-m03\"" pod="kube-system/kube-proxy-6mxhx"

	I0803 23:51:12.543720       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-6mxhx" node="ha-349588-m03"

	E0803 23:52:16.874914       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-7rfzm\": pod kindnet-7rfzm is already assigned to node \"ha-349588-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-7rfzm" node="ha-349588-m04"

	E0803 23:52:16.875424       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod b882822a-1717-446e-9816-b0d709515f5a(kube-system/kindnet-7rfzm) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-7rfzm"

	E0803 23:52:16.876997       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-7rfzm\": pod kindnet-7rfzm is already assigned to node \"ha-349588-m04\"" pod="kube-system/kindnet-7rfzm"

	I0803 23:52:16.877333       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-7rfzm" node="ha-349588-m04"

	E0803 23:52:16.874987       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-2sdf6\": pod kube-proxy-2sdf6 is already assigned to node \"ha-349588-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-2sdf6" node="ha-349588-m04"

	E0803 23:52:16.878219       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 2c41bdec-3f55-4626-9c5b-b757faed7907(kube-system/kube-proxy-2sdf6) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-2sdf6"

	E0803 23:52:16.878316       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-2sdf6\": pod kube-proxy-2sdf6 is already assigned to node \"ha-349588-m04\"" pod="kube-system/kube-proxy-2sdf6"

	I0803 23:52:16.878440       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-2sdf6" node="ha-349588-m04"

	E0803 23:52:17.021480       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-6rctf\": pod kube-proxy-6rctf is already assigned to node \"ha-349588-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-6rctf" node="ha-349588-m04"

	E0803 23:52:17.021686       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 22d8b275-6e92-4f89-85b5-5138eb55855b(kube-system/kube-proxy-6rctf) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-6rctf"

	E0803 23:52:17.021811       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-6rctf\": pod kube-proxy-6rctf is already assigned to node \"ha-349588-m04\"" pod="kube-system/kube-proxy-6rctf"

	I0803 23:52:17.022047       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-6rctf" node="ha-349588-m04"

	==> kubelet <==

	Aug 03 23:51:55 ha-349588 kubelet[1373]: E0803 23:51:55.143837    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:51:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:51:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:51:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:51:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:52:55 ha-349588 kubelet[1373]: E0803 23:52:55.144049    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:52:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:52:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:52:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:52:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:53:55 ha-349588 kubelet[1373]: E0803 23:53:55.154670    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:53:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:53:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:53:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:53:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:54:55 ha-349588 kubelet[1373]: E0803 23:54:55.142276    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:54:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:54:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:54:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:54:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 03 23:55:55 ha-349588 kubelet[1373]: E0803 23:55:55.140475    1373 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 03 23:55:55 ha-349588 kubelet[1373]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 03 23:55:55 ha-349588 kubelet[1373]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 03 23:55:55 ha-349588 kubelet[1373]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 03 23:55:55 ha-349588 kubelet[1373]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-349588 -n ha-349588

helpers_test.go:261: (dbg) Run:  kubectl --context ha-349588 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (48.22s)