=== RUN   TestAddons/Setup

addons_test.go:110: (dbg) Run:  out/minikube-linux-amd64 start -p addons-533488 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:110: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-533488 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: signal: killed (39m59.956330482s)

-- stdout --

	* [addons-533488] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19389

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19389-20864/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19389-20864/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-533488" primary control-plane node in "addons-533488" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image docker.io/marcnuri/yakd:0.0.5

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image ghcr.io/helm/tiller:v2.17.0

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.1

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	  - Using image docker.io/registry:2.8.3

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0

	  - Using image docker.io/busybox:stable

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	* Verifying registry addon...

	* Verifying ingress addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-533488 service yakd-dashboard -n yakd-dashboard

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	* Verifying csi-hostpath-driver addon...

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-533488 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: ingress-dns, nvidia-device-plugin, metrics-server, storage-provisioner, helm-tiller, cloud-spanner, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

-- /stdout --

** stderr ** 

	I0807 17:36:59.664618   29086 out.go:291] Setting OutFile to fd 1 ...

	I0807 17:36:59.664741   29086 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 17:36:59.664752   29086 out.go:304] Setting ErrFile to fd 2...

	I0807 17:36:59.664759   29086 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 17:36:59.664964   29086 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 17:36:59.665622   29086 out.go:298] Setting JSON to false

	I0807 17:36:59.666498   29086 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4766,"bootTime":1723047454,"procs":169,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0807 17:36:59.666559   29086 start.go:139] virtualization: kvm guest

	I0807 17:36:59.669083   29086 out.go:177] * [addons-533488] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0807 17:36:59.670915   29086 out.go:177]   - MINIKUBE_LOCATION=19389

	I0807 17:36:59.670950   29086 notify.go:220] Checking for updates...

	I0807 17:36:59.674000   29086 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0807 17:36:59.675426   29086 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 17:36:59.676777   29086 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 17:36:59.678082   29086 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0807 17:36:59.679556   29086 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0807 17:36:59.681092   29086 driver.go:392] Setting default libvirt URI to qemu:///system

	I0807 17:36:59.712513   29086 out.go:177] * Using the kvm2 driver based on user configuration

	I0807 17:36:59.714013   29086 start.go:297] selected driver: kvm2

	I0807 17:36:59.714024   29086 start.go:901] validating driver "kvm2" against <nil>

	I0807 17:36:59.714034   29086 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0807 17:36:59.714713   29086 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0807 17:36:59.714794   29086 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19389-20864/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0807 17:36:59.729770   29086 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0807 17:36:59.729823   29086 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0807 17:36:59.730053   29086 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 17:36:59.730078   29086 cni.go:84] Creating CNI manager for ""

	I0807 17:36:59.730085   29086 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0807 17:36:59.730096   29086 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0807 17:36:59.730163   29086 start.go:340] cluster config:

	{Name:addons-533488 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-533488 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 17:36:59.730304   29086 iso.go:125] acquiring lock: {Name:mkf212fcb23c5f8609a2c03b42fcca30ca8c42d1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0807 17:36:59.732171   29086 out.go:177] * Starting "addons-533488" primary control-plane node in "addons-533488" cluster

	I0807 17:36:59.733572   29086 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 17:36:59.733603   29086 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4

	I0807 17:36:59.733610   29086 cache.go:56] Caching tarball of preloaded images

	I0807 17:36:59.733689   29086 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 17:36:59.733708   29086 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 17:36:59.733995   29086 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/config.json ...

	I0807 17:36:59.734015   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/config.json: {Name:mke44dc90200b35239d4bc820921ed82f626a205 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:36:59.734164   29086 start.go:360] acquireMachinesLock for addons-533488: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 17:36:59.734226   29086 start.go:364] duration metric: took 45.607µs to acquireMachinesLock for "addons-533488"

	I0807 17:36:59.734247   29086 start.go:93] Provisioning new machine with config: &{Name:addons-533488 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.30.3 ClusterName:addons-533488 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 17:36:59.734309   29086 start.go:125] createHost starting for "" (driver="kvm2")

	I0807 17:36:59.735955   29086 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0807 17:36:59.736104   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:36:59.736166   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:36:59.750315   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41259

	I0807 17:36:59.750716   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:36:59.751244   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:36:59.751269   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:36:59.751697   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:36:59.751886   29086 main.go:141] libmachine: (addons-533488) Calling .GetMachineName

	I0807 17:36:59.752018   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:36:59.752218   29086 start.go:159] libmachine.API.Create for "addons-533488" (driver="kvm2")

	I0807 17:36:59.752248   29086 client.go:168] LocalClient.Create starting

	I0807 17:36:59.752295   29086 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 17:36:59.875980   29086 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 17:36:59.998431   29086 main.go:141] libmachine: Running pre-create checks...

	I0807 17:36:59.998457   29086 main.go:141] libmachine: (addons-533488) Calling .PreCreateCheck

	I0807 17:36:59.998954   29086 main.go:141] libmachine: (addons-533488) Calling .GetConfigRaw

	I0807 17:36:59.999475   29086 main.go:141] libmachine: Creating machine...

	I0807 17:36:59.999491   29086 main.go:141] libmachine: (addons-533488) Calling .Create

	I0807 17:36:59.999628   29086 main.go:141] libmachine: (addons-533488) Creating KVM machine...

	I0807 17:37:00.001107   29086 main.go:141] libmachine: (addons-533488) DBG | found existing default KVM network

	I0807 17:37:00.001850   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:00.001664   29108 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ad0}

	I0807 17:37:00.001885   29086 main.go:141] libmachine: (addons-533488) DBG | created network xml: 

	I0807 17:37:00.001912   29086 main.go:141] libmachine: (addons-533488) DBG | <network>

	I0807 17:37:00.001934   29086 main.go:141] libmachine: (addons-533488) DBG |   <name>mk-addons-533488</name>

	I0807 17:37:00.001949   29086 main.go:141] libmachine: (addons-533488) DBG |   <dns enable='no'/>

	I0807 17:37:00.001957   29086 main.go:141] libmachine: (addons-533488) DBG |   

	I0807 17:37:00.001972   29086 main.go:141] libmachine: (addons-533488) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0807 17:37:00.001985   29086 main.go:141] libmachine: (addons-533488) DBG |     <dhcp>

	I0807 17:37:00.001998   29086 main.go:141] libmachine: (addons-533488) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0807 17:37:00.002016   29086 main.go:141] libmachine: (addons-533488) DBG |     </dhcp>

	I0807 17:37:00.002031   29086 main.go:141] libmachine: (addons-533488) DBG |   </ip>

	I0807 17:37:00.002042   29086 main.go:141] libmachine: (addons-533488) DBG |   

	I0807 17:37:00.002058   29086 main.go:141] libmachine: (addons-533488) DBG | </network>

	I0807 17:37:00.002070   29086 main.go:141] libmachine: (addons-533488) DBG | 

	I0807 17:37:00.007838   29086 main.go:141] libmachine: (addons-533488) DBG | trying to create private KVM network mk-addons-533488 192.168.39.0/24...

	I0807 17:37:00.075447   29086 main.go:141] libmachine: (addons-533488) DBG | private KVM network mk-addons-533488 192.168.39.0/24 created

	I0807 17:37:00.075482   29086 main.go:141] libmachine: (addons-533488) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488 ...

	I0807 17:37:00.075543   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:00.075408   29108 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 17:37:00.075580   29086 main.go:141] libmachine: (addons-533488) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 17:37:00.075610   29086 main.go:141] libmachine: (addons-533488) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 17:37:00.350554   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:00.350420   29108 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa...

	I0807 17:37:00.524804   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:00.524656   29108 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/addons-533488.rawdisk...

	I0807 17:37:00.524845   29086 main.go:141] libmachine: (addons-533488) DBG | Writing magic tar header

	I0807 17:37:00.524931   29086 main.go:141] libmachine: (addons-533488) DBG | Writing SSH key tar header

	I0807 17:37:00.524967   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:00.524822   29108 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488 ...

	I0807 17:37:00.524985   29086 main.go:141] libmachine: (addons-533488) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488 (perms=drwx------)

	I0807 17:37:00.525000   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488

	I0807 17:37:00.525010   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 17:37:00.525018   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 17:37:00.525033   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 17:37:00.525045   29086 main.go:141] libmachine: (addons-533488) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 17:37:00.525054   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 17:37:00.525064   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home/jenkins

	I0807 17:37:00.525073   29086 main.go:141] libmachine: (addons-533488) DBG | Checking permissions on dir: /home

	I0807 17:37:00.525085   29086 main.go:141] libmachine: (addons-533488) DBG | Skipping /home - not owner

	I0807 17:37:00.525101   29086 main.go:141] libmachine: (addons-533488) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 17:37:00.525116   29086 main.go:141] libmachine: (addons-533488) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 17:37:00.525129   29086 main.go:141] libmachine: (addons-533488) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 17:37:00.525140   29086 main.go:141] libmachine: (addons-533488) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 17:37:00.525152   29086 main.go:141] libmachine: (addons-533488) Creating domain...

	I0807 17:37:00.526036   29086 main.go:141] libmachine: (addons-533488) define libvirt domain using xml: 

	I0807 17:37:00.526066   29086 main.go:141] libmachine: (addons-533488) <domain type='kvm'>

	I0807 17:37:00.526077   29086 main.go:141] libmachine: (addons-533488)   <name>addons-533488</name>

	I0807 17:37:00.526085   29086 main.go:141] libmachine: (addons-533488)   <memory unit='MiB'>4000</memory>

	I0807 17:37:00.526101   29086 main.go:141] libmachine: (addons-533488)   <vcpu>2</vcpu>

	I0807 17:37:00.526114   29086 main.go:141] libmachine: (addons-533488)   <features>

	I0807 17:37:00.526123   29086 main.go:141] libmachine: (addons-533488)     <acpi/>

	I0807 17:37:00.526130   29086 main.go:141] libmachine: (addons-533488)     <apic/>

	I0807 17:37:00.526135   29086 main.go:141] libmachine: (addons-533488)     <pae/>

	I0807 17:37:00.526143   29086 main.go:141] libmachine: (addons-533488)     

	I0807 17:37:00.526148   29086 main.go:141] libmachine: (addons-533488)   </features>

	I0807 17:37:00.526155   29086 main.go:141] libmachine: (addons-533488)   <cpu mode='host-passthrough'>

	I0807 17:37:00.526160   29086 main.go:141] libmachine: (addons-533488)   

	I0807 17:37:00.526168   29086 main.go:141] libmachine: (addons-533488)   </cpu>

	I0807 17:37:00.526176   29086 main.go:141] libmachine: (addons-533488)   <os>

	I0807 17:37:00.526186   29086 main.go:141] libmachine: (addons-533488)     <type>hvm</type>

	I0807 17:37:00.526218   29086 main.go:141] libmachine: (addons-533488)     <boot dev='cdrom'/>

	I0807 17:37:00.526243   29086 main.go:141] libmachine: (addons-533488)     <boot dev='hd'/>

	I0807 17:37:00.526251   29086 main.go:141] libmachine: (addons-533488)     <bootmenu enable='no'/>

	I0807 17:37:00.526256   29086 main.go:141] libmachine: (addons-533488)   </os>

	I0807 17:37:00.526261   29086 main.go:141] libmachine: (addons-533488)   <devices>

	I0807 17:37:00.526266   29086 main.go:141] libmachine: (addons-533488)     <disk type='file' device='cdrom'>

	I0807 17:37:00.526276   29086 main.go:141] libmachine: (addons-533488)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/boot2docker.iso'/>

	I0807 17:37:00.526285   29086 main.go:141] libmachine: (addons-533488)       <target dev='hdc' bus='scsi'/>

	I0807 17:37:00.526290   29086 main.go:141] libmachine: (addons-533488)       <readonly/>

	I0807 17:37:00.526296   29086 main.go:141] libmachine: (addons-533488)     </disk>

	I0807 17:37:00.526302   29086 main.go:141] libmachine: (addons-533488)     <disk type='file' device='disk'>

	I0807 17:37:00.526311   29086 main.go:141] libmachine: (addons-533488)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 17:37:00.526319   29086 main.go:141] libmachine: (addons-533488)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/addons-533488.rawdisk'/>

	I0807 17:37:00.526326   29086 main.go:141] libmachine: (addons-533488)       <target dev='hda' bus='virtio'/>

	I0807 17:37:00.526332   29086 main.go:141] libmachine: (addons-533488)     </disk>

	I0807 17:37:00.526341   29086 main.go:141] libmachine: (addons-533488)     <interface type='network'>

	I0807 17:37:00.526363   29086 main.go:141] libmachine: (addons-533488)       <source network='mk-addons-533488'/>

	I0807 17:37:00.526383   29086 main.go:141] libmachine: (addons-533488)       <model type='virtio'/>

	I0807 17:37:00.526395   29086 main.go:141] libmachine: (addons-533488)     </interface>

	I0807 17:37:00.526407   29086 main.go:141] libmachine: (addons-533488)     <interface type='network'>

	I0807 17:37:00.526419   29086 main.go:141] libmachine: (addons-533488)       <source network='default'/>

	I0807 17:37:00.526430   29086 main.go:141] libmachine: (addons-533488)       <model type='virtio'/>

	I0807 17:37:00.526440   29086 main.go:141] libmachine: (addons-533488)     </interface>

	I0807 17:37:00.526454   29086 main.go:141] libmachine: (addons-533488)     <serial type='pty'>

	I0807 17:37:00.526467   29086 main.go:141] libmachine: (addons-533488)       <target port='0'/>

	I0807 17:37:00.526478   29086 main.go:141] libmachine: (addons-533488)     </serial>

	I0807 17:37:00.526488   29086 main.go:141] libmachine: (addons-533488)     <console type='pty'>

	I0807 17:37:00.526514   29086 main.go:141] libmachine: (addons-533488)       <target type='serial' port='0'/>

	I0807 17:37:00.526523   29086 main.go:141] libmachine: (addons-533488)     </console>

	I0807 17:37:00.526534   29086 main.go:141] libmachine: (addons-533488)     <rng model='virtio'>

	I0807 17:37:00.526550   29086 main.go:141] libmachine: (addons-533488)       <backend model='random'>/dev/random</backend>

	I0807 17:37:00.526565   29086 main.go:141] libmachine: (addons-533488)     </rng>

	I0807 17:37:00.526576   29086 main.go:141] libmachine: (addons-533488)     

	I0807 17:37:00.526584   29086 main.go:141] libmachine: (addons-533488)     

	I0807 17:37:00.526594   29086 main.go:141] libmachine: (addons-533488)   </devices>

	I0807 17:37:00.526605   29086 main.go:141] libmachine: (addons-533488) </domain>

	I0807 17:37:00.526611   29086 main.go:141] libmachine: (addons-533488) 

	I0807 17:37:00.532448   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:58:47:d5 in network default

	I0807 17:37:00.533057   29086 main.go:141] libmachine: (addons-533488) Ensuring networks are active...

	I0807 17:37:00.533074   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:00.533810   29086 main.go:141] libmachine: (addons-533488) Ensuring network default is active

	I0807 17:37:00.534190   29086 main.go:141] libmachine: (addons-533488) Ensuring network mk-addons-533488 is active

	I0807 17:37:00.534615   29086 main.go:141] libmachine: (addons-533488) Getting domain xml...

	I0807 17:37:00.535324   29086 main.go:141] libmachine: (addons-533488) Creating domain...

	I0807 17:37:01.945346   29086 main.go:141] libmachine: (addons-533488) Waiting to get IP...

	I0807 17:37:01.946077   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:01.946528   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:01.946566   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:01.946512   29108 retry.go:31] will retry after 245.10662ms: waiting for machine to come up

	I0807 17:37:02.192930   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:02.193338   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:02.193360   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:02.193298   29108 retry.go:31] will retry after 348.908734ms: waiting for machine to come up

	I0807 17:37:02.543911   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:02.544352   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:02.544383   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:02.544302   29108 retry.go:31] will retry after 366.612664ms: waiting for machine to come up

	I0807 17:37:02.912839   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:02.913266   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:02.913296   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:02.913214   29108 retry.go:31] will retry after 600.50171ms: waiting for machine to come up

	I0807 17:37:03.514925   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:03.515419   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:03.515449   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:03.515359   29108 retry.go:31] will retry after 583.071003ms: waiting for machine to come up

	I0807 17:37:04.100061   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:04.100495   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:04.100522   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:04.100447   29108 retry.go:31] will retry after 749.302325ms: waiting for machine to come up

	I0807 17:37:04.851021   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:04.851433   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:04.851460   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:04.851401   29108 retry.go:31] will retry after 1.048750268s: waiting for machine to come up

	I0807 17:37:05.901543   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:05.901869   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:05.901891   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:05.901827   29108 retry.go:31] will retry after 1.450103883s: waiting for machine to come up

	I0807 17:37:07.354536   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:07.355039   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:07.355080   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:07.355006   29108 retry.go:31] will retry after 1.289391403s: waiting for machine to come up

	I0807 17:37:08.646546   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:08.646945   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:08.646983   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:08.646902   29108 retry.go:31] will retry after 1.625399857s: waiting for machine to come up

	I0807 17:37:10.273603   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:10.274091   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:10.274128   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:10.274029   29108 retry.go:31] will retry after 1.767228279s: waiting for machine to come up

	I0807 17:37:12.044029   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:12.044425   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:12.044462   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:12.044385   29108 retry.go:31] will retry after 2.237546862s: waiting for machine to come up

	I0807 17:37:14.284760   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:14.285206   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:14.285228   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:14.285170   29108 retry.go:31] will retry after 4.232910306s: waiting for machine to come up

	I0807 17:37:18.522064   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:18.522418   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find current IP address of domain addons-533488 in network mk-addons-533488

	I0807 17:37:18.522436   29086 main.go:141] libmachine: (addons-533488) DBG | I0807 17:37:18.522356   29108 retry.go:31] will retry after 5.208836617s: waiting for machine to come up

	I0807 17:37:23.735590   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:23.736060   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has current primary IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:23.736098   29086 main.go:141] libmachine: (addons-533488) Found IP for machine: 192.168.39.180

	I0807 17:37:23.736120   29086 main.go:141] libmachine: (addons-533488) Reserving static IP address...

	I0807 17:37:23.736441   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find host DHCP lease matching {name: "addons-533488", mac: "52:54:00:17:25:52", ip: "192.168.39.180"} in network mk-addons-533488

	I0807 17:37:23.807031   29086 main.go:141] libmachine: (addons-533488) DBG | Getting to WaitForSSH function...

	I0807 17:37:23.807059   29086 main.go:141] libmachine: (addons-533488) Reserved static IP address: 192.168.39.180

	I0807 17:37:23.807071   29086 main.go:141] libmachine: (addons-533488) Waiting for SSH to be available...

	I0807 17:37:23.810087   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:23.810504   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488

	I0807 17:37:23.810532   29086 main.go:141] libmachine: (addons-533488) DBG | unable to find defined IP address of network mk-addons-533488 interface with MAC address 52:54:00:17:25:52

	I0807 17:37:23.810677   29086 main.go:141] libmachine: (addons-533488) DBG | Using SSH client type: external

	I0807 17:37:23.810703   29086 main.go:141] libmachine: (addons-533488) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa (-rw-------)

	I0807 17:37:23.810726   29086 main.go:141] libmachine: (addons-533488) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 17:37:23.810736   29086 main.go:141] libmachine: (addons-533488) DBG | About to run SSH command:

	I0807 17:37:23.810749   29086 main.go:141] libmachine: (addons-533488) DBG | exit 0

	I0807 17:37:23.814356   29086 main.go:141] libmachine: (addons-533488) DBG | SSH cmd err, output: exit status 255: 

	I0807 17:37:23.814375   29086 main.go:141] libmachine: (addons-533488) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0807 17:37:23.814384   29086 main.go:141] libmachine: (addons-533488) DBG | command : exit 0

	I0807 17:37:23.814388   29086 main.go:141] libmachine: (addons-533488) DBG | err     : exit status 255

	I0807 17:37:23.814395   29086 main.go:141] libmachine: (addons-533488) DBG | output  : 

	I0807 17:37:26.816083   29086 main.go:141] libmachine: (addons-533488) DBG | Getting to WaitForSSH function...

	I0807 17:37:26.818753   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:26.819259   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:26.819299   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:26.819418   29086 main.go:141] libmachine: (addons-533488) DBG | Using SSH client type: external

	I0807 17:37:26.819446   29086 main.go:141] libmachine: (addons-533488) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa (-rw-------)

	I0807 17:37:26.819468   29086 main.go:141] libmachine: (addons-533488) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.180 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 17:37:26.819481   29086 main.go:141] libmachine: (addons-533488) DBG | About to run SSH command:

	I0807 17:37:26.819492   29086 main.go:141] libmachine: (addons-533488) DBG | exit 0

	I0807 17:37:26.944283   29086 main.go:141] libmachine: (addons-533488) DBG | SSH cmd err, output: <nil>: 

	I0807 17:37:26.944604   29086 main.go:141] libmachine: (addons-533488) KVM machine creation complete!

	I0807 17:37:26.944887   29086 main.go:141] libmachine: (addons-533488) Calling .GetConfigRaw

	I0807 17:37:26.945419   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:26.945605   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:26.945766   29086 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 17:37:26.945782   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:26.946963   29086 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 17:37:26.946982   29086 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 17:37:26.946988   29086 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 17:37:26.946993   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:26.949208   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:26.949486   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:26.949512   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:26.949667   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:26.949844   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:26.950095   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:26.950238   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:26.950449   29086 main.go:141] libmachine: Using SSH client type: native

	I0807 17:37:26.950644   29086 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.180 22 <nil> <nil>}

	I0807 17:37:26.950659   29086 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 17:37:27.055343   29086 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 17:37:27.055367   29086 main.go:141] libmachine: Detecting the provisioner...

	I0807 17:37:27.055376   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.058239   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.058675   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.058704   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.058847   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:27.059109   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.059285   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.059442   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:27.059584   29086 main.go:141] libmachine: Using SSH client type: native

	I0807 17:37:27.059725   29086 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.180 22 <nil> <nil>}

	I0807 17:37:27.059735   29086 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 17:37:27.169071   29086 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 17:37:27.169167   29086 main.go:141] libmachine: found compatible host: buildroot

	I0807 17:37:27.169183   29086 main.go:141] libmachine: Provisioning with buildroot...

	I0807 17:37:27.169195   29086 main.go:141] libmachine: (addons-533488) Calling .GetMachineName

	I0807 17:37:27.169478   29086 buildroot.go:166] provisioning hostname "addons-533488"

	I0807 17:37:27.169506   29086 main.go:141] libmachine: (addons-533488) Calling .GetMachineName

	I0807 17:37:27.169693   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.172178   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.172515   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.172540   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.172748   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:27.172938   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.173109   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.173252   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:27.173452   29086 main.go:141] libmachine: Using SSH client type: native

	I0807 17:37:27.173643   29086 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.180 22 <nil> <nil>}

	I0807 17:37:27.173662   29086 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-533488 && echo "addons-533488" | sudo tee /etc/hostname

	I0807 17:37:27.294851   29086 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-533488

	I0807 17:37:27.294873   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.297537   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.298004   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.298030   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.298221   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:27.298410   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.298563   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.298679   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:27.298856   29086 main.go:141] libmachine: Using SSH client type: native

	I0807 17:37:27.299068   29086 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.180 22 <nil> <nil>}

	I0807 17:37:27.299085   29086 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-533488' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-533488/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-533488' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 17:37:27.417583   29086 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 17:37:27.417608   29086 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 17:37:27.417643   29086 buildroot.go:174] setting up certificates

	I0807 17:37:27.417654   29086 provision.go:84] configureAuth start

	I0807 17:37:27.417666   29086 main.go:141] libmachine: (addons-533488) Calling .GetMachineName

	I0807 17:37:27.417992   29086 main.go:141] libmachine: (addons-533488) Calling .GetIP

	I0807 17:37:27.420589   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.421016   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.421043   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.421176   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.423318   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.423656   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.423675   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.423804   29086 provision.go:143] copyHostCerts

	I0807 17:37:27.423883   29086 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 17:37:27.424012   29086 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 17:37:27.424074   29086 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 17:37:27.424123   29086 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.addons-533488 san=[127.0.0.1 192.168.39.180 addons-533488 localhost minikube]

	I0807 17:37:27.522619   29086 provision.go:177] copyRemoteCerts

	I0807 17:37:27.522671   29086 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 17:37:27.522692   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.525199   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.525500   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.525525   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.525706   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:27.525881   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.526048   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:27.526183   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:27.610480   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 17:37:27.634232   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0807 17:37:27.657878   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0807 17:37:27.681482   29086 provision.go:87] duration metric: took 263.812417ms to configureAuth

	I0807 17:37:27.681512   29086 buildroot.go:189] setting minikube options for container-runtime

	I0807 17:37:27.681692   29086 config.go:182] Loaded profile config "addons-533488": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 17:37:27.681759   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.684333   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.684671   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.684702   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.684850   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:27.685031   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.685185   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.685301   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:27.685442   29086 main.go:141] libmachine: Using SSH client type: native

	I0807 17:37:27.685654   29086 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.180 22 <nil> <nil>}

	I0807 17:37:27.685670   29086 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 17:37:27.945573   29086 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 17:37:27.945609   29086 main.go:141] libmachine: Checking connection to Docker...

	I0807 17:37:27.945616   29086 main.go:141] libmachine: (addons-533488) Calling .GetURL

	I0807 17:37:27.946804   29086 main.go:141] libmachine: (addons-533488) DBG | Using libvirt version 6000000

	I0807 17:37:27.948742   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.949051   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.949077   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.949282   29086 main.go:141] libmachine: Docker is up and running!

	I0807 17:37:27.949298   29086 main.go:141] libmachine: Reticulating splines...

	I0807 17:37:27.949306   29086 client.go:171] duration metric: took 28.197048046s to LocalClient.Create

	I0807 17:37:27.949334   29086 start.go:167] duration metric: took 28.197133095s to libmachine.API.Create "addons-533488"

	I0807 17:37:27.949345   29086 start.go:293] postStartSetup for "addons-533488" (driver="kvm2")

	I0807 17:37:27.949359   29086 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 17:37:27.949392   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:27.949637   29086 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 17:37:27.949660   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:27.951589   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.951937   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:27.951955   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:27.952155   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:27.952352   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:27.952547   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:27.952717   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:28.034130   29086 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 17:37:28.038249   29086 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 17:37:28.038272   29086 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 17:37:28.038334   29086 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 17:37:28.038358   29086 start.go:296] duration metric: took 89.00682ms for postStartSetup

	I0807 17:37:28.038387   29086 main.go:141] libmachine: (addons-533488) Calling .GetConfigRaw

	I0807 17:37:28.038891   29086 main.go:141] libmachine: (addons-533488) Calling .GetIP

	I0807 17:37:28.041531   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.041816   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:28.041843   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.042049   29086 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/config.json ...

	I0807 17:37:28.042228   29086 start.go:128] duration metric: took 28.30790909s to createHost

	I0807 17:37:28.042251   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:28.044504   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.044865   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:28.044889   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.045025   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:28.045198   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:28.045366   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:28.045494   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:28.045637   29086 main.go:141] libmachine: Using SSH client type: native

	I0807 17:37:28.045829   29086 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.180 22 <nil> <nil>}

	I0807 17:37:28.045845   29086 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0807 17:37:28.152832   29086 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723052248.131729692

	I0807 17:37:28.152856   29086 fix.go:216] guest clock: 1723052248.131729692

	I0807 17:37:28.152864   29086 fix.go:229] Guest: 2024-08-07 17:37:28.131729692 +0000 UTC Remote: 2024-08-07 17:37:28.042238133 +0000 UTC m=+28.410003448 (delta=89.491559ms)

	I0807 17:37:28.152902   29086 fix.go:200] guest clock delta is within tolerance: 89.491559ms

	I0807 17:37:28.152908   29086 start.go:83] releasing machines lock for "addons-533488", held for 28.418669896s

	I0807 17:37:28.152933   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:28.153174   29086 main.go:141] libmachine: (addons-533488) Calling .GetIP

	I0807 17:37:28.156036   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.156421   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:28.156443   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.156609   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:28.157130   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:28.157296   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:28.157404   29086 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 17:37:28.157452   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:28.157583   29086 ssh_runner.go:195] Run: cat /version.json

	I0807 17:37:28.157601   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:28.160063   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.160096   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.160476   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:28.160502   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.160666   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:28.160732   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:28.160756   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:28.161006   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:28.161006   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:28.161205   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:28.161224   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:28.161379   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:28.161444   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:28.161510   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:28.264406   29086 ssh_runner.go:195] Run: systemctl --version

	I0807 17:37:28.270262   29086 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 17:37:28.430922   29086 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 17:37:28.436952   29086 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 17:37:28.437015   29086 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 17:37:28.452999   29086 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 17:37:28.453022   29086 start.go:495] detecting cgroup driver to use...

	I0807 17:37:28.453099   29086 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 17:37:28.469920   29086 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 17:37:28.483224   29086 docker.go:217] disabling cri-docker service (if available) ...

	I0807 17:37:28.483272   29086 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 17:37:28.496976   29086 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 17:37:28.510785   29086 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 17:37:28.625211   29086 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 17:37:28.773744   29086 docker.go:233] disabling docker service ...

	I0807 17:37:28.773820   29086 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 17:37:28.788631   29086 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 17:37:28.801433   29086 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 17:37:28.926951   29086 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 17:37:29.056703   29086 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 17:37:29.071183   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 17:37:29.089961   29086 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 17:37:29.090027   29086 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.100297   29086 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 17:37:29.100356   29086 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.110694   29086 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.120846   29086 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.130834   29086 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 17:37:29.141172   29086 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.150924   29086 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.167662   29086 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 17:37:29.177828   29086 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 17:37:29.186927   29086 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 17:37:29.186985   29086 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 17:37:29.200050   29086 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 17:37:29.209158   29086 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 17:37:29.319801   29086 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 17:37:29.449273   29086 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 17:37:29.449372   29086 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 17:37:29.454238   29086 start.go:563] Will wait 60s for crictl version

	I0807 17:37:29.454307   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:37:29.458040   29086 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 17:37:29.505157   29086 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 17:37:29.505283   29086 ssh_runner.go:195] Run: crio --version

	I0807 17:37:29.534744   29086 ssh_runner.go:195] Run: crio --version

	I0807 17:37:29.566371   29086 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 17:37:29.568018   29086 main.go:141] libmachine: (addons-533488) Calling .GetIP

	I0807 17:37:29.570839   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:29.571324   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:29.571349   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:29.571632   29086 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 17:37:29.575824   29086 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 17:37:29.588880   29086 kubeadm.go:883] updating cluster {Name:addons-533488 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.

3 ClusterName:addons-533488 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.180 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT

ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0807 17:37:29.589008   29086 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 17:37:29.589072   29086 ssh_runner.go:195] Run: sudo crictl images --output json

	I0807 17:37:29.622367   29086 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.3". assuming images are not preloaded.

	I0807 17:37:29.622445   29086 ssh_runner.go:195] Run: which lz4

	I0807 17:37:29.626548   29086 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0807 17:37:29.630773   29086 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0807 17:37:29.630800   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (406200976 bytes)

	I0807 17:37:31.007017   29086 crio.go:462] duration metric: took 1.380495197s to copy over tarball

	I0807 17:37:31.007091   29086 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0807 17:37:33.302303   29086 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.295182018s)

	I0807 17:37:33.302329   29086 crio.go:469] duration metric: took 2.295289128s to extract the tarball

	I0807 17:37:33.302338   29086 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0807 17:37:33.340637   29086 ssh_runner.go:195] Run: sudo crictl images --output json

	I0807 17:37:33.384078   29086 crio.go:514] all images are preloaded for cri-o runtime.

	I0807 17:37:33.384106   29086 cache_images.go:84] Images are preloaded, skipping loading

	I0807 17:37:33.384117   29086 kubeadm.go:934] updating node { 192.168.39.180 8443 v1.30.3 crio true true} ...

	I0807 17:37:33.384277   29086 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-533488 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.180

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:addons-533488 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 17:37:33.384347   29086 ssh_runner.go:195] Run: crio config

	I0807 17:37:33.427021   29086 cni.go:84] Creating CNI manager for ""

	I0807 17:37:33.427038   29086 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0807 17:37:33.427047   29086 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0807 17:37:33.427067   29086 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.180 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-533488 NodeName:addons-533488 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.180"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.180 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k

ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0807 17:37:33.427184   29086 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.180

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-533488"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.180

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.180"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0807 17:37:33.427236   29086 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 17:37:33.437324   29086 binaries.go:44] Found k8s binaries, skipping transfer

	I0807 17:37:33.437406   29086 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0807 17:37:33.447180   29086 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0807 17:37:33.463925   29086 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 17:37:33.480389   29086 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2157 bytes)

	I0807 17:37:33.497089   29086 ssh_runner.go:195] Run: grep 192.168.39.180	control-plane.minikube.internal$ /etc/hosts

	I0807 17:37:33.500771   29086 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.180	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 17:37:33.513405   29086 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 17:37:33.630210   29086 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 17:37:33.646928   29086 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488 for IP: 192.168.39.180

	I0807 17:37:33.646948   29086 certs.go:194] generating shared ca certs ...

	I0807 17:37:33.646965   29086 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:33.647100   29086 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 17:37:33.905700   29086 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt ...

	I0807 17:37:33.905734   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt: {Name:mk1ad2ad2a65fcafbda9f4bddc6f6746696b846e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:33.905953   29086 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key ...

	I0807 17:37:33.905974   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key: {Name:mkc9d150d26896f53fa908e2bf214b612b9bd4ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:33.906097   29086 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 17:37:34.026706   29086 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt ...

	I0807 17:37:34.026735   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt: {Name:mkfb924f1854c52c4e627c277966325c1941ebb5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.026934   29086 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key ...

	I0807 17:37:34.026951   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key: {Name:mk0da1a0c4c7a1e579722a5a34978c3325634ace Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.027065   29086 certs.go:256] generating profile certs ...

	I0807 17:37:34.027145   29086 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/client.key

	I0807 17:37:34.027175   29086 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/client.crt with IP's: []

	I0807 17:37:34.125253   29086 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/client.crt ...

	I0807 17:37:34.125282   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/client.crt: {Name:mkb2e7aa97eedb3dbf536e1b81759376bd3b00e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.125484   29086 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/client.key ...

	I0807 17:37:34.125498   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/client.key: {Name:mkb38587bd5368bc02cd81a0992ec1fe72bedc31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.125593   29086 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.key.a8452998

	I0807 17:37:34.125618   29086 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.crt.a8452998 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.180]

	I0807 17:37:34.204015   29086 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.crt.a8452998 ...

	I0807 17:37:34.204041   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.crt.a8452998: {Name:mke8f0892ad9c609aa746509fbb67a3aa93d2b1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.204231   29086 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.key.a8452998 ...

	I0807 17:37:34.204251   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.key.a8452998: {Name:mk43a12b14e50816f39262c83dd98c97ecd7ad3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.204349   29086 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.crt.a8452998 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.crt

	I0807 17:37:34.204443   29086 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.key.a8452998 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.key

	I0807 17:37:34.204509   29086 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.key

	I0807 17:37:34.204532   29086 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.crt with IP's: []

	I0807 17:37:34.275072   29086 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.crt ...

	I0807 17:37:34.275098   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.crt: {Name:mk5eed3c5225169a76e1b7cb5325cc4edcfb3e55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.275267   29086 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.key ...

	I0807 17:37:34.275281   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.key: {Name:mkc97db63f6946e371d068e86ff4b67c2aeb0457 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:34.275486   29086 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 17:37:34.275539   29086 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 17:37:34.275579   29086 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 17:37:34.275613   29086 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 17:37:34.276177   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 17:37:34.300249   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 17:37:34.325880   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 17:37:34.360221   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 17:37:34.390050   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0807 17:37:34.413997   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0807 17:37:34.437478   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 17:37:34.461473   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/addons-533488/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 17:37:34.484537   29086 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 17:37:34.507565   29086 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0807 17:37:34.524696   29086 ssh_runner.go:195] Run: openssl version

	I0807 17:37:34.530537   29086 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 17:37:34.542220   29086 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 17:37:34.546665   29086 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 17:37:34.546721   29086 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 17:37:34.552419   29086 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 17:37:34.563757   29086 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 17:37:34.567952   29086 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 17:37:34.568002   29086 kubeadm.go:392] StartCluster: {Name:addons-533488 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 C

lusterName:addons-533488 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.180 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 17:37:34.568090   29086 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0807 17:37:34.568137   29086 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0807 17:37:34.608505   29086 cri.go:89] found id: ""

	I0807 17:37:34.608569   29086 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0807 17:37:34.625918   29086 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0807 17:37:34.636508   29086 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0807 17:37:34.646217   29086 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0807 17:37:34.646238   29086 kubeadm.go:157] found existing configuration files:

	I0807 17:37:34.646296   29086 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0807 17:37:34.655858   29086 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0807 17:37:34.655912   29086 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0807 17:37:34.666760   29086 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0807 17:37:34.676290   29086 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0807 17:37:34.676343   29086 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0807 17:37:34.686004   29086 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0807 17:37:34.697103   29086 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0807 17:37:34.697162   29086 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0807 17:37:34.706902   29086 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0807 17:37:34.716306   29086 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0807 17:37:34.716360   29086 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0807 17:37:34.725789   29086 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0807 17:37:34.787369   29086 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3

	I0807 17:37:34.787471   29086 kubeadm.go:310] [preflight] Running pre-flight checks

	I0807 17:37:34.919240   29086 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0807 17:37:34.919373   29086 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0807 17:37:34.919504   29086 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0807 17:37:35.156511   29086 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0807 17:37:35.264013   29086 out.go:204]   - Generating certificates and keys ...

	I0807 17:37:35.264113   29086 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0807 17:37:35.264247   29086 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0807 17:37:35.264360   29086 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0807 17:37:35.459811   29086 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0807 17:37:35.515439   29086 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0807 17:37:35.675682   29086 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0807 17:37:35.847649   29086 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0807 17:37:35.847794   29086 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-533488 localhost] and IPs [192.168.39.180 127.0.0.1 ::1]

	I0807 17:37:35.910378   29086 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0807 17:37:35.910562   29086 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-533488 localhost] and IPs [192.168.39.180 127.0.0.1 ::1]

	I0807 17:37:36.054376   29086 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0807 17:37:36.200460   29086 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0807 17:37:36.564957   29086 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0807 17:37:36.565183   29086 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0807 17:37:36.742355   29086 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0807 17:37:36.905482   29086 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0807 17:37:37.057460   29086 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0807 17:37:37.159929   29086 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0807 17:37:37.269654   29086 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0807 17:37:37.270365   29086 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0807 17:37:37.272815   29086 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0807 17:37:37.274841   29086 out.go:204]   - Booting up control plane ...

	I0807 17:37:37.274947   29086 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0807 17:37:37.275027   29086 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0807 17:37:37.275829   29086 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0807 17:37:37.294295   29086 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0807 17:37:37.295259   29086 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0807 17:37:37.295312   29086 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0807 17:37:37.422202   29086 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0807 17:37:37.422301   29086 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0807 17:37:37.923919   29086 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.339331ms

	I0807 17:37:37.924022   29086 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0807 17:37:42.925161   29086 kubeadm.go:310] [api-check] The API server is healthy after 5.002941318s

	I0807 17:37:42.937653   29086 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0807 17:37:42.949374   29086 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0807 17:37:42.973253   29086 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0807 17:37:42.973504   29086 kubeadm.go:310] [mark-control-plane] Marking the node addons-533488 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0807 17:37:42.987920   29086 kubeadm.go:310] [bootstrap-token] Using token: dzetgu.x6jwww6oy2x559pl

	I0807 17:37:42.989452   29086 out.go:204]   - Configuring RBAC rules ...

	I0807 17:37:42.989571   29086 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0807 17:37:43.000743   29086 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0807 17:37:43.012624   29086 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0807 17:37:43.015720   29086 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0807 17:37:43.018717   29086 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0807 17:37:43.021635   29086 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0807 17:37:43.332138   29086 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0807 17:37:43.814706   29086 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0807 17:37:44.331014   29086 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0807 17:37:44.332175   29086 kubeadm.go:310] 

	I0807 17:37:44.332251   29086 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0807 17:37:44.332262   29086 kubeadm.go:310] 

	I0807 17:37:44.332370   29086 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0807 17:37:44.332398   29086 kubeadm.go:310] 

	I0807 17:37:44.332439   29086 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0807 17:37:44.332522   29086 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0807 17:37:44.332583   29086 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0807 17:37:44.332593   29086 kubeadm.go:310] 

	I0807 17:37:44.332664   29086 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0807 17:37:44.332676   29086 kubeadm.go:310] 

	I0807 17:37:44.332746   29086 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0807 17:37:44.332755   29086 kubeadm.go:310] 

	I0807 17:37:44.332829   29086 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0807 17:37:44.332925   29086 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0807 17:37:44.333020   29086 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0807 17:37:44.333033   29086 kubeadm.go:310] 

	I0807 17:37:44.333155   29086 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0807 17:37:44.333245   29086 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0807 17:37:44.333255   29086 kubeadm.go:310] 

	I0807 17:37:44.333326   29086 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token dzetgu.x6jwww6oy2x559pl \

	I0807 17:37:44.333417   29086 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 \

	I0807 17:37:44.333437   29086 kubeadm.go:310] 	--control-plane 

	I0807 17:37:44.333441   29086 kubeadm.go:310] 

	I0807 17:37:44.333546   29086 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0807 17:37:44.333555   29086 kubeadm.go:310] 

	I0807 17:37:44.333620   29086 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token dzetgu.x6jwww6oy2x559pl \

	I0807 17:37:44.333725   29086 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 

	I0807 17:37:44.334161   29086 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0807 17:37:44.334222   29086 cni.go:84] Creating CNI manager for ""

	I0807 17:37:44.334234   29086 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0807 17:37:44.336131   29086 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0807 17:37:44.337518   29086 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0807 17:37:44.349735   29086 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0807 17:37:44.369095   29086 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0807 17:37:44.369194   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:44.369217   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-533488 minikube.k8s.io/updated_at=2024_08_07T17_37_44_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=addons-533488 minikube.k8s.io/primary=true

	I0807 17:37:44.521547   29086 ops.go:34] apiserver oom_adj: -16

	I0807 17:37:44.521643   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:45.022167   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:45.522087   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:46.021716   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:46.522627   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:47.021909   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:47.522640   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:48.021852   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:48.522002   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:49.021831   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:49.522138   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:50.021847   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:50.522206   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:51.022296   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:51.522278   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:52.022542   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:52.522111   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:53.022322   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:53.521749   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:54.022095   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:54.522147   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:55.022255   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:55.521833   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:56.022551   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:56.522518   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:57.022549   29086 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 17:37:57.159884   29086 kubeadm.go:1113] duration metric: took 12.790749151s to wait for elevateKubeSystemPrivileges

	I0807 17:37:57.159926   29086 kubeadm.go:394] duration metric: took 22.591926954s to StartCluster

	I0807 17:37:57.159949   29086 settings.go:142] acquiring lock: {Name:mke44792daf8192c7cb4430e19df00c0686edd5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:57.160090   29086 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 17:37:57.160679   29086 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/kubeconfig: {Name:mk9a4ad53bf4447453626a7769211592f39f92fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 17:37:57.160879   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0807 17:37:57.160918   29086 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.39.180 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 17:37:57.160959   29086 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0807 17:37:57.161051   29086 addons.go:69] Setting yakd=true in profile "addons-533488"

	I0807 17:37:57.161060   29086 addons.go:69] Setting inspektor-gadget=true in profile "addons-533488"

	I0807 17:37:57.161083   29086 addons.go:234] Setting addon inspektor-gadget=true in "addons-533488"

	I0807 17:37:57.161098   29086 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-533488"

	I0807 17:37:57.161117   29086 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-533488"

	I0807 17:37:57.161112   29086 addons.go:69] Setting gcp-auth=true in profile "addons-533488"

	I0807 17:37:57.161124   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161116   29086 addons.go:69] Setting storage-provisioner=true in profile "addons-533488"

	I0807 17:37:57.161141   29086 mustload.go:65] Loading cluster: addons-533488

	I0807 17:37:57.161146   29086 addons.go:69] Setting metrics-server=true in profile "addons-533488"

	I0807 17:37:57.161153   29086 config.go:182] Loaded profile config "addons-533488": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 17:37:57.161162   29086 addons.go:234] Setting addon storage-provisioner=true in "addons-533488"

	I0807 17:37:57.161170   29086 addons.go:234] Setting addon metrics-server=true in "addons-533488"

	I0807 17:37:57.161197   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161205   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161090   29086 addons.go:234] Setting addon yakd=true in "addons-533488"

	I0807 17:37:57.161212   29086 addons.go:69] Setting helm-tiller=true in profile "addons-533488"

	I0807 17:37:57.161231   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161234   29086 addons.go:234] Setting addon helm-tiller=true in "addons-533488"

	I0807 17:37:57.161255   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161316   29086 config.go:182] Loaded profile config "addons-533488": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 17:37:57.161494   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161514   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161558   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161576   29086 addons.go:69] Setting ingress-dns=true in profile "addons-533488"

	I0807 17:37:57.161586   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161130   29086 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-533488"

	I0807 17:37:57.161596   29086 addons.go:234] Setting addon ingress-dns=true in "addons-533488"

	I0807 17:37:57.161598   29086 addons.go:69] Setting volcano=true in profile "addons-533488"

	I0807 17:37:57.161608   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161613   29086 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-533488"

	I0807 17:37:57.161615   29086 addons.go:234] Setting addon volcano=true in "addons-533488"

	I0807 17:37:57.161623   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161633   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161643   29086 addons.go:69] Setting registry=true in profile "addons-533488"

	I0807 17:37:57.161667   29086 addons.go:234] Setting addon registry=true in "addons-533488"

	I0807 17:37:57.161588   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161687   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161699   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161719   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161587   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161736   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161761   29086 addons.go:69] Setting cloud-spanner=true in profile "addons-533488"

	I0807 17:37:57.161201   29086 addons.go:69] Setting ingress=true in profile "addons-533488"

	I0807 17:37:57.161781   29086 addons.go:234] Setting addon cloud-spanner=true in "addons-533488"

	I0807 17:37:57.161784   29086 addons.go:234] Setting addon ingress=true in "addons-533488"

	I0807 17:37:57.161797   29086 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-533488"

	I0807 17:37:57.161849   29086 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-533488"

	I0807 17:37:57.161886   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.161954   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161977   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.161994   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.162000   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161589   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.162058   29086 addons.go:69] Setting volumesnapshots=true in profile "addons-533488"

	I0807 17:37:57.162085   29086 addons.go:234] Setting addon volumesnapshots=true in "addons-533488"

	I0807 17:37:57.161634   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.162287   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.162313   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.161800   29086 addons.go:69] Setting default-storageclass=true in profile "addons-533488"

	I0807 17:37:57.162372   29086 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-533488"

	I0807 17:37:57.162129   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.162565   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.162589   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.162599   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.162646   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.162669   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.162688   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.162705   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.162760   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.162803   29086 out.go:177] * Verifying Kubernetes components...

	I0807 17:37:57.162811   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.162852   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.162887   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.163241   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.163267   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.163353   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.163406   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.164361   29086 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 17:37:57.182813   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39207

	I0807 17:37:57.183038   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44499

	I0807 17:37:57.183338   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.184030   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.184112   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40639

	I0807 17:37:57.184583   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.184605   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.184927   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.184976   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40693

	I0807 17:37:57.185425   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.185445   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.185470   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.185533   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.185562   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.185768   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.185923   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.185943   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.186704   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.186899   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.188640   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.188666   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.188817   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.188853   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.196173   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37921

	I0807 17:37:57.196214   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35777

	I0807 17:37:57.196180   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.196420   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32837

	I0807 17:37:57.196510   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.196656   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.196699   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.196749   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.196811   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.197608   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.197626   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.197662   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.197690   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.197964   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.198252   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.198546   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.198581   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.198825   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.198874   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.199325   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.199352   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.199420   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.199726   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.199845   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.199858   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.200362   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.200392   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.200905   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.201484   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.201510   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.226548   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41975

	I0807 17:37:57.227007   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.228046   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.228069   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.228575   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.229150   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.229177   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.234194   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43083

	I0807 17:37:57.234635   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.235131   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.235150   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.235477   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.235684   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.236928   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38813

	I0807 17:37:57.237565   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.238331   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.238365   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.240681   29086 addons.go:234] Setting addon default-storageclass=true in "addons-533488"

	I0807 17:37:57.240720   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.241070   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.241120   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.241386   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37703

	I0807 17:37:57.241538   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39473

	I0807 17:37:57.242669   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.242679   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.242694   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44945

	I0807 17:37:57.242673   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45691

	I0807 17:37:57.242908   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.243347   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.243355   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.243387   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.243433   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.243600   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.243618   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.243675   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.243691   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.243832   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.243845   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.244016   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.244031   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.244245   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.244249   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.244528   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.244586   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.245152   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.245179   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.245157   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.245337   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.245674   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.246316   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.246747   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36229

	I0807 17:37:57.246951   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44053

	I0807 17:37:57.247140   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.247211   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.247645   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.247663   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.247799   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.247808   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.247887   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34159

	I0807 17:37:57.248338   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.248444   29086 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0807 17:37:57.248483   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.248512   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.248862   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.248910   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.248963   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.249479   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.249499   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.249847   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.249872   29086 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0807 17:37:57.249886   29086 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0807 17:37:57.249911   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.250039   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.250094   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.253911   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45803

	I0807 17:37:57.254088   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.254130   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.265343   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.265506   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.265556   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.265560   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37085

	I0807 17:37:57.265625   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42121

	I0807 17:37:57.265847   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.265866   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.265892   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.265917   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.265934   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.265983   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43601

	I0807 17:37:57.266067   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33705

	I0807 17:37:57.266652   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.266729   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.266787   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.267029   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.267809   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.267859   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.267913   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.268441   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.268535   29086 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1

	I0807 17:37:57.269029   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.269332   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.269345   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.269994   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.270008   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.270364   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.270365   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.270626   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.270899   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.270948   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.271229   29086 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0807 17:37:57.271652   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.271668   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.271792   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.271804   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.272175   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.272256   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.272454   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.272526   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0807 17:37:57.272752   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.273128   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.273795   29086 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0807 17:37:57.274678   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.275284   29086 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0807 17:37:57.275300   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0807 17:37:57.275318   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.275400   29086 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0807 17:37:57.275437   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0807 17:37:57.276278   29086 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0807 17:37:57.277980   29086 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0807 17:37:57.278001   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0807 17:37:57.278018   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.278900   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41387

	I0807 17:37:57.278986   29086 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-533488"

	I0807 17:37:57.279027   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:37:57.279052   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39565

	I0807 17:37:57.279375   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.279409   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.279432   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.279435   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.279811   29086 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0807 17:37:57.279824   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0807 17:37:57.279838   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.279891   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.279912   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.279979   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.279998   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.280328   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.280829   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.280867   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.281065   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.281252   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.281928   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.282018   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0807 17:37:57.282427   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.282456   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.283109   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.283508   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.283572   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.283721   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.283863   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.284061   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.284369   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.284395   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.284431   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.284567   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.284721   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.284787   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.284841   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.285367   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0807 17:37:57.286878   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0807 17:37:57.288247   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0807 17:37:57.288315   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0807 17:37:57.288397   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.288427   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.288441   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.288646   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.288844   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.288994   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.289605   29086 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0807 17:37:57.289621   29086 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0807 17:37:57.289637   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.290776   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0807 17:37:57.291981   29086 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0807 17:37:57.293154   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.293322   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0807 17:37:57.293345   29086 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0807 17:37:57.293362   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.293563   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.293656   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.293727   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.293928   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.294311   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.294440   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.295838   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40865

	I0807 17:37:57.296743   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.297453   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.297474   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.297568   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37845

	I0807 17:37:57.298024   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.298448   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.298605   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.298617   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.299016   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.299029   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.299045   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.299238   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.299988   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.300012   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.300154   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.300369   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.300499   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.300621   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.301006   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.301610   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.302506   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39723

	I0807 17:37:57.302739   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46581

	I0807 17:37:57.302921   29086 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0807 17:37:57.303004   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.303097   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.303446   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42271

	I0807 17:37:57.303726   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.303805   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.303810   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.303819   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.303824   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.303807   29086 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.1

	I0807 17:37:57.304126   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.304176   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.304183   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.304302   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.304759   29086 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0807 17:37:57.304776   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0807 17:37:57.304780   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.304791   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.304826   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.304848   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.305684   29086 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0807 17:37:57.305701   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0807 17:37:57.305717   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.308316   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.309463   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.311114   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.311337   29086 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0807 17:37:57.311753   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.312488   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.312532   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.312729   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.312754   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.312735   29086 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0807 17:37:57.312774   29086 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0807 17:37:57.312789   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.312929   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35415

	I0807 17:37:57.313122   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.313409   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45953

	I0807 17:37:57.313638   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.313685   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.313850   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.313914   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.313987   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.314113   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.314160   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.314236   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.314509   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.314779   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.315001   29086 out.go:177]   - Using image docker.io/registry:2.8.3

	I0807 17:37:57.315039   29086 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0807 17:37:57.315050   29086 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0807 17:37:57.315069   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.315602   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.315615   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.315660   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.316010   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.316199   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.316435   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.316666   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.316883   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.317097   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.317584   29086 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0807 17:37:57.318576   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.318618   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.318842   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:37:57.318864   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:37:57.319261   29086 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0807 17:37:57.319275   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0807 17:37:57.319289   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.320330   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.320364   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:37:57.320335   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.320398   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.320416   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.320656   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.320663   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39291

	I0807 17:37:57.320830   29086 main.go:141] libmachine: Failed to make call to close driver server: unexpected EOF

	I0807 17:37:57.320843   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:37:57.320859   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:37:57.320868   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:37:57.321307   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:37:57.321326   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:37:57.321340   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.321346   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:37:57.321409   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	W0807 17:37:57.321423   29086 out.go:239] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	I0807 17:37:57.321657   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.321657   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.321850   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.321863   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.321926   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.321945   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.321983   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.322139   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.322293   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.322305   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.322386   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.322532   29086 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22

	I0807 17:37:57.323112   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:37:57.323150   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:37:57.323594   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.323993   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.324015   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.324054   29086 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0807 17:37:57.324070   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0807 17:37:57.324086   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.324282   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.324437   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.324540   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.324780   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.324926   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45821

	I0807 17:37:57.325300   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.325804   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.325855   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.326166   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.326285   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	W0807 17:37:57.326328   29086 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:34070->192.168.39.180:22: read: connection reset by peer

	I0807 17:37:57.326352   29086 retry.go:31] will retry after 181.768689ms: ssh: handshake failed: read tcp 192.168.39.1:34070->192.168.39.180:22: read: connection reset by peer

	I0807 17:37:57.328192   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.328485   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.328664   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.328687   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.328840   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.328967   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.329057   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.329221   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.330431   29086 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0

	I0807 17:37:57.331856   29086 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0807 17:37:57.331875   29086 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0807 17:37:57.331888   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.334984   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.335330   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.335347   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.335536   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.335726   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.335916   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.336058   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	W0807 17:37:57.338571   29086 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:34086->192.168.39.180:22: read: connection reset by peer

	I0807 17:37:57.338592   29086 retry.go:31] will retry after 323.995523ms: ssh: handshake failed: read tcp 192.168.39.1:34086->192.168.39.180:22: read: connection reset by peer

	I0807 17:37:57.345288   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46049

	I0807 17:37:57.345708   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:37:57.346219   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:37:57.346237   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:37:57.346549   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:37:57.346769   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:37:57.348631   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:37:57.350833   29086 out.go:177]   - Using image docker.io/busybox:stable

	I0807 17:37:57.352463   29086 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0807 17:37:57.353982   29086 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0807 17:37:57.353997   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0807 17:37:57.354014   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:37:57.356999   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.357409   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:37:57.357440   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:37:57.357684   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:37:57.357878   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:37:57.358027   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:37:57.358186   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:37:57.582815   29086 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0807 17:37:57.582840   29086 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0807 17:37:57.630394   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0807 17:37:57.632978   29086 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0807 17:37:57.633003   29086 ssh_runner.go:362] scp helm-tiller/helm-tiller-rbac.yaml --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0807 17:37:57.671926   29086 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0807 17:37:57.671945   29086 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0807 17:37:57.699686   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0807 17:37:57.711588   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0807 17:37:57.783393   29086 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0807 17:37:57.783413   29086 ssh_runner.go:362] scp helm-tiller/helm-tiller-svc.yaml --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0807 17:37:57.784036   29086 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0807 17:37:57.784048   29086 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0807 17:37:57.786543   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0807 17:37:57.786556   29086 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0807 17:37:57.800759   29086 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0807 17:37:57.800778   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0807 17:37:57.827889   29086 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 17:37:57.827896   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0807 17:37:57.864255   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0807 17:37:57.877023   29086 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0807 17:37:57.877042   29086 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0807 17:37:57.879497   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0807 17:37:57.890360   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0807 17:37:57.939002   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0807 17:37:57.941544   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0807 17:37:58.002185   29086 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0807 17:37:58.002210   29086 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0807 17:37:58.020460   29086 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0807 17:37:58.020486   29086 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0807 17:37:58.048459   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0807 17:37:58.048483   29086 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0807 17:37:58.122662   29086 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0807 17:37:58.122696   29086 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0807 17:37:58.195324   29086 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0807 17:37:58.195348   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0807 17:37:58.234010   29086 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0807 17:37:58.234037   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0807 17:37:58.381982   29086 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0807 17:37:58.382001   29086 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0807 17:37:58.386074   29086 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0807 17:37:58.386089   29086 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0807 17:37:58.386980   29086 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0807 17:37:58.386998   29086 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0807 17:37:58.395475   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0807 17:37:58.395498   29086 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0807 17:37:58.462260   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0807 17:37:58.570013   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0807 17:37:58.570034   29086 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0807 17:37:58.583264   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0807 17:37:58.640049   29086 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0807 17:37:58.640082   29086 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0807 17:37:58.650482   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0807 17:37:58.650513   29086 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0807 17:37:58.654539   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0807 17:37:58.817930   29086 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0807 17:37:58.817955   29086 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0807 17:37:58.909589   29086 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0807 17:37:58.909607   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0807 17:37:58.924071   29086 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0807 17:37:58.924088   29086 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0807 17:37:59.160669   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0807 17:37:59.201871   29086 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0807 17:37:59.201896   29086 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0807 17:37:59.206803   29086 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0807 17:37:59.206821   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0807 17:37:59.619976   29086 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0807 17:37:59.619998   29086 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0807 17:37:59.671998   29086 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0807 17:37:59.672024   29086 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0807 17:37:59.779634   29086 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0807 17:37:59.779661   29086 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0807 17:37:59.966902   29086 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0807 17:37:59.966936   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0807 17:38:00.144915   29086 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0807 17:38:00.144942   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0807 17:38:00.153147   29086 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0807 17:38:00.153168   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0807 17:38:00.459819   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0807 17:38:00.463849   29086 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0807 17:38:00.463877   29086 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0807 17:38:00.603870   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0807 17:38:04.282051   29086 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0807 17:38:04.282109   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:38:04.285206   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:38:04.285642   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:38:04.285679   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:38:04.285792   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:38:04.286016   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:38:04.286181   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:38:04.286329   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:38:04.723343   29086 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0807 17:38:04.773651   29086 addons.go:234] Setting addon gcp-auth=true in "addons-533488"

	I0807 17:38:04.773719   29086 host.go:66] Checking if "addons-533488" exists ...

	I0807 17:38:04.774147   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:38:04.774201   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:38:04.790299   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43369

	I0807 17:38:04.790794   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:38:04.791328   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:38:04.791352   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:38:04.791709   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:38:04.792395   29086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 17:38:04.792429   29086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 17:38:04.808199   29086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34373

	I0807 17:38:04.808614   29086 main.go:141] libmachine: () Calling .GetVersion

	I0807 17:38:04.809127   29086 main.go:141] libmachine: Using API Version  1

	I0807 17:38:04.809149   29086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 17:38:04.809474   29086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 17:38:04.809693   29086 main.go:141] libmachine: (addons-533488) Calling .GetState

	I0807 17:38:04.811567   29086 main.go:141] libmachine: (addons-533488) Calling .DriverName

	I0807 17:38:04.811805   29086 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0807 17:38:04.811831   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHHostname

	I0807 17:38:04.815069   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:38:04.815493   29086 main.go:141] libmachine: (addons-533488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:17:25:52", ip: ""} in network mk-addons-533488: {Iface:virbr1 ExpiryTime:2024-08-07 18:37:15 +0000 UTC Type:0 Mac:52:54:00:17:25:52 Iaid: IPaddr:192.168.39.180 Prefix:24 Hostname:addons-533488 Clientid:01:52:54:00:17:25:52}

	I0807 17:38:04.815519   29086 main.go:141] libmachine: (addons-533488) DBG | domain addons-533488 has defined IP address 192.168.39.180 and MAC address 52:54:00:17:25:52 in network mk-addons-533488

	I0807 17:38:04.815707   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHPort

	I0807 17:38:04.815978   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHKeyPath

	I0807 17:38:04.816223   29086 main.go:141] libmachine: (addons-533488) Calling .GetSSHUsername

	I0807 17:38:04.816404   29086 sshutil.go:53] new ssh client: &{IP:192.168.39.180 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/addons-533488/id_rsa Username:docker}

	I0807 17:38:05.996419   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.365991845s)

	I0807 17:38:05.996472   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996477   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.296764854s)

	I0807 17:38:05.996483   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996532   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.284922073s)

	I0807 17:38:05.996554   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996564   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996512   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996600   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996626   29086 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (8.168675606s)

	I0807 17:38:05.996645   29086 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0807 17:38:05.996610   29086 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (8.168685971s)

	I0807 17:38:05.996655   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (8.132375325s)

	I0807 17:38:05.996680   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996690   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996697   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.117179481s)

	I0807 17:38:05.996735   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996748   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996770   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.106391414s)

	I0807 17:38:05.996786   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996797   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996843   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (8.057811866s)

	I0807 17:38:05.996861   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996870   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996890   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (8.055311709s)

	I0807 17:38:05.996907   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996917   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996954   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.534669217s)

	I0807 17:38:05.996971   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.996976   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.41367877s)

	I0807 17:38:05.996994   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997003   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.996980   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997043   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.342481002s)

	I0807 17:38:05.997075   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997085   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997176   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.836476358s)

	W0807 17:38:05.997221   29086 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0807 17:38:05.997248   29086 retry.go:31] will retry after 330.237435ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0807 17:38:05.997300   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.997312   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.997322   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997330   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997348   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.537488532s)

	I0807 17:38:05.997366   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997375   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997489   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.997507   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.997539   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.997579   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.997587   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.997595   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997602   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997732   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.997743   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.997751   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997769   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997786   29086 node_ready.go:35] waiting up to 6m0s for node "addons-533488" to be "Ready" ...

	I0807 17:38:05.997806   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.997818   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.997833   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.997843   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.997969   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.997991   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.997998   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998006   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.998013   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.998057   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.998077   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.998085   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998095   29086 addons.go:475] Verifying addon registry=true in "addons-533488"

	I0807 17:38:05.998506   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.998517   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998696   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.998705   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998713   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.998720   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.998762   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.998782   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.998788   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998795   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.998802   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.998836   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.998851   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.998866   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.998873   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998880   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.998886   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.998920   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.998928   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.998934   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:05.998940   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:05.999083   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.999110   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.999116   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.999338   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.999357   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.999390   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.999398   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.999788   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.999817   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.999828   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.999952   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:05.999972   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:05.999978   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:05.999985   29086 addons.go:475] Verifying addon ingress=true in "addons-533488"

	I0807 17:38:06.000151   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.000160   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.000177   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.000184   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.000108   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.000248   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.000248   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.000259   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.000265   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.000268   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.000275   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.000282   29086 addons.go:475] Verifying addon metrics-server=true in "addons-533488"

	I0807 17:38:06.000342   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.000344   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.000362   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.000364   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.000369   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.000370   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.000386   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.000394   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.000124   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.000805   29086 out.go:177] * Verifying registry addon...

	I0807 17:38:06.001651   29086 out.go:177] * Verifying ingress addon...

	I0807 17:38:06.002244   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.002266   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.002279   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.002293   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.002268   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.002309   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.002552   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.002577   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.002584   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.002838   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.002849   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.004462   29086 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0807 17:38:06.005371   29086 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0807 17:38:06.005414   29086 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-533488 service yakd-dashboard -n yakd-dashboard

	I0807 17:38:06.016787   29086 node_ready.go:49] node "addons-533488" has status "Ready":"True"

	I0807 17:38:06.016813   29086 node_ready.go:38] duration metric: took 19.011857ms for node "addons-533488" to be "Ready" ...

	I0807 17:38:06.016825   29086 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 17:38:06.025748   29086 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0807 17:38:06.025777   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:06.038506   29086 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0807 17:38:06.038526   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:06.050081   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.050104   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.050437   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.050437   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.050466   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	W0807 17:38:06.050559   29086 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I0807 17:38:06.062519   29086 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-brzz5" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.067713   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.067740   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.068070   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.068137   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.068159   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.177346   29086 pod_ready.go:92] pod "coredns-7db6d8ff4d-brzz5" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:06.177384   29086 pod_ready.go:81] duration metric: took 114.835104ms for pod "coredns-7db6d8ff4d-brzz5" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.177397   29086 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-s6vqw" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.267385   29086 pod_ready.go:92] pod "coredns-7db6d8ff4d-s6vqw" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:06.267413   29086 pod_ready.go:81] duration metric: took 90.007397ms for pod "coredns-7db6d8ff4d-s6vqw" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.267426   29086 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.295334   29086 pod_ready.go:92] pod "etcd-addons-533488" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:06.295358   29086 pod_ready.go:81] duration metric: took 27.923523ms for pod "etcd-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.295367   29086 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.311077   29086 pod_ready.go:92] pod "kube-apiserver-addons-533488" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:06.311106   29086 pod_ready.go:81] duration metric: took 15.733388ms for pod "kube-apiserver-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.311120   29086 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.328550   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0807 17:38:06.405463   29086 pod_ready.go:92] pod "kube-controller-manager-addons-533488" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:06.405492   29086 pod_ready.go:81] duration metric: took 94.362313ms for pod "kube-controller-manager-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.405509   29086 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-d687t" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.500442   29086 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-533488" context rescaled to 1 replicas

	I0807 17:38:06.512874   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:06.517549   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:06.808319   29086 pod_ready.go:92] pod "kube-proxy-d687t" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:06.808341   29086 pod_ready.go:81] duration metric: took 402.824636ms for pod "kube-proxy-d687t" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.808350   29086 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:06.845471   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.24155019s)

	I0807 17:38:06.845523   29086 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.033696338s)

	I0807 17:38:06.845522   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.845641   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.845981   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.846050   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.846066   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.846077   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:06.846089   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:06.846308   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:06.846327   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:06.846332   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:06.846344   29086 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-533488"

	I0807 17:38:06.847594   29086 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0807 17:38:06.848420   29086 out.go:177] * Verifying csi-hostpath-driver addon...

	I0807 17:38:06.850216   29086 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0807 17:38:06.850956   29086 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0807 17:38:06.851139   29086 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0807 17:38:06.851171   29086 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0807 17:38:06.873461   29086 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0807 17:38:06.873491   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:06.909507   29086 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0807 17:38:06.909533   29086 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0807 17:38:06.933712   29086 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0807 17:38:06.933730   29086 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0807 17:38:06.988067   29086 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0807 17:38:07.011722   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:07.013514   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:07.201149   29086 pod_ready.go:92] pod "kube-scheduler-addons-533488" in "kube-system" namespace has status "Ready":"True"

	I0807 17:38:07.201169   29086 pod_ready.go:81] duration metric: took 392.8126ms for pod "kube-scheduler-addons-533488" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:07.201179   29086 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace to be "Ready" ...

	I0807 17:38:07.357399   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:07.510630   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:07.513181   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:07.873753   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:08.010285   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:08.014158   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:08.362546   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:08.509988   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:08.510143   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:08.859821   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:09.013505   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:09.013885   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:09.214394   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:09.364411   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:09.509467   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:09.510650   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:09.747021   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.758915584s)

	I0807 17:38:09.747074   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:09.747092   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:09.747210   29086 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.418610447s)

	I0807 17:38:09.747246   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:09.747260   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:09.747376   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:09.747395   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:09.747406   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:09.747413   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:09.747528   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:09.747556   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:09.747581   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:09.747602   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:09.747638   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:09.747645   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:09.747746   29086 main.go:141] libmachine: Making call to close driver server

	I0807 17:38:09.747759   29086 main.go:141] libmachine: (addons-533488) Calling .Close

	I0807 17:38:09.748006   29086 main.go:141] libmachine: (addons-533488) DBG | Closing plugin on server side

	I0807 17:38:09.748031   29086 main.go:141] libmachine: Successfully made call to close driver server

	I0807 17:38:09.748047   29086 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 17:38:09.749833   29086 addons.go:475] Verifying addon gcp-auth=true in "addons-533488"

	I0807 17:38:09.751854   29086 out.go:177] * Verifying gcp-auth addon...

	I0807 17:38:09.753574   29086 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0807 17:38:09.758125   29086 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0807 17:38:09.758140   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:09.863431   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:10.010412   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:10.012299   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:10.258836   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:10.356615   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:10.511331   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:10.511661   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:10.760585   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:10.857203   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:11.010107   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:11.010389   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:11.257712   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:11.357644   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:11.510087   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:11.510922   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:11.706923   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:11.757647   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:11.857166   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:12.009646   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:12.010193   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:12.257739   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:12.357205   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:12.516024   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:12.524161   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:12.757016   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:12.857275   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:13.013873   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:13.015350   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:13.257011   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:13.357330   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:13.511470   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:13.511534   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:13.993597   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:13.996144   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:13.998330   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:14.009312   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:14.012567   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:14.257037   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:14.357768   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:14.509203   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:14.512033   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:14.843956   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:14.857292   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:15.008747   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:15.011295   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:15.257002   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:15.357837   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:15.509468   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:15.510209   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:15.758082   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:15.858075   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:16.011195   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:16.011371   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:16.207869   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:16.257021   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:16.358834   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:16.509541   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:16.509683   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:16.756969   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:16.856622   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:17.010340   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:17.010567   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:17.257217   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:17.355760   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:17.511318   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:17.511331   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:17.759844   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:17.856702   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:18.010889   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:18.011032   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:18.258033   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:18.360195   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:18.509536   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:18.510139   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:18.707836   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:18.757904   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:18.856898   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:19.012655   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:19.019164   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:19.257386   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:19.357682   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:19.510513   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:19.510517   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:19.757192   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:19.857020   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:20.009318   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:20.012058   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:20.257053   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:20.357894   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:20.509191   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:20.510826   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:20.757906   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:20.856653   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:21.010726   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:21.011279   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:21.206952   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:21.257164   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:21.357109   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:21.511113   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:21.511390   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:21.756698   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:21.857367   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:22.111108   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:22.113076   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:22.258012   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:22.357244   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:22.510482   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:22.510824   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:22.757355   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:22.860669   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:23.008721   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:23.009500   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:23.207898   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:23.257293   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:23.355929   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:23.510850   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:23.510954   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:23.756997   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:23.861061   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:24.009716   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:24.011743   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:24.259858   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:24.357368   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:24.511435   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:24.511557   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:24.758864   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:24.856120   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:25.009687   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:25.009900   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:25.262306   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:25.356395   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:25.509263   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:25.509996   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:25.707251   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:25.757810   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:25.857283   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:26.009970   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:26.012136   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:26.260932   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:26.361715   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:26.509935   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:26.511987   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:26.757435   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:26.856779   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:27.011314   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:27.012470   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:27.268044   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:27.363742   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:27.514095   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:27.514288   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:27.709547   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:27.757530   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:27.857702   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:28.009585   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:28.010109   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:28.257946   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:28.359519   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:28.509645   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:28.510502   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:28.757528   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:28.857035   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:29.009380   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:29.010099   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:29.257760   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:29.356302   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:29.509743   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:29.510065   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:29.757970   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:29.856176   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:30.008994   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:30.012413   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:30.237845   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:30.258712   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:30.356802   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:30.510115   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:30.510416   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:30.756850   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:30.857075   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:31.012893   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:31.013320   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:31.256967   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:31.356445   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:31.509871   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:31.511492   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:31.757969   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:31.859835   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:32.009922   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:32.009919   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:32.257448   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:32.357499   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:32.509715   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:32.509919   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:32.708463   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:32.757754   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:32.857308   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:33.010112   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:33.010194   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:33.257536   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:33.356895   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:33.508768   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:33.511366   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:33.758363   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:33.856725   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:34.011156   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:34.011333   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:34.258885   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:34.359758   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:34.511568   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:34.511917   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:34.756843   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:34.864549   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:35.010147   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:35.010495   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:35.208564   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:35.257174   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:35.355680   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:35.509635   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:35.510097   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:35.756567   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:35.856566   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:36.009447   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:36.010848   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:36.257613   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:36.356486   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:36.510048   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:36.510620   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:36.757548   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:36.856649   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:37.009843   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:37.009986   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:37.258855   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:37.359541   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:37.512846   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:37.515236   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:37.708014   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:37.757195   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:37.855623   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:38.010777   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:38.011067   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:38.257335   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:38.357267   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:38.509120   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:38.509215   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:38.757212   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:38.860747   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:39.010941   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:39.011182   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:39.259797   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:39.357557   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:39.510633   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:39.511660   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:39.757452   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:39.856815   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:40.010285   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:40.011543   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:40.207183   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:40.257138   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:40.358201   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:40.577675   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:40.578702   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:40.803436   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:40.857306   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:41.011660   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:41.012980   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:41.257233   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:41.357550   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:41.510424   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:41.510454   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:41.757649   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:41.858292   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:42.010505   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:42.010531   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:42.257614   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:42.363455   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:42.631064   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:42.631435   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:42.707181   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:42.758283   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:42.856606   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:43.009381   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:43.009606   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:43.257562   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:43.356819   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:43.509191   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:43.509198   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0807 17:38:43.757394   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:43.858994   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:44.010268   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:44.010654   29086 kapi.go:107] duration metric: took 38.006192746s to wait for kubernetes.io/minikube-addons=registry ...

	I0807 17:38:44.257794   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:44.356573   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:44.509669   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:44.757824   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:44.857669   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:45.010060   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:45.208495   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:45.261263   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:45.356356   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:45.510489   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:45.757466   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:45.856868   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:46.010309   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:46.257358   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:46.548703   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:46.553420   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:46.756752   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:46.856668   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:47.009462   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:47.258918   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:47.358307   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:47.510231   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:47.707777   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:47.757894   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:47.860933   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:48.010258   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:48.257456   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:48.361910   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:48.510055   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:48.765793   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:48.870790   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:49.011222   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:49.257072   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:49.357361   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:49.510154   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:49.759398   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:49.857452   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:50.009867   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:50.207788   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:50.258553   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:50.356419   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:50.510260   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:50.757749   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:50.856580   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:51.010023   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:51.256971   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:51.359336   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:51.509818   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:51.762844   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:51.859989   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:52.010798   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:52.256759   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:52.357347   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:52.510368   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:52.798961   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:52.802138   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:52.856770   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:53.009644   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:53.257818   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:53.357315   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:53.509450   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:53.759172   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:53.856166   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:54.010424   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:54.258470   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:54.356814   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:54.510604   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:54.757992   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:54.856901   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:55.011107   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:55.206643   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:55.257441   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:55.356450   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:55.509467   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:56.167227   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:56.168442   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:56.168463   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:56.259616   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:56.357165   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:56.510147   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:56.757058   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:56.856905   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:57.010619   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:57.208380   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:57.258987   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:57.357140   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:57.509583   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:57.757350   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:57.856550   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:58.009612   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:58.257805   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:58.356951   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:58.509926   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:58.757158   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:58.855878   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:59.011777   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:59.258776   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:59.356831   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:38:59.509988   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:38:59.707996   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:38:59.757101   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:38:59.860879   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:00.009991   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:00.257450   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:00.356836   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:00.509806   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:00.758207   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:00.862945   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:01.010378   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:01.258313   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:01.366526   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:01.510976   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:01.708189   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:01.757603   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:01.864651   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:02.013513   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:02.257602   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:02.357408   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:02.509655   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:02.757393   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:02.861923   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:03.010057   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:03.257879   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:03.357438   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:03.510954   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:03.756937   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:03.857129   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:04.010271   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:04.208439   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:04.257922   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:04.357776   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:04.510805   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:05.098390   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:05.098685   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:05.099813   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:05.258565   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:05.360777   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:05.510559   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:05.757541   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:05.859390   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:06.011012   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:06.257609   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:06.374433   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:06.511060   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:06.708966   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:06.759021   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:06.856768   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:07.010127   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:07.257977   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:07.356905   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:07.510220   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:07.758201   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:07.857017   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:08.010707   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:08.259832   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:08.356443   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:08.511552   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:08.714369   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:08.760358   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:08.861253   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:09.009152   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:09.259319   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:09.356262   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:09.509672   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:09.756853   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:09.856559   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:10.012560   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:10.257396   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:10.360089   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:10.509625   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:10.757908   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:10.859492   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:11.010009   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:11.208093   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:11.257099   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:11.357803   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:11.511772   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:11.759705   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:11.856654   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:12.010047   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:12.257667   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:12.357226   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:12.509667   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:12.758138   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:12.857956   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:13.219302   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:13.222083   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:13.263683   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:13.357090   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:13.519444   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:13.758093   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:13.866939   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:14.014503   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:14.258553   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:14.357325   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:14.510533   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:14.757575   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:14.856679   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:15.010198   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:15.259508   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:15.360758   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:15.510990   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:15.711612   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:15.772484   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:15.857109   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:16.013089   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:16.258013   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:16.357138   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:16.510883   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:16.758582   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:16.861015   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:17.010298   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:17.257652   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:17.360013   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:17.509981   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:17.756834   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:17.857975   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:18.010539   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:18.479662   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:18.481847   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:18.482787   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:18.509303   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:18.757398   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:18.855961   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:19.009918   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:19.258237   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:19.356126   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:19.512270   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:19.759400   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:19.856876   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:20.009715   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:20.256739   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:20.356715   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:20.510575   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:20.708414   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:20.757455   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:20.856070   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:21.009513   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:21.259414   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:21.358657   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:21.510233   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:21.757150   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:21.856845   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:22.010833   29086 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0807 17:39:22.258290   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:22.356824   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:22.510316   29086 kapi.go:107] duration metric: took 1m16.504942984s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0807 17:39:22.762217   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:22.857111   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:23.209796   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:23.258084   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:23.356928   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:23.757078   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:23.857083   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:24.257495   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:24.356720   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:24.756911   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:24.856508   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:25.257598   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:25.356287   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:25.713001   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:25.756867   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0807 17:39:25.857637   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:26.257985   29086 kapi.go:107] duration metric: took 1m16.504408751s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0807 17:39:26.259730   29086 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-533488 cluster.

	I0807 17:39:26.260925   29086 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0807 17:39:26.262061   29086 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0807 17:39:26.357292   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:26.856034   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:27.357364   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:27.857380   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:28.207079   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:28.357344   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:29.082429   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:29.357264   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:29.857257   29086 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0807 17:39:30.213700   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:30.359072   29086 kapi.go:107] duration metric: took 1m23.508109455s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0807 17:39:30.361023   29086 out.go:177] * Enabled addons: ingress-dns, nvidia-device-plugin, metrics-server, storage-provisioner, helm-tiller, cloud-spanner, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I0807 17:39:30.362558   29086 addons.go:510] duration metric: took 1m33.201595301s for enable addons: enabled=[ingress-dns nvidia-device-plugin metrics-server storage-provisioner helm-tiller cloud-spanner inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I0807 17:39:32.707464   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:34.707562   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:36.708667   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:39.207122   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:41.208531   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:43.707717   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:45.709486   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:48.207305   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:50.208586   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:52.210364   29086 pod_ready.go:102] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"False"

	I0807 17:39:54.211980   29086 pod_ready.go:92] pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace has status "Ready":"True"

	I0807 17:39:54.212004   29086 pod_ready.go:81] duration metric: took 1m47.010818721s for pod "metrics-server-c59844bb4-tq82q" in "kube-system" namespace to be "Ready" ...

	I0807 17:39:54.212013   29086 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-7xdvc" in "kube-system" namespace to be "Ready" ...

	I0807 17:39:54.216281   29086 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-7xdvc" in "kube-system" namespace has status "Ready":"True"

	I0807 17:39:54.216301   29086 pod_ready.go:81] duration metric: took 4.280841ms for pod "nvidia-device-plugin-daemonset-7xdvc" in "kube-system" namespace to be "Ready" ...

	I0807 17:39:54.216326   29086 pod_ready.go:38] duration metric: took 1m48.199489718s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 17:39:54.216349   29086 api_server.go:52] waiting for apiserver process to appear ...

	I0807 17:39:54.216384   29086 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0807 17:39:54.216443   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0807 17:39:54.261565   29086 cri.go:89] found id: "507405bd1f474bb56c0969241df68bb550c529c15fe9df8f1709ecf07aa10162"

	I0807 17:39:54.261589   29086 cri.go:89] found id: ""

	I0807 17:39:54.261599   29086 logs.go:276] 1 containers: [507405bd1f474bb56c0969241df68bb550c529c15fe9df8f1709ecf07aa10162]

	I0807 17:39:54.261656   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:39:54.265910   29086 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0807 17:39:54.265974   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0807 17:39:54.305913   29086 cri.go:89] found id: "5149620cc13749dc34198a033be89b0463f819aaa175b650f81e0d8655818231"

	I0807 17:39:54.305939   29086 cri.go:89] found id: ""

	I0807 17:39:54.305948   29086 logs.go:276] 1 containers: [5149620cc13749dc34198a033be89b0463f819aaa175b650f81e0d8655818231]

	I0807 17:39:54.306009   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:39:54.310018   29086 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0807 17:39:54.310071   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0807 17:39:54.359999   29086 cri.go:89] found id: "f1f70a5b6a7bd09da5a2c01a1d9d3c7b71848bc75b8377d47e2c1ed5b8299263"

	I0807 17:39:54.360028   29086 cri.go:89] found id: ""

	I0807 17:39:54.360039   29086 logs.go:276] 1 containers: [f1f70a5b6a7bd09da5a2c01a1d9d3c7b71848bc75b8377d47e2c1ed5b8299263]

	I0807 17:39:54.360106   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:39:54.364380   29086 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0807 17:39:54.364443   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0807 17:39:54.401497   29086 cri.go:89] found id: "6e861f2e5e27fb937da023ac22e2772323e0f6d7577a3f615d215870f66b6e4f"

	I0807 17:39:54.401518   29086 cri.go:89] found id: ""

	I0807 17:39:54.401526   29086 logs.go:276] 1 containers: [6e861f2e5e27fb937da023ac22e2772323e0f6d7577a3f615d215870f66b6e4f]

	I0807 17:39:54.401568   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:39:54.405742   29086 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0807 17:39:54.405791   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0807 17:39:54.445263   29086 cri.go:89] found id: "f64277264b4abde694037ac51dd86a01f874641022121a58330e7f7061e614e2"

	I0807 17:39:54.445280   29086 cri.go:89] found id: ""

	I0807 17:39:54.445287   29086 logs.go:276] 1 containers: [f64277264b4abde694037ac51dd86a01f874641022121a58330e7f7061e614e2]

	I0807 17:39:54.445328   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:39:54.449365   29086 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0807 17:39:54.449413   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0807 17:39:54.492086   29086 cri.go:89] found id: "a22be6013db36e876083d12d7c640f4a7d50da13682e0523d84ce825d700a338"

	I0807 17:39:54.492108   29086 cri.go:89] found id: ""

	I0807 17:39:54.492116   29086 logs.go:276] 1 containers: [a22be6013db36e876083d12d7c640f4a7d50da13682e0523d84ce825d700a338]

	I0807 17:39:54.492171   29086 ssh_runner.go:195] Run: which crictl

	I0807 17:39:54.496562   29086 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0807 17:39:54.496619   29086 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0807 17:39:54.551052   29086 cri.go:89] found id: ""

	I0807 17:39:54.551077   29086 logs.go:276] 0 containers: []

	W0807 17:39:54.551087   29086 logs.go:278] No container was found matching "kindnet"

	I0807 17:39:54.551095   29086 logs.go:123] Gathering logs for kubelet ...

	I0807 17:39:54.551106   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W0807 17:39:54.602060   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:03 addons-533488 kubelet[1269]: W0807 17:38:03.279525    1269 reflector.go:547] object-"local-path-storage"/"local-path-config": failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.602292   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:03 addons-533488 kubelet[1269]: E0807 17:38:03.279651    1269 reflector.go:150] object-"local-path-storage"/"local-path-config": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.602438   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:03 addons-533488 kubelet[1269]: W0807 17:38:03.279759    1269 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.602596   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:03 addons-533488 kubelet[1269]: E0807 17:38:03.279786    1269 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.603874   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:03 addons-533488 kubelet[1269]: W0807 17:38:03.614477    1269 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.604030   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:03 addons-533488 kubelet[1269]: E0807 17:38:03.614531    1269 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.608659   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:05 addons-533488 kubelet[1269]: W0807 17:38:05.911019    1269 reflector.go:547] object-"ingress-nginx"/"ingress-nginx-admission": failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-533488" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.608857   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:05 addons-533488 kubelet[1269]: E0807 17:38:05.911069    1269 reflector.go:150] object-"ingress-nginx"/"ingress-nginx-admission": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "ingress-nginx-admission" is forbidden: User "system:node:addons-533488" cannot list resource "secrets" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.609055   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:05 addons-533488 kubelet[1269]: W0807 17:38:05.914496    1269 reflector.go:547] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.609216   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:05 addons-533488 kubelet[1269]: E0807 17:38:05.914538    1269 reflector.go:150] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-533488" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.616410   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:07 addons-533488 kubelet[1269]: W0807 17:38:07.804238    1269 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-533488" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-533488' and this object

	W0807 17:39:54.616565   29086 logs.go:138] Found kubelet problem: Aug 07 17:38:07 addons-533488 kubelet[1269]: E0807 17:38:07.804416    1269 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-533488" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-533488' and this object

	I0807 17:39:54.640492   29086 logs.go:123] Gathering logs for etcd [5149620cc13749dc34198a033be89b0463f819aaa175b650f81e0d8655818231] ...

	I0807 17:39:54.640523   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5149620cc13749dc34198a033be89b0463f819aaa175b650f81e0d8655818231"

	I0807 17:39:54.705422   29086 logs.go:123] Gathering logs for kube-scheduler [6e861f2e5e27fb937da023ac22e2772323e0f6d7577a3f615d215870f66b6e4f] ...

	I0807 17:39:54.705453   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e861f2e5e27fb937da023ac22e2772323e0f6d7577a3f615d215870f66b6e4f"

	I0807 17:39:54.756288   29086 logs.go:123] Gathering logs for kube-proxy [f64277264b4abde694037ac51dd86a01f874641022121a58330e7f7061e614e2] ...

	I0807 17:39:54.756321   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f64277264b4abde694037ac51dd86a01f874641022121a58330e7f7061e614e2"

	I0807 17:39:54.794271   29086 logs.go:123] Gathering logs for CRI-O ...

	I0807 17:39:54.794299   29086 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:112: out/minikube-linux-amd64 start -p addons-533488 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: signal: killed

--- FAIL: TestAddons/Setup (2400.07s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile

functional_test.go:408: (dbg) Run:  out/minikube-linux-amd64 -p functional-965692 image load /home/jenkins/workspace/KVM_Linux_crio_integration/echo-server-save.tar --alsologtostderr

functional_test.go:408: (dbg) Done: out/minikube-linux-amd64 -p functional-965692 image load /home/jenkins/workspace/KVM_Linux_crio_integration/echo-server-save.tar --alsologtostderr: (4.884076994s)

functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-965692 image ls

functional_test.go:447: (dbg) Done: out/minikube-linux-amd64 -p functional-965692 image ls: (2.341166042s)

functional_test.go:442: expected "docker.io/kicbase/echo-server:functional-965692" to be loaded into minikube but the image is not there

--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (7.23s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 node stop m02 -v=7 --alsologtostderr

E0807 18:34:14.922136   28052 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/functional-965692/client.crt: no such file or directory

ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.47707222s)

-- stdout --

	* Stopping node "ha-198246-m02"  ...

-- /stdout --

** stderr ** 

	I0807 18:33:41.488127   48662 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:33:41.488293   48662 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:33:41.488302   48662 out.go:304] Setting ErrFile to fd 2...

	I0807 18:33:41.488307   48662 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:33:41.488475   48662 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:33:41.488727   48662 mustload.go:65] Loading cluster: ha-198246

	I0807 18:33:41.489068   48662 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:33:41.489089   48662 stop.go:39] StopHost: ha-198246-m02

	I0807 18:33:41.489465   48662 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:33:41.489507   48662 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:33:41.506259   48662 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44093

	I0807 18:33:41.506693   48662 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:33:41.507343   48662 main.go:141] libmachine: Using API Version  1

	I0807 18:33:41.507369   48662 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:33:41.507709   48662 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:33:41.510381   48662 out.go:177] * Stopping node "ha-198246-m02"  ...

	I0807 18:33:41.511950   48662 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I0807 18:33:41.511996   48662 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:33:41.512275   48662 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I0807 18:33:41.512315   48662 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:33:41.515803   48662 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:33:41.516352   48662 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:33:41.516374   48662 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:33:41.516614   48662 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:33:41.516808   48662 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:33:41.516956   48662 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:33:41.517104   48662 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:33:41.600398   48662 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I0807 18:33:41.655537   48662 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I0807 18:33:41.711929   48662 main.go:141] libmachine: Stopping "ha-198246-m02"...

	I0807 18:33:41.711951   48662 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:33:41.713370   48662 main.go:141] libmachine: (ha-198246-m02) Calling .Stop

	I0807 18:33:41.716804   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 0/120

	I0807 18:33:42.718860   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 1/120

	I0807 18:33:43.720141   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 2/120

	I0807 18:33:44.721341   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 3/120

	I0807 18:33:45.722530   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 4/120

	I0807 18:33:46.724369   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 5/120

	I0807 18:33:47.726701   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 6/120

	I0807 18:33:48.728065   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 7/120

	I0807 18:33:49.729522   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 8/120

	I0807 18:33:50.731093   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 9/120

	I0807 18:33:51.733307   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 10/120

	I0807 18:33:52.734793   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 11/120

	I0807 18:33:53.736162   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 12/120

	I0807 18:33:54.737355   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 13/120

	I0807 18:33:55.738664   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 14/120

	I0807 18:33:56.740530   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 15/120

	I0807 18:33:57.741776   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 16/120

	I0807 18:33:58.743980   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 17/120

	I0807 18:33:59.745231   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 18/120

	I0807 18:34:00.746730   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 19/120

	I0807 18:34:01.749024   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 20/120

	I0807 18:34:02.750954   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 21/120

	I0807 18:34:03.752427   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 22/120

	I0807 18:34:04.754591   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 23/120

	I0807 18:34:05.757009   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 24/120

	I0807 18:34:06.758453   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 25/120

	I0807 18:34:07.760588   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 26/120

	I0807 18:34:08.762726   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 27/120

	I0807 18:34:09.764494   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 28/120

	I0807 18:34:10.766793   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 29/120

	I0807 18:34:11.769026   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 30/120

	I0807 18:34:12.770797   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 31/120

	I0807 18:34:13.772327   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 32/120

	I0807 18:34:14.773640   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 33/120

	I0807 18:34:15.775486   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 34/120

	I0807 18:34:16.777546   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 35/120

	I0807 18:34:17.778884   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 36/120

	I0807 18:34:18.780426   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 37/120

	I0807 18:34:19.781872   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 38/120

	I0807 18:34:20.783273   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 39/120

	I0807 18:34:21.785298   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 40/120

	I0807 18:34:22.787358   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 41/120

	I0807 18:34:23.788847   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 42/120

	I0807 18:34:24.790669   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 43/120

	I0807 18:34:25.792742   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 44/120

	I0807 18:34:26.794712   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 45/120

	I0807 18:34:27.796166   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 46/120

	I0807 18:34:28.797613   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 47/120

	I0807 18:34:29.799899   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 48/120

	I0807 18:34:30.801246   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 49/120

	I0807 18:34:31.802989   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 50/120

	I0807 18:34:32.804423   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 51/120

	I0807 18:34:33.805801   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 52/120

	I0807 18:34:34.807297   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 53/120

	I0807 18:34:35.808742   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 54/120

	I0807 18:34:36.810617   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 55/120

	I0807 18:34:37.812319   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 56/120

	I0807 18:34:38.813823   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 57/120

	I0807 18:34:39.816347   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 58/120

	I0807 18:34:40.818491   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 59/120

	I0807 18:34:41.820935   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 60/120

	I0807 18:34:42.822395   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 61/120

	I0807 18:34:43.823758   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 62/120

	I0807 18:34:44.825232   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 63/120

	I0807 18:34:45.826718   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 64/120

	I0807 18:34:46.828528   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 65/120

	I0807 18:34:47.830645   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 66/120

	I0807 18:34:48.832455   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 67/120

	I0807 18:34:49.834543   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 68/120

	I0807 18:34:50.835872   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 69/120

	I0807 18:34:51.837670   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 70/120

	I0807 18:34:52.839365   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 71/120

	I0807 18:34:53.840720   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 72/120

	I0807 18:34:54.842939   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 73/120

	I0807 18:34:55.844261   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 74/120

	I0807 18:34:56.846279   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 75/120

	I0807 18:34:57.847512   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 76/120

	I0807 18:34:58.848853   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 77/120

	I0807 18:34:59.850257   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 78/120

	I0807 18:35:00.851914   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 79/120

	I0807 18:35:01.854197   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 80/120

	I0807 18:35:02.855821   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 81/120

	I0807 18:35:03.857790   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 82/120

	I0807 18:35:04.859616   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 83/120

	I0807 18:35:05.861899   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 84/120

	I0807 18:35:06.863589   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 85/120

	I0807 18:35:07.864939   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 86/120

	I0807 18:35:08.866587   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 87/120

	I0807 18:35:09.868049   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 88/120

	I0807 18:35:10.869627   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 89/120

	I0807 18:35:11.871552   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 90/120

	I0807 18:35:12.873807   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 91/120

	I0807 18:35:13.875172   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 92/120

	I0807 18:35:14.876908   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 93/120

	I0807 18:35:15.878266   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 94/120

	I0807 18:35:16.880487   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 95/120

	I0807 18:35:17.881870   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 96/120

	I0807 18:35:18.884009   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 97/120

	I0807 18:35:19.885328   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 98/120

	I0807 18:35:20.886781   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 99/120

	I0807 18:35:21.888894   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 100/120

	I0807 18:35:22.890259   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 101/120

	I0807 18:35:23.891712   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 102/120

	I0807 18:35:24.893210   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 103/120

	I0807 18:35:25.894468   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 104/120

	I0807 18:35:26.896567   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 105/120

	I0807 18:35:27.897851   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 106/120

	I0807 18:35:28.899369   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 107/120

	I0807 18:35:29.900808   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 108/120

	I0807 18:35:30.902036   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 109/120

	I0807 18:35:31.904457   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 110/120

	I0807 18:35:32.905956   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 111/120

	I0807 18:35:33.907230   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 112/120

	I0807 18:35:34.908859   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 113/120

	I0807 18:35:35.910248   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 114/120

	I0807 18:35:36.912560   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 115/120

	I0807 18:35:37.914757   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 116/120

	I0807 18:35:38.916151   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 117/120

	I0807 18:35:39.917545   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 118/120

	I0807 18:35:40.919430   48662 main.go:141] libmachine: (ha-198246-m02) Waiting for machine to stop 119/120

	I0807 18:35:41.920880   48662 stop.go:66] stop err: unable to stop vm, current state "Running"

	W0807 18:35:41.921041   48662 out.go:239] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-198246 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:369: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (19.163089481s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:35:41.962973   49096 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:35:41.963131   49096 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:35:41.963212   49096 out.go:304] Setting ErrFile to fd 2...

	I0807 18:35:41.963228   49096 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:35:41.963516   49096 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:35:41.963749   49096 out.go:298] Setting JSON to false

	I0807 18:35:41.963777   49096 mustload.go:65] Loading cluster: ha-198246

	I0807 18:35:41.963871   49096 notify.go:220] Checking for updates...

	I0807 18:35:41.964341   49096 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:35:41.964362   49096 status.go:255] checking status of ha-198246 ...

	I0807 18:35:41.964920   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:35:41.965015   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:35:41.983762   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34677

	I0807 18:35:41.984245   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:35:41.984821   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:35:41.984852   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:35:41.985202   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:35:41.985395   49096 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:35:41.986984   49096 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:35:41.987001   49096 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:35:41.987305   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:35:41.987349   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:35:42.001674   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34585

	I0807 18:35:42.002067   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:35:42.002610   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:35:42.002645   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:35:42.002970   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:35:42.003168   49096 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:35:42.006065   49096 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:35:42.006568   49096 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:35:42.006600   49096 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:35:42.006790   49096 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:35:42.007188   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:35:42.007235   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:35:42.022832   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38517

	I0807 18:35:42.023221   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:35:42.023758   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:35:42.023782   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:35:42.024148   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:35:42.024352   49096 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:35:42.024568   49096 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:35:42.024599   49096 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:35:42.027646   49096 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:35:42.028062   49096 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:35:42.028106   49096 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:35:42.028301   49096 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:35:42.028464   49096 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:35:42.028604   49096 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:35:42.028700   49096 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:35:42.113693   49096 ssh_runner.go:195] Run: systemctl --version

	I0807 18:35:42.121037   49096 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:35:42.141105   49096 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:35:42.141134   49096 api_server.go:166] Checking apiserver status ...

	I0807 18:35:42.141169   49096 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:35:42.158172   49096 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:35:42.168904   49096 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:35:42.168970   49096 ssh_runner.go:195] Run: ls

	I0807 18:35:42.173940   49096 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:35:42.180605   49096 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:35:42.180631   49096 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:35:42.180641   49096 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:35:42.180656   49096 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:35:42.180942   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:35:42.180980   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:35:42.195950   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43675

	I0807 18:35:42.196348   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:35:42.196790   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:35:42.196812   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:35:42.197099   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:35:42.197290   49096 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:35:42.198700   49096 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:35:42.198714   49096 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:35:42.199009   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:35:42.199040   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:35:42.213417   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42009

	I0807 18:35:42.213855   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:35:42.214327   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:35:42.214344   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:35:42.214662   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:35:42.214889   49096 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:35:42.217607   49096 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:35:42.218030   49096 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:35:42.218056   49096 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:35:42.218177   49096 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:35:42.218596   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:35:42.218640   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:35:42.232822   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35563

	I0807 18:35:42.233210   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:35:42.233646   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:35:42.233670   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:35:42.234032   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:35:42.234236   49096 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:35:42.234450   49096 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:35:42.234472   49096 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:35:42.237381   49096 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:35:42.237875   49096 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:35:42.237898   49096 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:35:42.238012   49096 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:35:42.238186   49096 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:35:42.238331   49096 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:35:42.238442   49096 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:00.708469   49096 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:00.708577   49096 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:00.708597   49096 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:00.708608   49096 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:00.708657   49096 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:00.708669   49096 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:00.708995   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:00.709079   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:00.724115   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33069

	I0807 18:36:00.724547   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:00.725047   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:36:00.725068   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:00.725379   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:00.725560   49096 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:00.727288   49096 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:00.727302   49096 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:00.727595   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:00.727636   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:00.743542   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43221

	I0807 18:36:00.744066   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:00.744640   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:36:00.744660   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:00.745097   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:00.745348   49096 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:00.748850   49096 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:00.749268   49096 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:00.749289   49096 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:00.749473   49096 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:00.749864   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:00.749938   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:00.766508   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40075

	I0807 18:36:00.766895   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:00.767370   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:36:00.767395   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:00.767687   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:00.767934   49096 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:00.768128   49096 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:00.768157   49096 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:00.770885   49096 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:00.771261   49096 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:00.771297   49096 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:00.771437   49096 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:00.771589   49096 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:00.771776   49096 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:00.772010   49096 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:00.862315   49096 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:00.880148   49096 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:00.880174   49096 api_server.go:166] Checking apiserver status ...

	I0807 18:36:00.880221   49096 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:00.895258   49096 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:00.905460   49096 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:00.905519   49096 ssh_runner.go:195] Run: ls

	I0807 18:36:00.910411   49096 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:00.915518   49096 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:00.915541   49096 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:00.915548   49096 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:00.915564   49096 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:00.915900   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:00.915934   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:00.930775   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42733

	I0807 18:36:00.931302   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:00.931715   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:36:00.931735   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:00.932262   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:00.932485   49096 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:00.934070   49096 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:00.934086   49096 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:00.934481   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:00.934527   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:00.949391   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45619

	I0807 18:36:00.949809   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:00.950269   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:36:00.950294   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:00.950604   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:00.950784   49096 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:00.953712   49096 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:00.954168   49096 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:00.954204   49096 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:00.954300   49096 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:00.954594   49096 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:00.954642   49096 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:00.971056   49096 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41817

	I0807 18:36:00.971504   49096 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:00.971970   49096 main.go:141] libmachine: Using API Version  1

	I0807 18:36:00.971994   49096 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:00.972342   49096 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:00.972557   49096 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:00.972746   49096 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:00.972765   49096 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:00.975672   49096 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:00.976379   49096 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:00.976446   49096 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:00.976574   49096 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:00.976745   49096 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:00.976889   49096 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:00.977020   49096 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:01.066082   49096 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:01.083561   49096 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:372: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr" : exit status 3

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-198246 -n ha-198246

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-198246 logs -n 25: (1.53216351s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile4028937378/001/cp-test_ha-198246-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246:/home/docker/cp-test_ha-198246-m03_ha-198246.txt                       |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246 sudo cat                                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m03_ha-198246.txt                                 |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m02:/home/docker/cp-test_ha-198246-m03_ha-198246-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m02 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m03_ha-198246-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04:/home/docker/cp-test_ha-198246-m03_ha-198246-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m04 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m03_ha-198246-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-198246 cp testdata/cp-test.txt                                                | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile4028937378/001/cp-test_ha-198246-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246:/home/docker/cp-test_ha-198246-m04_ha-198246.txt                       |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246 sudo cat                                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m04_ha-198246.txt                                 |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m02:/home/docker/cp-test_ha-198246-m04_ha-198246-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m02 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m04_ha-198246-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03:/home/docker/cp-test_ha-198246-m04_ha-198246-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m03 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m04_ha-198246-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-198246 node stop m02 -v=7                                                     | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/07 18:27:21

	Running on machine: ubuntu-20-agent-10

	Binary: Built with gc go1.22.5 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0807 18:27:21.721727   44266 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:27:21.721967   44266 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:27:21.721975   44266 out.go:304] Setting ErrFile to fd 2...

	I0807 18:27:21.721979   44266 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:27:21.722152   44266 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:27:21.722687   44266 out.go:298] Setting JSON to false

	I0807 18:27:21.723512   44266 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":7788,"bootTime":1723047454,"procs":172,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0807 18:27:21.723565   44266 start.go:139] virtualization: kvm guest

	I0807 18:27:21.725729   44266 out.go:177] * [ha-198246] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0807 18:27:21.727183   44266 notify.go:220] Checking for updates...

	I0807 18:27:21.727193   44266 out.go:177]   - MINIKUBE_LOCATION=19389

	I0807 18:27:21.728548   44266 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0807 18:27:21.729974   44266 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:27:21.731326   44266 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:27:21.732576   44266 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0807 18:27:21.733798   44266 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0807 18:27:21.735342   44266 driver.go:392] Setting default libvirt URI to qemu:///system

	I0807 18:27:21.769737   44266 out.go:177] * Using the kvm2 driver based on user configuration

	I0807 18:27:21.771127   44266 start.go:297] selected driver: kvm2

	I0807 18:27:21.771144   44266 start.go:901] validating driver "kvm2" against <nil>

	I0807 18:27:21.771156   44266 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0807 18:27:21.771870   44266 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0807 18:27:21.771942   44266 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19389-20864/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0807 18:27:21.786733   44266 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0807 18:27:21.786777   44266 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0807 18:27:21.786970   44266 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 18:27:21.787023   44266 cni.go:84] Creating CNI manager for ""

	I0807 18:27:21.787034   44266 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0807 18:27:21.787041   44266 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0807 18:27:21.787097   44266 start.go:340] cluster config:

	{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0807 18:27:21.787200   44266 iso.go:125] acquiring lock: {Name:mkf212fcb23c5f8609a2c03b42fcca30ca8c42d1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0807 18:27:21.789527   44266 out.go:177] * Starting "ha-198246" primary control-plane node in "ha-198246" cluster

	I0807 18:27:21.790581   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:27:21.790607   44266 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4

	I0807 18:27:21.790615   44266 cache.go:56] Caching tarball of preloaded images

	I0807 18:27:21.790695   44266 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 18:27:21.790708   44266 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 18:27:21.790995   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:27:21.791015   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json: {Name:mk9ea4fdb45a0ad19fddd77d9e86e860b1888943 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:21.791157   44266 start.go:360] acquireMachinesLock for ha-198246: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 18:27:21.791197   44266 start.go:364] duration metric: took 17.005µs to acquireMachinesLock for "ha-198246"

	I0807 18:27:21.791219   44266 start.go:93] Provisioning new machine with config: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:27:21.791271   44266 start.go:125] createHost starting for "" (driver="kvm2")

	I0807 18:27:21.792742   44266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0807 18:27:21.792862   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:27:21.792923   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:27:21.806899   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38255

	I0807 18:27:21.807336   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:27:21.807888   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:27:21.807907   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:27:21.808260   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:27:21.808450   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:21.808588   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:21.808718   44266 start.go:159] libmachine.API.Create for "ha-198246" (driver="kvm2")

	I0807 18:27:21.808749   44266 client.go:168] LocalClient.Create starting

	I0807 18:27:21.808783   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 18:27:21.808815   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:27:21.808831   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:27:21.808893   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 18:27:21.808911   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:27:21.808924   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:27:21.808938   44266 main.go:141] libmachine: Running pre-create checks...

	I0807 18:27:21.808951   44266 main.go:141] libmachine: (ha-198246) Calling .PreCreateCheck

	I0807 18:27:21.809303   44266 main.go:141] libmachine: (ha-198246) Calling .GetConfigRaw

	I0807 18:27:21.809632   44266 main.go:141] libmachine: Creating machine...

	I0807 18:27:21.809644   44266 main.go:141] libmachine: (ha-198246) Calling .Create

	I0807 18:27:21.809775   44266 main.go:141] libmachine: (ha-198246) Creating KVM machine...

	I0807 18:27:21.810961   44266 main.go:141] libmachine: (ha-198246) DBG | found existing default KVM network

	I0807 18:27:21.811595   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:21.811462   44289 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1e0}

	I0807 18:27:21.811613   44266 main.go:141] libmachine: (ha-198246) DBG | created network xml: 

	I0807 18:27:21.811622   44266 main.go:141] libmachine: (ha-198246) DBG | <network>

	I0807 18:27:21.811630   44266 main.go:141] libmachine: (ha-198246) DBG |   <name>mk-ha-198246</name>

	I0807 18:27:21.811643   44266 main.go:141] libmachine: (ha-198246) DBG |   <dns enable='no'/>

	I0807 18:27:21.811649   44266 main.go:141] libmachine: (ha-198246) DBG |   

	I0807 18:27:21.811659   44266 main.go:141] libmachine: (ha-198246) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0807 18:27:21.811669   44266 main.go:141] libmachine: (ha-198246) DBG |     <dhcp>

	I0807 18:27:21.811682   44266 main.go:141] libmachine: (ha-198246) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0807 18:27:21.811690   44266 main.go:141] libmachine: (ha-198246) DBG |     </dhcp>

	I0807 18:27:21.811695   44266 main.go:141] libmachine: (ha-198246) DBG |   </ip>

	I0807 18:27:21.811700   44266 main.go:141] libmachine: (ha-198246) DBG |   

	I0807 18:27:21.811723   44266 main.go:141] libmachine: (ha-198246) DBG | </network>

	I0807 18:27:21.811744   44266 main.go:141] libmachine: (ha-198246) DBG | 

	I0807 18:27:21.816727   44266 main.go:141] libmachine: (ha-198246) DBG | trying to create private KVM network mk-ha-198246 192.168.39.0/24...

	I0807 18:27:21.878767   44266 main.go:141] libmachine: (ha-198246) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246 ...

	I0807 18:27:21.878803   44266 main.go:141] libmachine: (ha-198246) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 18:27:21.878813   44266 main.go:141] libmachine: (ha-198246) DBG | private KVM network mk-ha-198246 192.168.39.0/24 created

	I0807 18:27:21.878832   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:21.878720   44289 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:27:21.878874   44266 main.go:141] libmachine: (ha-198246) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 18:27:22.116138   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:22.116028   44289 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa...

	I0807 18:27:22.201603   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:22.201499   44289 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/ha-198246.rawdisk...

	I0807 18:27:22.201635   44266 main.go:141] libmachine: (ha-198246) DBG | Writing magic tar header

	I0807 18:27:22.201649   44266 main.go:141] libmachine: (ha-198246) DBG | Writing SSH key tar header

	I0807 18:27:22.201665   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:22.201611   44289 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246 ...

	I0807 18:27:22.201729   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246

	I0807 18:27:22.201753   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246 (perms=drwx------)

	I0807 18:27:22.201760   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 18:27:22.201769   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:27:22.201775   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 18:27:22.201784   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 18:27:22.201812   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins

	I0807 18:27:22.201832   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home

	I0807 18:27:22.201841   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 18:27:22.201848   44266 main.go:141] libmachine: (ha-198246) DBG | Skipping /home - not owner

	I0807 18:27:22.201885   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 18:27:22.201909   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 18:27:22.201940   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 18:27:22.201958   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 18:27:22.201972   44266 main.go:141] libmachine: (ha-198246) Creating domain...

	I0807 18:27:22.202738   44266 main.go:141] libmachine: (ha-198246) define libvirt domain using xml: 

	I0807 18:27:22.202751   44266 main.go:141] libmachine: (ha-198246) <domain type='kvm'>

	I0807 18:27:22.202774   44266 main.go:141] libmachine: (ha-198246)   <name>ha-198246</name>

	I0807 18:27:22.202794   44266 main.go:141] libmachine: (ha-198246)   <memory unit='MiB'>2200</memory>

	I0807 18:27:22.202803   44266 main.go:141] libmachine: (ha-198246)   <vcpu>2</vcpu>

	I0807 18:27:22.202808   44266 main.go:141] libmachine: (ha-198246)   <features>

	I0807 18:27:22.202813   44266 main.go:141] libmachine: (ha-198246)     <acpi/>

	I0807 18:27:22.202817   44266 main.go:141] libmachine: (ha-198246)     <apic/>

	I0807 18:27:22.202822   44266 main.go:141] libmachine: (ha-198246)     <pae/>

	I0807 18:27:22.202827   44266 main.go:141] libmachine: (ha-198246)     

	I0807 18:27:22.202831   44266 main.go:141] libmachine: (ha-198246)   </features>

	I0807 18:27:22.202835   44266 main.go:141] libmachine: (ha-198246)   <cpu mode='host-passthrough'>

	I0807 18:27:22.202840   44266 main.go:141] libmachine: (ha-198246)   

	I0807 18:27:22.202844   44266 main.go:141] libmachine: (ha-198246)   </cpu>

	I0807 18:27:22.202848   44266 main.go:141] libmachine: (ha-198246)   <os>

	I0807 18:27:22.202852   44266 main.go:141] libmachine: (ha-198246)     <type>hvm</type>

	I0807 18:27:22.202857   44266 main.go:141] libmachine: (ha-198246)     <boot dev='cdrom'/>

	I0807 18:27:22.202864   44266 main.go:141] libmachine: (ha-198246)     <boot dev='hd'/>

	I0807 18:27:22.202878   44266 main.go:141] libmachine: (ha-198246)     <bootmenu enable='no'/>

	I0807 18:27:22.202882   44266 main.go:141] libmachine: (ha-198246)   </os>

	I0807 18:27:22.202898   44266 main.go:141] libmachine: (ha-198246)   <devices>

	I0807 18:27:22.202906   44266 main.go:141] libmachine: (ha-198246)     <disk type='file' device='cdrom'>

	I0807 18:27:22.202934   44266 main.go:141] libmachine: (ha-198246)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/boot2docker.iso'/>

	I0807 18:27:22.202951   44266 main.go:141] libmachine: (ha-198246)       <target dev='hdc' bus='scsi'/>

	I0807 18:27:22.202961   44266 main.go:141] libmachine: (ha-198246)       <readonly/>

	I0807 18:27:22.202972   44266 main.go:141] libmachine: (ha-198246)     </disk>

	I0807 18:27:22.202982   44266 main.go:141] libmachine: (ha-198246)     <disk type='file' device='disk'>

	I0807 18:27:22.202994   44266 main.go:141] libmachine: (ha-198246)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 18:27:22.203006   44266 main.go:141] libmachine: (ha-198246)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/ha-198246.rawdisk'/>

	I0807 18:27:22.203017   44266 main.go:141] libmachine: (ha-198246)       <target dev='hda' bus='virtio'/>

	I0807 18:27:22.203025   44266 main.go:141] libmachine: (ha-198246)     </disk>

	I0807 18:27:22.203039   44266 main.go:141] libmachine: (ha-198246)     <interface type='network'>

	I0807 18:27:22.203047   44266 main.go:141] libmachine: (ha-198246)       <source network='mk-ha-198246'/>

	I0807 18:27:22.203055   44266 main.go:141] libmachine: (ha-198246)       <model type='virtio'/>

	I0807 18:27:22.203066   44266 main.go:141] libmachine: (ha-198246)     </interface>

	I0807 18:27:22.203074   44266 main.go:141] libmachine: (ha-198246)     <interface type='network'>

	I0807 18:27:22.203086   44266 main.go:141] libmachine: (ha-198246)       <source network='default'/>

	I0807 18:27:22.203094   44266 main.go:141] libmachine: (ha-198246)       <model type='virtio'/>

	I0807 18:27:22.203103   44266 main.go:141] libmachine: (ha-198246)     </interface>

	I0807 18:27:22.203110   44266 main.go:141] libmachine: (ha-198246)     <serial type='pty'>

	I0807 18:27:22.203121   44266 main.go:141] libmachine: (ha-198246)       <target port='0'/>

	I0807 18:27:22.203127   44266 main.go:141] libmachine: (ha-198246)     </serial>

	I0807 18:27:22.203154   44266 main.go:141] libmachine: (ha-198246)     <console type='pty'>

	I0807 18:27:22.203178   44266 main.go:141] libmachine: (ha-198246)       <target type='serial' port='0'/>

	I0807 18:27:22.203188   44266 main.go:141] libmachine: (ha-198246)     </console>

	I0807 18:27:22.203200   44266 main.go:141] libmachine: (ha-198246)     <rng model='virtio'>

	I0807 18:27:22.203214   44266 main.go:141] libmachine: (ha-198246)       <backend model='random'>/dev/random</backend>

	I0807 18:27:22.203229   44266 main.go:141] libmachine: (ha-198246)     </rng>

	I0807 18:27:22.203239   44266 main.go:141] libmachine: (ha-198246)     

	I0807 18:27:22.203243   44266 main.go:141] libmachine: (ha-198246)     

	I0807 18:27:22.203251   44266 main.go:141] libmachine: (ha-198246)   </devices>

	I0807 18:27:22.203258   44266 main.go:141] libmachine: (ha-198246) </domain>

	I0807 18:27:22.203271   44266 main.go:141] libmachine: (ha-198246) 

	I0807 18:27:22.207680   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:90:2f:e2 in network default

	I0807 18:27:22.208187   44266 main.go:141] libmachine: (ha-198246) Ensuring networks are active...

	I0807 18:27:22.208224   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:22.208779   44266 main.go:141] libmachine: (ha-198246) Ensuring network default is active

	I0807 18:27:22.209008   44266 main.go:141] libmachine: (ha-198246) Ensuring network mk-ha-198246 is active

	I0807 18:27:22.209409   44266 main.go:141] libmachine: (ha-198246) Getting domain xml...

	I0807 18:27:22.209962   44266 main.go:141] libmachine: (ha-198246) Creating domain...

	I0807 18:27:23.404405   44266 main.go:141] libmachine: (ha-198246) Waiting to get IP...

	I0807 18:27:23.405206   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:23.405600   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:23.405641   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:23.405567   44289 retry.go:31] will retry after 306.958712ms: waiting for machine to come up

	I0807 18:27:23.713982   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:23.714499   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:23.714526   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:23.714462   44289 retry.go:31] will retry after 299.119708ms: waiting for machine to come up

	I0807 18:27:24.014947   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:24.015426   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:24.015446   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:24.015393   44289 retry.go:31] will retry after 384.564278ms: waiting for machine to come up

	I0807 18:27:24.402079   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:24.402483   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:24.402507   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:24.402453   44289 retry.go:31] will retry after 547.85343ms: waiting for machine to come up

	I0807 18:27:24.952336   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:24.952783   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:24.952809   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:24.952724   44289 retry.go:31] will retry after 591.886125ms: waiting for machine to come up

	I0807 18:27:25.546536   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:25.546960   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:25.546987   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:25.546919   44289 retry.go:31] will retry after 637.639818ms: waiting for machine to come up

	I0807 18:27:26.185754   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:26.186206   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:26.186253   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:26.186171   44289 retry.go:31] will retry after 1.07415852s: waiting for machine to come up

	I0807 18:27:27.261894   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:27.262328   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:27.262357   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:27.262273   44289 retry.go:31] will retry after 1.388616006s: waiting for machine to come up

	I0807 18:27:28.652877   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:28.653287   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:28.653318   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:28.653222   44289 retry.go:31] will retry after 1.163215795s: waiting for machine to come up

	I0807 18:27:29.818449   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:29.818914   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:29.818948   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:29.818858   44289 retry.go:31] will retry after 2.029996828s: waiting for machine to come up

	I0807 18:27:31.849800   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:31.850166   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:31.850195   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:31.850108   44289 retry.go:31] will retry after 1.806326332s: waiting for machine to come up

	I0807 18:27:33.659132   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:33.659739   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:33.659768   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:33.659685   44289 retry.go:31] will retry after 3.239044606s: waiting for machine to come up

	I0807 18:27:36.900422   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:36.900792   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:36.900819   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:36.900742   44289 retry.go:31] will retry after 3.037723315s: waiting for machine to come up

	I0807 18:27:39.941930   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:39.942412   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:39.942441   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:39.942337   44289 retry.go:31] will retry after 5.1268659s: waiting for machine to come up

	I0807 18:27:45.074427   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:45.074880   44266 main.go:141] libmachine: (ha-198246) Found IP for machine: 192.168.39.196

	I0807 18:27:45.074901   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has current primary IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:45.074909   44266 main.go:141] libmachine: (ha-198246) Reserving static IP address...

	I0807 18:27:45.075244   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find host DHCP lease matching {name: "ha-198246", mac: "52:54:00:b0:88:98", ip: "192.168.39.196"} in network mk-ha-198246

	I0807 18:27:45.145259   44266 main.go:141] libmachine: (ha-198246) DBG | Getting to WaitForSSH function...

	I0807 18:27:45.145285   44266 main.go:141] libmachine: (ha-198246) Reserved static IP address: 192.168.39.196

	I0807 18:27:45.145343   44266 main.go:141] libmachine: (ha-198246) Waiting for SSH to be available...

	I0807 18:27:45.147843   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:45.148233   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246

	I0807 18:27:45.148255   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find defined IP address of network mk-ha-198246 interface with MAC address 52:54:00:b0:88:98

	I0807 18:27:45.148474   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH client type: external

	I0807 18:27:45.148506   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa (-rw-------)

	I0807 18:27:45.148558   44266 main.go:141] libmachine: (ha-198246) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:27:45.148578   44266 main.go:141] libmachine: (ha-198246) DBG | About to run SSH command:

	I0807 18:27:45.148592   44266 main.go:141] libmachine: (ha-198246) DBG | exit 0

	I0807 18:27:45.152274   44266 main.go:141] libmachine: (ha-198246) DBG | SSH cmd err, output: exit status 255: 

	I0807 18:27:45.152292   44266 main.go:141] libmachine: (ha-198246) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0807 18:27:45.152299   44266 main.go:141] libmachine: (ha-198246) DBG | command : exit 0

	I0807 18:27:45.152304   44266 main.go:141] libmachine: (ha-198246) DBG | err     : exit status 255

	I0807 18:27:45.152312   44266 main.go:141] libmachine: (ha-198246) DBG | output  : 

	I0807 18:27:48.153047   44266 main.go:141] libmachine: (ha-198246) DBG | Getting to WaitForSSH function...

	I0807 18:27:48.155522   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.155912   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.155936   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.156105   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH client type: external

	I0807 18:27:48.156130   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa (-rw-------)

	I0807 18:27:48.156167   44266 main.go:141] libmachine: (ha-198246) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.196 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:27:48.156191   44266 main.go:141] libmachine: (ha-198246) DBG | About to run SSH command:

	I0807 18:27:48.156225   44266 main.go:141] libmachine: (ha-198246) DBG | exit 0

	I0807 18:27:48.280381   44266 main.go:141] libmachine: (ha-198246) DBG | SSH cmd err, output: <nil>: 

	I0807 18:27:48.280692   44266 main.go:141] libmachine: (ha-198246) KVM machine creation complete!

	I0807 18:27:48.281058   44266 main.go:141] libmachine: (ha-198246) Calling .GetConfigRaw

	I0807 18:27:48.281656   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:48.281875   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:48.282036   44266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 18:27:48.282050   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:27:48.283345   44266 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 18:27:48.283363   44266 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 18:27:48.283372   44266 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 18:27:48.283379   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.286023   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.286450   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.286469   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.286618   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.286773   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.286910   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.287021   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.287206   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.287379   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.287389   44266 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 18:27:48.387621   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:27:48.387645   44266 main.go:141] libmachine: Detecting the provisioner...

	I0807 18:27:48.387655   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.390612   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.391010   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.391041   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.391226   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.391498   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.391674   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.391801   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.392003   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.392181   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.392195   44266 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 18:27:48.492889   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 18:27:48.492963   44266 main.go:141] libmachine: found compatible host: buildroot

	I0807 18:27:48.492969   44266 main.go:141] libmachine: Provisioning with buildroot...

	I0807 18:27:48.492976   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:48.493236   44266 buildroot.go:166] provisioning hostname "ha-198246"

	I0807 18:27:48.493263   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:48.493468   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.496265   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.496578   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.496602   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.496742   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.496924   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.497076   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.497274   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.497500   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.497677   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.497689   44266 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-198246 && echo "ha-198246" | sudo tee /etc/hostname

	I0807 18:27:48.615801   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-198246

	I0807 18:27:48.615855   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.618925   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.619286   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.619315   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.619478   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.619662   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.619808   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.619965   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.620141   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.620341   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.620359   44266 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-198246' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-198246/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-198246' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 18:27:48.729682   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:27:48.729740   44266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 18:27:48.729770   44266 buildroot.go:174] setting up certificates

	I0807 18:27:48.729789   44266 provision.go:84] configureAuth start

	I0807 18:27:48.729808   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:48.730094   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:48.732947   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.733289   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.733317   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.733475   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.735604   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.735911   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.735935   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.736091   44266 provision.go:143] copyHostCerts

	I0807 18:27:48.736118   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:27:48.736160   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem, removing ...

	I0807 18:27:48.736174   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:27:48.736261   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 18:27:48.736361   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:27:48.736380   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem, removing ...

	I0807 18:27:48.736386   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:27:48.736428   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 18:27:48.736530   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:27:48.736553   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem, removing ...

	I0807 18:27:48.736560   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:27:48.736583   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 18:27:48.736657   44266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.ha-198246 san=[127.0.0.1 192.168.39.196 ha-198246 localhost minikube]

	I0807 18:27:48.961157   44266 provision.go:177] copyRemoteCerts

	I0807 18:27:48.961215   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 18:27:48.961238   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.964265   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.964661   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.964697   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.964961   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.965206   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.965427   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.965581   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.047016   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0807 18:27:49.047096   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 18:27:49.071078   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0807 18:27:49.071152   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0807 18:27:49.095496   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0807 18:27:49.095566   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0807 18:27:49.120006   44266 provision.go:87] duration metric: took 390.201413ms to configureAuth

	I0807 18:27:49.120032   44266 buildroot.go:189] setting minikube options for container-runtime

	I0807 18:27:49.120250   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:27:49.120330   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.122781   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.123123   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.123148   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.123319   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.123504   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.123653   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.123754   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.123923   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:49.124077   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:49.124093   44266 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 18:27:49.379427   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 18:27:49.379449   44266 main.go:141] libmachine: Checking connection to Docker...

	I0807 18:27:49.379457   44266 main.go:141] libmachine: (ha-198246) Calling .GetURL

	I0807 18:27:49.381160   44266 main.go:141] libmachine: (ha-198246) DBG | Using libvirt version 6000000

	I0807 18:27:49.383505   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.383829   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.383861   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.384032   44266 main.go:141] libmachine: Docker is up and running!

	I0807 18:27:49.384051   44266 main.go:141] libmachine: Reticulating splines...

	I0807 18:27:49.384060   44266 client.go:171] duration metric: took 27.57529956s to LocalClient.Create

	I0807 18:27:49.384091   44266 start.go:167] duration metric: took 27.575373855s to libmachine.API.Create "ha-198246"

	I0807 18:27:49.384103   44266 start.go:293] postStartSetup for "ha-198246" (driver="kvm2")

	I0807 18:27:49.384117   44266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 18:27:49.384137   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.384384   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 18:27:49.384406   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.387011   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.387377   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.387400   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.387601   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.387778   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.387917   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.388019   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.467416   44266 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 18:27:49.471819   44266 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 18:27:49.471844   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 18:27:49.471913   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 18:27:49.471996   44266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> 280522.pem in /etc/ssl/certs

	I0807 18:27:49.472007   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /etc/ssl/certs/280522.pem

	I0807 18:27:49.472100   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0807 18:27:49.482472   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:27:49.507293   44266 start.go:296] duration metric: took 123.178167ms for postStartSetup

	I0807 18:27:49.507345   44266 main.go:141] libmachine: (ha-198246) Calling .GetConfigRaw

	I0807 18:27:49.507928   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:49.510575   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.511008   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.511039   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.511346   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:27:49.511529   44266 start.go:128] duration metric: took 27.720249653s to createHost

	I0807 18:27:49.511551   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.513835   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.514239   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.514268   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.514412   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.514597   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.514751   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.514864   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.515031   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:49.515233   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:49.515246   44266 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0807 18:27:49.621198   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723055269.601266320

	I0807 18:27:49.621228   44266 fix.go:216] guest clock: 1723055269.601266320

	I0807 18:27:49.621239   44266 fix.go:229] Guest: 2024-08-07 18:27:49.60126632 +0000 UTC Remote: 2024-08-07 18:27:49.511541014 +0000 UTC m=+27.822561678 (delta=89.725306ms)

	I0807 18:27:49.621348   44266 fix.go:200] guest clock delta is within tolerance: 89.725306ms

	I0807 18:27:49.621358   44266 start.go:83] releasing machines lock for "ha-198246", held for 27.830148378s

	I0807 18:27:49.621384   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.621648   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:49.624076   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.624475   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.624506   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.624646   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.625094   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.625251   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.625329   44266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 18:27:49.625368   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.625433   44266 ssh_runner.go:195] Run: cat /version.json

	I0807 18:27:49.625456   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.628179   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628428   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628489   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.628513   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628653   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.628845   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.628875   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.628902   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628989   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.629163   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.629174   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.629309   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.629489   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.629653   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.707121   44266 ssh_runner.go:195] Run: systemctl --version

	I0807 18:27:49.730199   44266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 18:27:49.894353   44266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 18:27:49.901460   44266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 18:27:49.901532   44266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 18:27:49.918470   44266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 18:27:49.918496   44266 start.go:495] detecting cgroup driver to use...

	I0807 18:27:49.918550   44266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 18:27:49.935346   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 18:27:49.950325   44266 docker.go:217] disabling cri-docker service (if available) ...

	I0807 18:27:49.950373   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 18:27:49.965026   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 18:27:49.979393   44266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 18:27:50.101391   44266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 18:27:50.266571   44266 docker.go:233] disabling docker service ...

	I0807 18:27:50.266633   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 18:27:50.280886   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 18:27:50.293687   44266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 18:27:50.411890   44266 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 18:27:50.531647   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 18:27:50.545917   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 18:27:50.565503   44266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 18:27:50.565564   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.577648   44266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 18:27:50.577727   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.589717   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.601142   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.612276   44266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 18:27:50.623423   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.634380   44266 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.652648   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.664994   44266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 18:27:50.675990   44266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 18:27:50.676071   44266 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 18:27:50.690790   44266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 18:27:50.702376   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:27:50.836087   44266 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 18:27:50.977071   44266 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 18:27:50.977144   44266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 18:27:50.982362   44266 start.go:563] Will wait 60s for crictl version

	I0807 18:27:50.982434   44266 ssh_runner.go:195] Run: which crictl

	I0807 18:27:50.986273   44266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 18:27:51.023888   44266 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 18:27:51.023993   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:27:51.051884   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:27:51.082665   44266 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 18:27:51.083804   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:51.086499   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:51.086829   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:51.086855   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:51.087080   44266 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 18:27:51.091372   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:27:51.104446   44266 kubeadm.go:883] updating cluster {Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cl

usterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0807 18:27:51.104537   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:27:51.104583   44266 ssh_runner.go:195] Run: sudo crictl images --output json

	I0807 18:27:51.135506   44266 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.3". assuming images are not preloaded.

	I0807 18:27:51.135568   44266 ssh_runner.go:195] Run: which lz4

	I0807 18:27:51.140129   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0807 18:27:51.140252   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0807 18:27:51.144801   44266 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0807 18:27:51.144833   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (406200976 bytes)

	I0807 18:27:52.554895   44266 crio.go:462] duration metric: took 1.414692613s to copy over tarball

	I0807 18:27:52.555019   44266 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0807 18:27:54.702005   44266 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.146953106s)

	I0807 18:27:54.702032   44266 crio.go:469] duration metric: took 2.147109225s to extract the tarball

	I0807 18:27:54.702041   44266 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0807 18:27:54.740000   44266 ssh_runner.go:195] Run: sudo crictl images --output json

	I0807 18:27:54.786797   44266 crio.go:514] all images are preloaded for cri-o runtime.

	I0807 18:27:54.786816   44266 cache_images.go:84] Images are preloaded, skipping loading

	I0807 18:27:54.786825   44266 kubeadm.go:934] updating node { 192.168.39.196 8443 v1.30.3 crio true true} ...

	I0807 18:27:54.786956   44266 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-198246 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.196

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 18:27:54.787033   44266 ssh_runner.go:195] Run: crio config

	I0807 18:27:54.830632   44266 cni.go:84] Creating CNI manager for ""

	I0807 18:27:54.830659   44266 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0807 18:27:54.830671   44266 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0807 18:27:54.830691   44266 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.196 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-198246 NodeName:ha-198246 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.196"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.196 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0807 18:27:54.830808   44266 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.196

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-198246"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.196

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.196"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0807 18:27:54.830828   44266 kube-vip.go:115] generating kube-vip config ...

	I0807 18:27:54.830867   44266 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0807 18:27:54.849054   44266 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0807 18:27:54.849165   44266 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0807 18:27:54.849229   44266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 18:27:54.859040   44266 binaries.go:44] Found k8s binaries, skipping transfer

	I0807 18:27:54.859110   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0807 18:27:54.868475   44266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0807 18:27:54.885744   44266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 18:27:54.902712   44266 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0807 18:27:54.919755   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0807 18:27:54.936740   44266 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0807 18:27:54.940938   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:27:54.953525   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:27:55.078749   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:27:55.097378   44266 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246 for IP: 192.168.39.196

	I0807 18:27:55.097404   44266 certs.go:194] generating shared ca certs ...

	I0807 18:27:55.097422   44266 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.097635   44266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 18:27:55.097699   44266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 18:27:55.097714   44266 certs.go:256] generating profile certs ...

	I0807 18:27:55.097787   44266 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key

	I0807 18:27:55.097814   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt with IP's: []

	I0807 18:27:55.208693   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt ...

	I0807 18:27:55.208724   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt: {Name:mka7fa8cfb74ff61110b7cfa5be9a6c01adb62d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.208915   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key ...

	I0807 18:27:55.208929   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key: {Name:mk2f8f0495ba491dab5e08ca790f78097bcc62bb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.209031   44266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4

	I0807 18:27:55.209049   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.196 192.168.39.254]

	I0807 18:27:55.624285   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4 ...

	I0807 18:27:55.624314   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4: {Name:mkd68d7f250c70cd5fa8d28ad5bc1bbe0c86a654 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.624461   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4 ...

	I0807 18:27:55.624473   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4: {Name:mkff3833d02b04ce9c36a734c937e13f709f80e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.624542   44266 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt

	I0807 18:27:55.624619   44266 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key

	I0807 18:27:55.624669   44266 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key

	I0807 18:27:55.624697   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt with IP's: []

	I0807 18:27:55.759073   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt ...

	I0807 18:27:55.759102   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt: {Name:mkb3499dae347a7cfa9dfc4b50cfa2f9ee673ecb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.759241   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key ...

	I0807 18:27:55.759251   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key: {Name:mk07d2a285004089dd73e71e881ed70e932c4b60 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.759316   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0807 18:27:55.759333   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0807 18:27:55.759346   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0807 18:27:55.759360   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0807 18:27:55.759372   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0807 18:27:55.759384   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0807 18:27:55.759400   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0807 18:27:55.759412   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0807 18:27:55.759461   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem (1338 bytes)

	W0807 18:27:55.759494   44266 certs.go:480] ignoring /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052_empty.pem, impossibly tiny 0 bytes

	I0807 18:27:55.759504   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 18:27:55.759526   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 18:27:55.759550   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 18:27:55.759571   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 18:27:55.759608   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:27:55.759632   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:55.759646   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem -> /usr/share/ca-certificates/28052.pem

	I0807 18:27:55.759658   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /usr/share/ca-certificates/280522.pem

	I0807 18:27:55.760218   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 18:27:55.787520   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 18:27:55.815044   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 18:27:55.840056   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 18:27:55.867094   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0807 18:27:55.897468   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0807 18:27:55.954340   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 18:27:55.987648   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 18:27:56.013314   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 18:27:56.039452   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem --> /usr/share/ca-certificates/28052.pem (1338 bytes)

	I0807 18:27:56.065754   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /usr/share/ca-certificates/280522.pem (1708 bytes)

	I0807 18:27:56.091942   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0807 18:27:56.111135   44266 ssh_runner.go:195] Run: openssl version

	I0807 18:27:56.117304   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 18:27:56.128689   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:56.133805   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:56.133860   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:56.140551   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 18:27:56.152253   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/28052.pem && ln -fs /usr/share/ca-certificates/28052.pem /etc/ssl/certs/28052.pem"

	I0807 18:27:56.164005   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/28052.pem

	I0807 18:27:56.169124   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  7 18:17 /usr/share/ca-certificates/28052.pem

	I0807 18:27:56.169182   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/28052.pem

	I0807 18:27:56.175462   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/28052.pem /etc/ssl/certs/51391683.0"

	I0807 18:27:56.187518   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/280522.pem && ln -fs /usr/share/ca-certificates/280522.pem /etc/ssl/certs/280522.pem"

	I0807 18:27:56.201710   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/280522.pem

	I0807 18:27:56.206624   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  7 18:17 /usr/share/ca-certificates/280522.pem

	I0807 18:27:56.206673   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/280522.pem

	I0807 18:27:56.212905   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/280522.pem /etc/ssl/certs/3ec20f2e.0"

	I0807 18:27:56.224505   44266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 18:27:56.229013   44266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 18:27:56.229063   44266 kubeadm.go:392] StartCluster: {Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Clust

erName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 18:27:56.229135   44266 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0807 18:27:56.229186   44266 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0807 18:27:56.270696   44266 cri.go:89] found id: ""

	I0807 18:27:56.270773   44266 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0807 18:27:56.281401   44266 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0807 18:27:56.291997   44266 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0807 18:27:56.302725   44266 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0807 18:27:56.302745   44266 kubeadm.go:157] found existing configuration files:

	I0807 18:27:56.302792   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0807 18:27:56.312979   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0807 18:27:56.313046   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0807 18:27:56.323033   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0807 18:27:56.332468   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0807 18:27:56.332514   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0807 18:27:56.342420   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0807 18:27:56.351963   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0807 18:27:56.352032   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0807 18:27:56.361913   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0807 18:27:56.371591   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0807 18:27:56.371657   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0807 18:27:56.381281   44266 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0807 18:27:56.488327   44266 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3

	I0807 18:27:56.488440   44266 kubeadm.go:310] [preflight] Running pre-flight checks

	I0807 18:27:56.624126   44266 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0807 18:27:56.624281   44266 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0807 18:27:56.624494   44266 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0807 18:27:56.873034   44266 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0807 18:27:56.990825   44266 out.go:204]   - Generating certificates and keys ...

	I0807 18:27:56.990959   44266 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0807 18:27:56.991052   44266 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0807 18:27:57.066929   44266 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0807 18:27:57.283110   44266 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0807 18:27:57.486271   44266 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0807 18:27:57.678831   44266 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0807 18:27:57.750579   44266 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0807 18:27:57.750810   44266 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-198246 localhost] and IPs [192.168.39.196 127.0.0.1 ::1]

	I0807 18:27:58.190149   44266 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0807 18:27:58.190378   44266 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-198246 localhost] and IPs [192.168.39.196 127.0.0.1 ::1]

	I0807 18:27:58.450761   44266 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0807 18:27:58.618895   44266 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0807 18:27:58.844633   44266 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0807 18:27:58.844738   44266 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0807 18:27:58.940356   44266 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0807 18:27:59.154431   44266 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0807 18:27:59.281640   44266 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0807 18:27:59.360167   44266 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0807 18:27:59.439806   44266 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0807 18:27:59.440368   44266 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0807 18:27:59.443581   44266 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0807 18:27:59.445418   44266 out.go:204]   - Booting up control plane ...

	I0807 18:27:59.445508   44266 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0807 18:27:59.446192   44266 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0807 18:27:59.446957   44266 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0807 18:27:59.461414   44266 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0807 18:27:59.462292   44266 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0807 18:27:59.462339   44266 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0807 18:27:59.600411   44266 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0807 18:27:59.600545   44266 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0807 18:28:00.099690   44266 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.352376ms

	I0807 18:28:00.099804   44266 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0807 18:28:05.959621   44266 kubeadm.go:310] [api-check] The API server is healthy after 5.862299271s

	I0807 18:28:05.975846   44266 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0807 18:28:06.014624   44266 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0807 18:28:06.042297   44266 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0807 18:28:06.042535   44266 kubeadm.go:310] [mark-control-plane] Marking the node ha-198246 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0807 18:28:06.057030   44266 kubeadm.go:310] [bootstrap-token] Using token: acde14.b8y6evu3gygtakpe

	I0807 18:28:06.058575   44266 out.go:204]   - Configuring RBAC rules ...

	I0807 18:28:06.058714   44266 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0807 18:28:06.066217   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0807 18:28:06.080020   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0807 18:28:06.087791   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0807 18:28:06.092681   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0807 18:28:06.096020   44266 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0807 18:28:06.374616   44266 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0807 18:28:06.820636   44266 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0807 18:28:07.370115   44266 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0807 18:28:07.370141   44266 kubeadm.go:310] 

	I0807 18:28:07.370203   44266 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0807 18:28:07.370211   44266 kubeadm.go:310] 

	I0807 18:28:07.370295   44266 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0807 18:28:07.370303   44266 kubeadm.go:310] 

	I0807 18:28:07.370345   44266 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0807 18:28:07.370425   44266 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0807 18:28:07.370496   44266 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0807 18:28:07.370506   44266 kubeadm.go:310] 

	I0807 18:28:07.370578   44266 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0807 18:28:07.370587   44266 kubeadm.go:310] 

	I0807 18:28:07.370652   44266 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0807 18:28:07.370661   44266 kubeadm.go:310] 

	I0807 18:28:07.370747   44266 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0807 18:28:07.370856   44266 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0807 18:28:07.370953   44266 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0807 18:28:07.370964   44266 kubeadm.go:310] 

	I0807 18:28:07.371074   44266 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0807 18:28:07.371188   44266 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0807 18:28:07.371231   44266 kubeadm.go:310] 

	I0807 18:28:07.371348   44266 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token acde14.b8y6evu3gygtakpe \

	I0807 18:28:07.371521   44266 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 \

	I0807 18:28:07.371563   44266 kubeadm.go:310] 	--control-plane 

	I0807 18:28:07.371570   44266 kubeadm.go:310] 

	I0807 18:28:07.371677   44266 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0807 18:28:07.371685   44266 kubeadm.go:310] 

	I0807 18:28:07.371782   44266 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token acde14.b8y6evu3gygtakpe \

	I0807 18:28:07.371920   44266 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 

	I0807 18:28:07.372287   44266 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0807 18:28:07.372313   44266 cni.go:84] Creating CNI manager for ""

	I0807 18:28:07.372321   44266 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0807 18:28:07.374314   44266 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0807 18:28:07.375747   44266 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0807 18:28:07.381422   44266 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...

	I0807 18:28:07.381440   44266 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0807 18:28:07.402202   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0807 18:28:07.779600   44266 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0807 18:28:07.779665   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:07.779684   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-198246 minikube.k8s.io/updated_at=2024_08_07T18_28_07_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=ha-198246 minikube.k8s.io/primary=true

	I0807 18:28:07.798602   44266 ops.go:34] apiserver oom_adj: -16

	I0807 18:28:08.016757   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:08.517348   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:09.017382   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:09.516834   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:10.017237   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:10.517025   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:11.017393   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:11.517645   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:12.017006   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:12.517242   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:13.017450   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:13.517301   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:14.017420   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:14.517520   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:15.016948   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:15.517754   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:16.016906   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:16.517576   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:17.017692   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:17.517425   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:18.017663   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:18.517834   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:19.017814   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:19.516956   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:20.017249   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:20.516839   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:20.593055   44266 kubeadm.go:1113] duration metric: took 12.81344917s to wait for elevateKubeSystemPrivileges

	I0807 18:28:20.593093   44266 kubeadm.go:394] duration metric: took 24.364034512s to StartCluster

	I0807 18:28:20.593114   44266 settings.go:142] acquiring lock: {Name:mke44792daf8192c7cb4430e19df00c0686edd5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:20.593205   44266 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:28:20.593898   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/kubeconfig: {Name:mk9a4ad53bf4447453626a7769211592f39f92fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:20.594131   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0807 18:28:20.594146   44266 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0807 18:28:20.594202   44266 addons.go:69] Setting storage-provisioner=true in profile "ha-198246"

	I0807 18:28:20.594127   44266 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:28:20.594240   44266 start.go:241] waiting for startup goroutines ...

	I0807 18:28:20.594244   44266 addons.go:234] Setting addon storage-provisioner=true in "ha-198246"

	I0807 18:28:20.594253   44266 addons.go:69] Setting default-storageclass=true in profile "ha-198246"

	I0807 18:28:20.594272   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:28:20.594281   44266 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-198246"

	I0807 18:28:20.594338   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:20.594625   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.594626   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.594650   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.594656   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.609354   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36055

	I0807 18:28:20.609414   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38699

	I0807 18:28:20.609790   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.609862   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.610266   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.610283   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.610389   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.610410   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.610618   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.610723   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.610793   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:20.611217   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.611247   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.612810   44266 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:28:20.613017   44266 kapi.go:59] client config for ha-198246: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt", KeyFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key", CAFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02a80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0807 18:28:20.613524   44266 addons.go:234] Setting addon default-storageclass=true in "ha-198246"

	I0807 18:28:20.613554   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:28:20.613774   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.613789   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.613921   44266 cert_rotation.go:137] Starting client certificate rotation controller

	I0807 18:28:20.626271   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46075

	I0807 18:28:20.626822   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.627365   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.627390   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.627663   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.627835   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:20.628446   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42551

	I0807 18:28:20.628810   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.629360   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.629383   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.629588   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:28:20.629689   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.630104   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.630142   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.631750   44266 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0807 18:28:20.633155   44266 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0807 18:28:20.633177   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0807 18:28:20.633196   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:28:20.636123   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.636542   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:28:20.636568   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.636689   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:28:20.636880   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:28:20.637013   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:28:20.637127   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:28:20.646444   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38675

	I0807 18:28:20.646903   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.647381   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.647407   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.647701   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.647869   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:20.649389   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:28:20.649621   44266 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0807 18:28:20.649639   44266 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0807 18:28:20.649655   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:28:20.652497   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.652927   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:28:20.652955   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.653107   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:28:20.653303   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:28:20.653475   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:28:20.653622   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:28:20.708691   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0807 18:28:20.771288   44266 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0807 18:28:20.803911   44266 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0807 18:28:21.019837   44266 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0807 18:28:21.230253   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230275   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.230346   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230366   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.230561   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.230578   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.230586   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230594   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.230677   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.230683   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.230695   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.230703   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230710   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.232188   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.232193   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.232228   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.232229   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.232250   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.232250   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.232412   44266 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0807 18:28:21.232423   44266 round_trippers.go:469] Request Headers:

	I0807 18:28:21.232433   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:28:21.232442   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:28:21.244939   44266 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I0807 18:28:21.245737   44266 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0807 18:28:21.245758   44266 round_trippers.go:469] Request Headers:

	I0807 18:28:21.245768   44266 round_trippers.go:473]     Content-Type: application/json

	I0807 18:28:21.245779   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:28:21.245784   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:28:21.248031   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:28:21.248194   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.248228   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.248571   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.248579   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.248602   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.251329   44266 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0807 18:28:21.252717   44266 addons.go:510] duration metric: took 658.567856ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0807 18:28:21.252752   44266 start.go:246] waiting for cluster config update ...

	I0807 18:28:21.252766   44266 start.go:255] writing updated cluster config ...

	I0807 18:28:21.254496   44266 out.go:177] 

	I0807 18:28:21.255798   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:21.255869   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:28:21.257396   44266 out.go:177] * Starting "ha-198246-m02" control-plane node in "ha-198246" cluster

	I0807 18:28:21.258544   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:28:21.258563   44266 cache.go:56] Caching tarball of preloaded images

	I0807 18:28:21.258651   44266 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 18:28:21.258666   44266 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 18:28:21.258740   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:28:21.258909   44266 start.go:360] acquireMachinesLock for ha-198246-m02: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 18:28:21.258952   44266 start.go:364] duration metric: took 24.011µs to acquireMachinesLock for "ha-198246-m02"

	I0807 18:28:21.258975   44266 start.go:93] Provisioning new machine with config: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:28:21.259059   44266 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0807 18:28:21.260585   44266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0807 18:28:21.260664   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:21.260685   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:21.274940   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34303

	I0807 18:28:21.275393   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:21.275883   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:21.275912   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:21.276238   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:21.276417   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:21.276559   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:21.276724   44266 start.go:159] libmachine.API.Create for "ha-198246" (driver="kvm2")

	I0807 18:28:21.276747   44266 client.go:168] LocalClient.Create starting

	I0807 18:28:21.276782   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 18:28:21.276821   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:28:21.276844   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:28:21.276909   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 18:28:21.276934   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:28:21.276948   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:28:21.276978   44266 main.go:141] libmachine: Running pre-create checks...

	I0807 18:28:21.276990   44266 main.go:141] libmachine: (ha-198246-m02) Calling .PreCreateCheck

	I0807 18:28:21.277160   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetConfigRaw

	I0807 18:28:21.277503   44266 main.go:141] libmachine: Creating machine...

	I0807 18:28:21.277517   44266 main.go:141] libmachine: (ha-198246-m02) Calling .Create

	I0807 18:28:21.277664   44266 main.go:141] libmachine: (ha-198246-m02) Creating KVM machine...

	I0807 18:28:21.278838   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found existing default KVM network

	I0807 18:28:21.278997   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found existing private KVM network mk-ha-198246

	I0807 18:28:21.279157   44266 main.go:141] libmachine: (ha-198246-m02) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02 ...

	I0807 18:28:21.279196   44266 main.go:141] libmachine: (ha-198246-m02) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 18:28:21.279252   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.279170   44685 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:28:21.279333   44266 main.go:141] libmachine: (ha-198246-m02) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 18:28:21.511603   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.511453   44685 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa...

	I0807 18:28:21.728136   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.727998   44685 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/ha-198246-m02.rawdisk...

	I0807 18:28:21.728162   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Writing magic tar header

	I0807 18:28:21.728173   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Writing SSH key tar header

	I0807 18:28:21.728181   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.728108   44685 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02 ...

	I0807 18:28:21.728242   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02

	I0807 18:28:21.728271   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02 (perms=drwx------)

	I0807 18:28:21.728290   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 18:28:21.728311   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:28:21.728325   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 18:28:21.728339   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 18:28:21.728355   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 18:28:21.728367   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 18:28:21.728379   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins

	I0807 18:28:21.728394   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home

	I0807 18:28:21.728405   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Skipping /home - not owner

	I0807 18:28:21.728422   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 18:28:21.728437   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 18:28:21.728467   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 18:28:21.728487   44266 main.go:141] libmachine: (ha-198246-m02) Creating domain...

	I0807 18:28:21.729349   44266 main.go:141] libmachine: (ha-198246-m02) define libvirt domain using xml: 

	I0807 18:28:21.729400   44266 main.go:141] libmachine: (ha-198246-m02) <domain type='kvm'>

	I0807 18:28:21.729415   44266 main.go:141] libmachine: (ha-198246-m02)   <name>ha-198246-m02</name>

	I0807 18:28:21.729428   44266 main.go:141] libmachine: (ha-198246-m02)   <memory unit='MiB'>2200</memory>

	I0807 18:28:21.729439   44266 main.go:141] libmachine: (ha-198246-m02)   <vcpu>2</vcpu>

	I0807 18:28:21.729455   44266 main.go:141] libmachine: (ha-198246-m02)   <features>

	I0807 18:28:21.729466   44266 main.go:141] libmachine: (ha-198246-m02)     <acpi/>

	I0807 18:28:21.729474   44266 main.go:141] libmachine: (ha-198246-m02)     <apic/>

	I0807 18:28:21.729486   44266 main.go:141] libmachine: (ha-198246-m02)     <pae/>

	I0807 18:28:21.729493   44266 main.go:141] libmachine: (ha-198246-m02)     

	I0807 18:28:21.729502   44266 main.go:141] libmachine: (ha-198246-m02)   </features>

	I0807 18:28:21.729510   44266 main.go:141] libmachine: (ha-198246-m02)   <cpu mode='host-passthrough'>

	I0807 18:28:21.729518   44266 main.go:141] libmachine: (ha-198246-m02)   

	I0807 18:28:21.729530   44266 main.go:141] libmachine: (ha-198246-m02)   </cpu>

	I0807 18:28:21.729541   44266 main.go:141] libmachine: (ha-198246-m02)   <os>

	I0807 18:28:21.729550   44266 main.go:141] libmachine: (ha-198246-m02)     <type>hvm</type>

	I0807 18:28:21.729563   44266 main.go:141] libmachine: (ha-198246-m02)     <boot dev='cdrom'/>

	I0807 18:28:21.729574   44266 main.go:141] libmachine: (ha-198246-m02)     <boot dev='hd'/>

	I0807 18:28:21.729587   44266 main.go:141] libmachine: (ha-198246-m02)     <bootmenu enable='no'/>

	I0807 18:28:21.729597   44266 main.go:141] libmachine: (ha-198246-m02)   </os>

	I0807 18:28:21.729627   44266 main.go:141] libmachine: (ha-198246-m02)   <devices>

	I0807 18:28:21.729665   44266 main.go:141] libmachine: (ha-198246-m02)     <disk type='file' device='cdrom'>

	I0807 18:28:21.729686   44266 main.go:141] libmachine: (ha-198246-m02)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/boot2docker.iso'/>

	I0807 18:28:21.729699   44266 main.go:141] libmachine: (ha-198246-m02)       <target dev='hdc' bus='scsi'/>

	I0807 18:28:21.729711   44266 main.go:141] libmachine: (ha-198246-m02)       <readonly/>

	I0807 18:28:21.729721   44266 main.go:141] libmachine: (ha-198246-m02)     </disk>

	I0807 18:28:21.729734   44266 main.go:141] libmachine: (ha-198246-m02)     <disk type='file' device='disk'>

	I0807 18:28:21.729748   44266 main.go:141] libmachine: (ha-198246-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 18:28:21.729765   44266 main.go:141] libmachine: (ha-198246-m02)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/ha-198246-m02.rawdisk'/>

	I0807 18:28:21.729773   44266 main.go:141] libmachine: (ha-198246-m02)       <target dev='hda' bus='virtio'/>

	I0807 18:28:21.729781   44266 main.go:141] libmachine: (ha-198246-m02)     </disk>

	I0807 18:28:21.729789   44266 main.go:141] libmachine: (ha-198246-m02)     <interface type='network'>

	I0807 18:28:21.729799   44266 main.go:141] libmachine: (ha-198246-m02)       <source network='mk-ha-198246'/>

	I0807 18:28:21.729807   44266 main.go:141] libmachine: (ha-198246-m02)       <model type='virtio'/>

	I0807 18:28:21.729816   44266 main.go:141] libmachine: (ha-198246-m02)     </interface>

	I0807 18:28:21.729832   44266 main.go:141] libmachine: (ha-198246-m02)     <interface type='network'>

	I0807 18:28:21.729845   44266 main.go:141] libmachine: (ha-198246-m02)       <source network='default'/>

	I0807 18:28:21.729856   44266 main.go:141] libmachine: (ha-198246-m02)       <model type='virtio'/>

	I0807 18:28:21.729868   44266 main.go:141] libmachine: (ha-198246-m02)     </interface>

	I0807 18:28:21.729875   44266 main.go:141] libmachine: (ha-198246-m02)     <serial type='pty'>

	I0807 18:28:21.729887   44266 main.go:141] libmachine: (ha-198246-m02)       <target port='0'/>

	I0807 18:28:21.729895   44266 main.go:141] libmachine: (ha-198246-m02)     </serial>

	I0807 18:28:21.729923   44266 main.go:141] libmachine: (ha-198246-m02)     <console type='pty'>

	I0807 18:28:21.729945   44266 main.go:141] libmachine: (ha-198246-m02)       <target type='serial' port='0'/>

	I0807 18:28:21.729956   44266 main.go:141] libmachine: (ha-198246-m02)     </console>

	I0807 18:28:21.729961   44266 main.go:141] libmachine: (ha-198246-m02)     <rng model='virtio'>

	I0807 18:28:21.729976   44266 main.go:141] libmachine: (ha-198246-m02)       <backend model='random'>/dev/random</backend>

	I0807 18:28:21.729987   44266 main.go:141] libmachine: (ha-198246-m02)     </rng>

	I0807 18:28:21.729995   44266 main.go:141] libmachine: (ha-198246-m02)     

	I0807 18:28:21.730002   44266 main.go:141] libmachine: (ha-198246-m02)     

	I0807 18:28:21.730010   44266 main.go:141] libmachine: (ha-198246-m02)   </devices>

	I0807 18:28:21.730016   44266 main.go:141] libmachine: (ha-198246-m02) </domain>

	I0807 18:28:21.730025   44266 main.go:141] libmachine: (ha-198246-m02) 

	I0807 18:28:21.736803   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:b2:15:7e in network default

	I0807 18:28:21.737390   44266 main.go:141] libmachine: (ha-198246-m02) Ensuring networks are active...

	I0807 18:28:21.737416   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:21.738108   44266 main.go:141] libmachine: (ha-198246-m02) Ensuring network default is active

	I0807 18:28:21.738450   44266 main.go:141] libmachine: (ha-198246-m02) Ensuring network mk-ha-198246 is active

	I0807 18:28:21.738836   44266 main.go:141] libmachine: (ha-198246-m02) Getting domain xml...

	I0807 18:28:21.739511   44266 main.go:141] libmachine: (ha-198246-m02) Creating domain...

	I0807 18:28:22.980593   44266 main.go:141] libmachine: (ha-198246-m02) Waiting to get IP...

	I0807 18:28:22.981319   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:22.981653   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:22.981678   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:22.981626   44685 retry.go:31] will retry after 277.857687ms: waiting for machine to come up

	I0807 18:28:23.261356   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:23.261928   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:23.261955   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:23.261836   44685 retry.go:31] will retry after 296.896309ms: waiting for machine to come up

	I0807 18:28:23.560474   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:23.560953   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:23.560974   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:23.560905   44685 retry.go:31] will retry after 431.200025ms: waiting for machine to come up

	I0807 18:28:23.993408   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:23.993831   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:23.993860   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:23.993783   44685 retry.go:31] will retry after 489.747622ms: waiting for machine to come up

	I0807 18:28:24.485553   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:24.486096   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:24.486118   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:24.486038   44685 retry.go:31] will retry after 595.37365ms: waiting for machine to come up

	I0807 18:28:25.082858   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:25.083273   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:25.083297   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:25.083229   44685 retry.go:31] will retry after 864.817898ms: waiting for machine to come up

	I0807 18:28:25.949301   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:25.949755   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:25.949787   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:25.949705   44685 retry.go:31] will retry after 980.056682ms: waiting for machine to come up

	I0807 18:28:26.931211   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:26.931633   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:26.931667   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:26.931574   44685 retry.go:31] will retry after 1.374312311s: waiting for machine to come up

	I0807 18:28:28.308159   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:28.308539   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:28.308588   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:28.308503   44685 retry.go:31] will retry after 1.32565444s: waiting for machine to come up

	I0807 18:28:29.635739   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:29.636210   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:29.636236   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:29.636128   44685 retry.go:31] will retry after 2.094612533s: waiting for machine to come up

	I0807 18:28:31.731860   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:31.732338   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:31.732366   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:31.732297   44685 retry.go:31] will retry after 2.384083205s: waiting for machine to come up

	I0807 18:28:34.117344   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:34.117765   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:34.117789   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:34.117726   44685 retry.go:31] will retry after 3.244651745s: waiting for machine to come up

	I0807 18:28:37.364060   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:37.364496   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:37.364524   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:37.364456   44685 retry.go:31] will retry after 3.883256435s: waiting for machine to come up

	I0807 18:28:41.249166   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.249651   44266 main.go:141] libmachine: (ha-198246-m02) Found IP for machine: 192.168.39.251

	I0807 18:28:41.249682   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has current primary IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.249838   44266 main.go:141] libmachine: (ha-198246-m02) Reserving static IP address...

	I0807 18:28:41.250128   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find host DHCP lease matching {name: "ha-198246-m02", mac: "52:54:00:c8:91:fc", ip: "192.168.39.251"} in network mk-ha-198246

	I0807 18:28:41.326471   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Getting to WaitForSSH function...

	I0807 18:28:41.326495   44266 main.go:141] libmachine: (ha-198246-m02) Reserved static IP address: 192.168.39.251

	I0807 18:28:41.326537   44266 main.go:141] libmachine: (ha-198246-m02) Waiting for SSH to be available...

	I0807 18:28:41.329224   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.329503   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.329528   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.329675   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Using SSH client type: external

	I0807 18:28:41.329699   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa (-rw-------)

	I0807 18:28:41.329726   44266 main.go:141] libmachine: (ha-198246-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.251 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:28:41.329738   44266 main.go:141] libmachine: (ha-198246-m02) DBG | About to run SSH command:

	I0807 18:28:41.329752   44266 main.go:141] libmachine: (ha-198246-m02) DBG | exit 0

	I0807 18:28:41.456688   44266 main.go:141] libmachine: (ha-198246-m02) DBG | SSH cmd err, output: <nil>: 

	I0807 18:28:41.457054   44266 main.go:141] libmachine: (ha-198246-m02) KVM machine creation complete!

	I0807 18:28:41.457342   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetConfigRaw

	I0807 18:28:41.457876   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:41.458082   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:41.458245   44266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 18:28:41.458260   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:28:41.459550   44266 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 18:28:41.459565   44266 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 18:28:41.459572   44266 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 18:28:41.459578   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.461855   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.462198   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.462225   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.462361   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.462552   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.462697   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.462811   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.463068   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.463266   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.463277   44266 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 18:28:41.563789   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:28:41.563815   44266 main.go:141] libmachine: Detecting the provisioner...

	I0807 18:28:41.563825   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.566883   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.567241   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.567263   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.567445   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.567660   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.567837   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.567975   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.568253   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.568452   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.568470   44266 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 18:28:41.669364   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 18:28:41.669425   44266 main.go:141] libmachine: found compatible host: buildroot

	I0807 18:28:41.669432   44266 main.go:141] libmachine: Provisioning with buildroot...

	I0807 18:28:41.669440   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:41.669653   44266 buildroot.go:166] provisioning hostname "ha-198246-m02"

	I0807 18:28:41.669679   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:41.669860   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.672464   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.672770   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.672793   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.672942   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.673104   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.673265   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.673412   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.673627   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.673943   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.673966   44266 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-198246-m02 && echo "ha-198246-m02" | sudo tee /etc/hostname

	I0807 18:28:41.792440   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-198246-m02

	I0807 18:28:41.792466   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.795604   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.795966   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.795984   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.796230   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.796424   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.796595   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.796740   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.796885   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.797037   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.797053   44266 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-198246-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-198246-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-198246-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 18:28:41.906596   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:28:41.906633   44266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 18:28:41.906652   44266 buildroot.go:174] setting up certificates

	I0807 18:28:41.906662   44266 provision.go:84] configureAuth start

	I0807 18:28:41.906670   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:41.906995   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:41.909871   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.910201   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.910258   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.910405   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.912630   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.912923   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.912952   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.913098   44266 provision.go:143] copyHostCerts

	I0807 18:28:41.913133   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:28:41.913171   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem, removing ...

	I0807 18:28:41.913181   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:28:41.913262   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 18:28:41.913348   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:28:41.913371   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem, removing ...

	I0807 18:28:41.913380   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:28:41.913419   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 18:28:41.913479   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:28:41.913502   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem, removing ...

	I0807 18:28:41.913510   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:28:41.913543   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 18:28:41.913607   44266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.ha-198246-m02 san=[127.0.0.1 192.168.39.251 ha-198246-m02 localhost minikube]

	I0807 18:28:42.029415   44266 provision.go:177] copyRemoteCerts

	I0807 18:28:42.029466   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 18:28:42.029488   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.031816   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.032108   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.032134   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.032373   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.032590   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.032761   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.032906   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.115186   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0807 18:28:42.115248   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0807 18:28:42.139771   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0807 18:28:42.139888   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0807 18:28:42.166463   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0807 18:28:42.166547   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 18:28:42.191360   44266 provision.go:87] duration metric: took 284.686105ms to configureAuth

	I0807 18:28:42.191394   44266 buildroot.go:189] setting minikube options for container-runtime

	I0807 18:28:42.191575   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:42.191639   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.194385   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.194831   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.194853   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.195191   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.195376   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.195544   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.195680   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.195895   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:42.196044   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:42.196058   44266 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 18:28:42.467289   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 18:28:42.467319   44266 main.go:141] libmachine: Checking connection to Docker...

	I0807 18:28:42.467328   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetURL

	I0807 18:28:42.468563   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Using libvirt version 6000000

	I0807 18:28:42.470865   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.471205   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.471243   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.471411   44266 main.go:141] libmachine: Docker is up and running!

	I0807 18:28:42.471434   44266 main.go:141] libmachine: Reticulating splines...

	I0807 18:28:42.471451   44266 client.go:171] duration metric: took 21.19468682s to LocalClient.Create

	I0807 18:28:42.471481   44266 start.go:167] duration metric: took 21.194756451s to libmachine.API.Create "ha-198246"

	I0807 18:28:42.471493   44266 start.go:293] postStartSetup for "ha-198246-m02" (driver="kvm2")

	I0807 18:28:42.471507   44266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 18:28:42.471534   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.471773   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 18:28:42.471806   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.474080   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.474413   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.474433   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.474545   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.474739   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.474895   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.475097   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.560490   44266 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 18:28:42.565161   44266 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 18:28:42.565195   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 18:28:42.565275   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 18:28:42.565387   44266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> 280522.pem in /etc/ssl/certs

	I0807 18:28:42.565402   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /etc/ssl/certs/280522.pem

	I0807 18:28:42.565531   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0807 18:28:42.576441   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:28:42.601887   44266 start.go:296] duration metric: took 130.379831ms for postStartSetup

	I0807 18:28:42.601945   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetConfigRaw

	I0807 18:28:42.602524   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:42.605525   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.605930   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.605957   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.606232   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:28:42.606422   44266 start.go:128] duration metric: took 21.347355066s to createHost

	I0807 18:28:42.606445   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.608659   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.609011   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.609037   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.609154   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.609339   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.609509   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.609670   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.609881   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:42.610037   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:42.610048   44266 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0807 18:28:42.712453   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723055322.681885034

	I0807 18:28:42.712476   44266 fix.go:216] guest clock: 1723055322.681885034

	I0807 18:28:42.712486   44266 fix.go:229] Guest: 2024-08-07 18:28:42.681885034 +0000 UTC Remote: 2024-08-07 18:28:42.606435256 +0000 UTC m=+80.917455918 (delta=75.449778ms)

	I0807 18:28:42.712505   44266 fix.go:200] guest clock delta is within tolerance: 75.449778ms

	I0807 18:28:42.712511   44266 start.go:83] releasing machines lock for "ha-198246-m02", held for 21.453548489s

	I0807 18:28:42.712528   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.712799   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:42.715436   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.715971   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.716003   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.718499   44266 out.go:177] * Found network options:

	I0807 18:28:42.719912   44266 out.go:177]   - NO_PROXY=192.168.39.196

	W0807 18:28:42.721156   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:28:42.721186   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.721776   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.721994   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.722091   44266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 18:28:42.722129   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	W0807 18:28:42.722390   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:28:42.722461   44266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 18:28:42.722484   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.724944   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725052   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725311   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.725352   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725460   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.725478   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.725500   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725609   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.725652   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.725814   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.725827   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.725956   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.725974   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.726095   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.958805   44266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 18:28:42.964806   44266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 18:28:42.964894   44266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 18:28:42.981388   44266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 18:28:42.981416   44266 start.go:495] detecting cgroup driver to use...

	I0807 18:28:42.981488   44266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 18:28:42.997458   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 18:28:43.012016   44266 docker.go:217] disabling cri-docker service (if available) ...

	I0807 18:28:43.012089   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 18:28:43.025912   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 18:28:43.039739   44266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 18:28:43.155400   44266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 18:28:43.303225   44266 docker.go:233] disabling docker service ...

	I0807 18:28:43.303286   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 18:28:43.318739   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 18:28:43.332532   44266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 18:28:43.472596   44266 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 18:28:43.605966   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 18:28:43.619925   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 18:28:43.638588   44266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 18:28:43.638650   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.649283   44266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 18:28:43.649357   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.659951   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.670486   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.680962   44266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 18:28:43.691796   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.702576   44266 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.720080   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.730366   44266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 18:28:43.739403   44266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 18:28:43.739465   44266 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 18:28:43.752984   44266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 18:28:43.764481   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:28:43.897332   44266 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 18:28:44.051283   44266 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 18:28:44.051350   44266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 18:28:44.056138   44266 start.go:563] Will wait 60s for crictl version

	I0807 18:28:44.056186   44266 ssh_runner.go:195] Run: which crictl

	I0807 18:28:44.060100   44266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 18:28:44.107041   44266 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 18:28:44.107160   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:28:44.136233   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:28:44.172438   44266 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 18:28:44.174040   44266 out.go:177]   - env NO_PROXY=192.168.39.196

	I0807 18:28:44.175421   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:44.178934   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:44.179638   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:44.179664   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:44.179936   44266 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 18:28:44.184425   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:28:44.197404   44266 mustload.go:65] Loading cluster: ha-198246

	I0807 18:28:44.197592   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:44.197871   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:44.197898   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:44.212129   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33201

	I0807 18:28:44.212590   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:44.213046   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:44.213066   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:44.213444   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:44.213618   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:44.215209   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:28:44.215490   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:44.215512   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:44.229524   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34027

	I0807 18:28:44.229880   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:44.230343   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:44.230365   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:44.230754   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:44.230920   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:28:44.231062   44266 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246 for IP: 192.168.39.251

	I0807 18:28:44.231075   44266 certs.go:194] generating shared ca certs ...

	I0807 18:28:44.231089   44266 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:44.231203   44266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 18:28:44.231239   44266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 18:28:44.231248   44266 certs.go:256] generating profile certs ...

	I0807 18:28:44.231307   44266 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key

	I0807 18:28:44.231330   44266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680

	I0807 18:28:44.231342   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.196 192.168.39.251 192.168.39.254]

	I0807 18:28:44.559979   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680 ...

	I0807 18:28:44.560015   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680: {Name:mk532d2b707d0b4ff2030a049398865e8e454aaa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:44.560219   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680 ...

	I0807 18:28:44.560234   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680: {Name:mkd4bd0dec009d42e6ef356f3ddf31b6cb75091b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:44.560311   44266 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt

	I0807 18:28:44.560448   44266 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key

	I0807 18:28:44.560582   44266 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key

	I0807 18:28:44.560598   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0807 18:28:44.560612   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0807 18:28:44.560628   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0807 18:28:44.560643   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0807 18:28:44.560658   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0807 18:28:44.560672   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0807 18:28:44.560687   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0807 18:28:44.560701   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0807 18:28:44.560749   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem (1338 bytes)

	W0807 18:28:44.560780   44266 certs.go:480] ignoring /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052_empty.pem, impossibly tiny 0 bytes

	I0807 18:28:44.560791   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 18:28:44.560824   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 18:28:44.560849   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 18:28:44.560873   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 18:28:44.560916   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:28:44.560944   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem -> /usr/share/ca-certificates/28052.pem

	I0807 18:28:44.560960   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /usr/share/ca-certificates/280522.pem

	I0807 18:28:44.560975   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:44.561016   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:28:44.564346   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:44.564706   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:28:44.564750   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:44.564946   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:28:44.565119   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:28:44.565260   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:28:44.565409   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:28:44.636542   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0807 18:28:44.641908   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0807 18:28:44.653641   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0807 18:28:44.658316   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0807 18:28:44.670858   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0807 18:28:44.676928   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0807 18:28:44.688768   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0807 18:28:44.693467   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0807 18:28:44.706551   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0807 18:28:44.711030   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0807 18:28:44.721174   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0807 18:28:44.725233   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0807 18:28:44.735693   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 18:28:44.760511   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 18:28:44.784292   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 18:28:44.808965   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 18:28:44.832316   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0807 18:28:44.855893   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0807 18:28:44.879876   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 18:28:44.903976   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 18:28:44.927934   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem --> /usr/share/ca-certificates/28052.pem (1338 bytes)

	I0807 18:28:44.951549   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /usr/share/ca-certificates/280522.pem (1708 bytes)

	I0807 18:28:44.976102   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 18:28:45.000438   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0807 18:28:45.017427   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0807 18:28:45.034095   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0807 18:28:45.051357   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0807 18:28:45.068164   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0807 18:28:45.084903   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0807 18:28:45.102266   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0807 18:28:45.119661   44266 ssh_runner.go:195] Run: openssl version

	I0807 18:28:45.125624   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/28052.pem && ln -fs /usr/share/ca-certificates/28052.pem /etc/ssl/certs/28052.pem"

	I0807 18:28:45.137494   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/28052.pem

	I0807 18:28:45.142382   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  7 18:17 /usr/share/ca-certificates/28052.pem

	I0807 18:28:45.142458   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/28052.pem

	I0807 18:28:45.148370   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/28052.pem /etc/ssl/certs/51391683.0"

	I0807 18:28:45.159984   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/280522.pem && ln -fs /usr/share/ca-certificates/280522.pem /etc/ssl/certs/280522.pem"

	I0807 18:28:45.171372   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/280522.pem

	I0807 18:28:45.176093   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  7 18:17 /usr/share/ca-certificates/280522.pem

	I0807 18:28:45.176163   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/280522.pem

	I0807 18:28:45.182048   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/280522.pem /etc/ssl/certs/3ec20f2e.0"

	I0807 18:28:45.193770   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 18:28:45.205285   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:45.209824   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:45.209886   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:45.215494   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 18:28:45.226843   44266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 18:28:45.231043   44266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 18:28:45.231100   44266 kubeadm.go:934] updating node {m02 192.168.39.251 8443 v1.30.3 crio true true} ...

	I0807 18:28:45.231200   44266 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-198246-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.251

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 18:28:45.231226   44266 kube-vip.go:115] generating kube-vip config ...

	I0807 18:28:45.231271   44266 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0807 18:28:45.250153   44266 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0807 18:28:45.250214   44266 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0807 18:28:45.250259   44266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 18:28:45.260907   44266 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0807 18:28:45.260967   44266 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0807 18:28:45.270880   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0807 18:28:45.270914   44266 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet

	I0807 18:28:45.270924   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:28:45.270930   44266 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm

	I0807 18:28:45.270992   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:28:45.275789   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0807 18:28:45.275817   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0807 18:29:16.535217   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:29:16.535295   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:29:16.541424   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0807 18:29:16.541476   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0807 18:29:46.649609   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:29:46.666629   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:29:46.666743   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:29:46.671680   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0807 18:29:46.671715   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0807 18:29:47.065172   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0807 18:29:47.074897   44266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0807 18:29:47.091782   44266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 18:29:47.108598   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0807 18:29:47.125245   44266 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0807 18:29:47.129682   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:29:47.142072   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:29:47.274574   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:29:47.291877   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:29:47.292235   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:29:47.292273   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:29:47.307242   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39989

	I0807 18:29:47.307720   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:29:47.308297   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:29:47.308318   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:29:47.308692   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:29:47.308878   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:29:47.309043   44266 start.go:317] joinCluster: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiratio

n:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 18:29:47.309174   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0807 18:29:47.309196   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:29:47.312164   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:29:47.312576   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:29:47.312598   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:29:47.312741   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:29:47.312882   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:29:47.313026   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:29:47.313145   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:29:47.474155   44266 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:29:47.474212   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 78qnj6.khw60v382x7suzf2 --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m02 --control-plane --apiserver-advertise-address=192.168.39.251 --apiserver-bind-port=8443"

	I0807 18:30:09.531673   44266 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 78qnj6.khw60v382x7suzf2 --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m02 --control-plane --apiserver-advertise-address=192.168.39.251 --apiserver-bind-port=8443": (22.057432801s)

	I0807 18:30:09.531712   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0807 18:30:10.063192   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-198246-m02 minikube.k8s.io/updated_at=2024_08_07T18_30_10_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=ha-198246 minikube.k8s.io/primary=false

	I0807 18:30:10.185705   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-198246-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0807 18:30:10.289663   44266 start.go:319] duration metric: took 22.980616289s to joinCluster

	I0807 18:30:10.289758   44266 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:30:10.290021   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:30:10.291609   44266 out.go:177] * Verifying Kubernetes components...

	I0807 18:30:10.293124   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:30:10.576909   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:30:10.661898   44266 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:30:10.662179   44266 kapi.go:59] client config for ha-198246: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt", KeyFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key", CAFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02a80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0807 18:30:10.662254   44266 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.196:8443

	I0807 18:30:10.662605   44266 node_ready.go:35] waiting up to 6m0s for node "ha-198246-m02" to be "Ready" ...

	I0807 18:30:10.662743   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:10.662754   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:10.662761   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:10.662767   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:10.674699   44266 round_trippers.go:574] Response Status: 200 OK in 11 milliseconds

	I0807 18:30:11.163679   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:11.163703   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:11.163714   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:11.163720   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:11.167619   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:11.662940   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:11.662963   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:11.662969   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:11.662974   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:11.667816   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:12.163352   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:12.163385   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:12.163396   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:12.163402   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:12.172406   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:30:12.662926   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:12.662951   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:12.662956   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:12.662961   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:12.667516   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:12.668218   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:13.163680   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:13.163706   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:13.163714   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:13.163719   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:13.168225   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:13.663108   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:13.663128   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:13.663136   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:13.663140   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:13.667026   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:14.163223   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:14.163246   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:14.163255   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:14.163263   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:14.167544   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:14.663519   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:14.663545   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:14.663556   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:14.663562   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:14.667595   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:15.163698   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:15.163725   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:15.163738   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:15.163746   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:15.167266   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:15.167770   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:15.662914   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:15.662941   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:15.662951   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:15.662957   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:15.666490   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:16.163391   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:16.163419   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:16.163429   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:16.163435   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:16.167182   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:16.663906   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:16.663932   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:16.663943   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:16.663948   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:16.668176   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:17.162965   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:17.163049   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:17.163068   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:17.163080   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:17.167431   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:17.168285   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:17.663405   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:17.663429   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:17.663440   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:17.663447   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:17.667918   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:18.162918   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:18.162941   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:18.162949   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:18.162953   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:18.166467   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:18.663722   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:18.663747   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:18.663757   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:18.663762   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:18.668276   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:19.162945   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:19.162966   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:19.162973   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:19.162978   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:19.166353   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:19.663155   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:19.663178   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:19.663187   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:19.663192   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:19.667298   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:19.668045   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:20.163460   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:20.163483   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:20.163490   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:20.163493   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:20.166765   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:20.662987   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:20.663010   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:20.663021   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:20.663027   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:20.666411   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:21.163219   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:21.163241   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:21.163249   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:21.163252   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:21.167248   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:21.663138   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:21.663163   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:21.663171   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:21.663177   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:21.666630   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:22.163469   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:22.163496   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:22.163507   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:22.163513   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:22.166849   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:22.167436   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:22.663333   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:22.663354   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:22.663364   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:22.663369   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:22.667068   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:23.163229   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:23.163251   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:23.163259   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:23.163263   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:23.167845   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:23.663204   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:23.663224   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:23.663232   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:23.663236   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:23.667349   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:24.163700   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:24.163721   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:24.163727   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:24.163730   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:24.166893   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:24.167762   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:24.663135   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:24.663185   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:24.663196   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:24.663200   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:24.667220   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:25.163134   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:25.163158   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:25.163167   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:25.163171   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:25.167004   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:25.663113   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:25.663133   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:25.663141   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:25.663144   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:25.666348   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:26.162882   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:26.162907   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:26.162918   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:26.162923   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:26.166232   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:26.663636   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:26.663655   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:26.663663   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:26.663668   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:26.668096   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:26.668860   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:27.162906   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:27.162932   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:27.162956   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:27.162961   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:27.166246   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:27.662814   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:27.662838   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:27.662849   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:27.662855   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:27.666937   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:28.163385   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:28.163408   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:28.163419   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:28.163425   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:28.166996   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:28.663197   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:28.663220   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:28.663227   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:28.663231   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:28.666970   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.163041   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.163064   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.163072   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.163077   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.166751   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.167186   44266 node_ready.go:49] node "ha-198246-m02" has status "Ready":"True"

	I0807 18:30:29.167202   44266 node_ready.go:38] duration metric: took 18.504556301s for node "ha-198246-m02" to be "Ready" ...

	I0807 18:30:29.167209   44266 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:30:29.167270   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:29.167282   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.167291   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.167298   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.172316   44266 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0807 18:30:29.179632   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.179698   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rbnrx

	I0807 18:30:29.179705   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.179713   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.179716   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.182900   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.183633   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.183648   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.183658   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.183664   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.186729   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.187287   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.187309   44266 pod_ready.go:81] duration metric: took 7.655346ms for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.187321   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.187382   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-w6w6g

	I0807 18:30:29.187393   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.187403   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.187407   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.190210   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.190826   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.190843   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.190852   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.190860   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.193702   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.194277   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.194298   44266 pod_ready.go:81] duration metric: took 6.969332ms for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.194310   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.194367   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246

	I0807 18:30:29.194377   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.194385   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.194388   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.197299   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.197836   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.197850   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.197857   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.197862   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.200079   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.200638   44266 pod_ready.go:92] pod "etcd-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.200658   44266 pod_ready.go:81] duration metric: took 6.339465ms for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.200671   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.200727   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m02

	I0807 18:30:29.200736   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.200746   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.200754   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.202945   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.203877   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.203893   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.203901   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.203907   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.205928   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.206548   44266 pod_ready.go:92] pod "etcd-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.206567   44266 pod_ready.go:81] duration metric: took 5.88553ms for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.206585   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.363426   44266 request.go:629] Waited for 156.781521ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:30:29.363516   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:30:29.363524   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.363536   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.363544   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.367464   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.563699   44266 request.go:629] Waited for 195.39754ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.563755   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.563761   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.563771   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.563776   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.568245   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:29.568903   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.568920   44266 pod_ready.go:81] duration metric: took 362.325252ms for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.568929   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.764067   44266 request.go:629] Waited for 195.080715ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:30:29.764156   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:30:29.764163   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.764175   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.764183   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.767929   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.964048   44266 request.go:629] Waited for 195.354316ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.964123   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.964133   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.964143   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.964148   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.967577   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.968090   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.968117   44266 pod_ready.go:81] duration metric: took 399.182286ms for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.968126   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.163142   44266 request.go:629] Waited for 194.953767ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:30:30.163221   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:30:30.163231   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.163244   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.163253   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.166706   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.363808   44266 request.go:629] Waited for 196.398052ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:30.363874   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:30.363885   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.363895   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.363904   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.367698   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.368173   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:30.368190   44266 pod_ready.go:81] duration metric: took 400.057957ms for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.368215   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.563270   44266 request.go:629] Waited for 194.991431ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:30:30.563343   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:30:30.563350   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.563360   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.563365   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.566556   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.763133   44266 request.go:629] Waited for 196.018941ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:30.763191   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:30.763198   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.763206   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.763217   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.766348   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.767082   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:30.767100   44266 pod_ready.go:81] duration metric: took 398.876067ms for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.767118   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.963064   44266 request.go:629] Waited for 195.878143ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:30:30.963131   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:30:30.963137   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.963144   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.963151   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.966736   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:31.163920   44266 request.go:629] Waited for 196.37962ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.164005   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.164017   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.164028   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.164037   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.168411   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:31.168975   44266 pod_ready.go:92] pod "kube-proxy-4l79v" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:31.168994   44266 pod_ready.go:81] duration metric: took 401.867348ms for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.169006   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.363592   44266 request.go:629] Waited for 194.511545ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:30:31.363668   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:30:31.363675   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.363685   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.363691   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.368028   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:31.563121   44266 request.go:629] Waited for 194.293236ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:31.563213   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:31.563223   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.563234   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.563244   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.566830   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:31.567571   44266 pod_ready.go:92] pod "kube-proxy-m5ng2" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:31.567600   44266 pod_ready.go:81] duration metric: took 398.576464ms for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.567631   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.764083   44266 request.go:629] Waited for 196.35828ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:30:31.764163   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:30:31.764177   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.764191   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.764199   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.767212   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:31.963277   44266 request.go:629] Waited for 195.395503ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.963339   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.963343   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.963350   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.963354   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.966678   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:31.967366   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:31.967384   44266 pod_ready.go:81] duration metric: took 399.739353ms for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.967393   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:32.163518   44266 request.go:629] Waited for 196.071536ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:30:32.163576   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:30:32.163581   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.163589   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.163593   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.167125   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:32.363259   44266 request.go:629] Waited for 195.352702ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:32.363309   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:32.363314   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.363325   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.363330   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.366413   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:32.367013   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:32.367033   44266 pod_ready.go:81] duration metric: took 399.634584ms for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:32.367043   44266 pod_ready.go:38] duration metric: took 3.199823963s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:30:32.367059   44266 api_server.go:52] waiting for apiserver process to appear ...

	I0807 18:30:32.367111   44266 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:30:32.385352   44266 api_server.go:72] duration metric: took 22.095548352s to wait for apiserver process to appear ...

	I0807 18:30:32.385377   44266 api_server.go:88] waiting for apiserver healthz status ...

	I0807 18:30:32.385393   44266 api_server.go:253] Checking apiserver healthz at https://192.168.39.196:8443/healthz ...

	I0807 18:30:32.391376   44266 api_server.go:279] https://192.168.39.196:8443/healthz returned 200:

	ok

	I0807 18:30:32.391449   44266 round_trippers.go:463] GET https://192.168.39.196:8443/version

	I0807 18:30:32.391462   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.391472   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.391483   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.392358   44266 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0807 18:30:32.392431   44266 api_server.go:141] control plane version: v1.30.3

	I0807 18:30:32.392445   44266 api_server.go:131] duration metric: took 7.062347ms to wait for apiserver health ...

	I0807 18:30:32.392452   44266 system_pods.go:43] waiting for kube-system pods to appear ...

	I0807 18:30:32.563869   44266 request.go:629] Waited for 171.348742ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.563921   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.563931   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.563938   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.563942   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.569072   44266 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0807 18:30:32.573329   44266 system_pods.go:59] 17 kube-system pods found

	I0807 18:30:32.573357   44266 system_pods.go:61] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:30:32.573361   44266 system_pods.go:61] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:30:32.573364   44266 system_pods.go:61] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:30:32.573367   44266 system_pods.go:61] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:30:32.573370   44266 system_pods.go:61] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:30:32.573373   44266 system_pods.go:61] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:30:32.573376   44266 system_pods.go:61] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:30:32.573380   44266 system_pods.go:61] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:30:32.573383   44266 system_pods.go:61] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:30:32.573386   44266 system_pods.go:61] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:30:32.573390   44266 system_pods.go:61] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:30:32.573393   44266 system_pods.go:61] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:30:32.573396   44266 system_pods.go:61] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:30:32.573398   44266 system_pods.go:61] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:30:32.573402   44266 system_pods.go:61] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:30:32.573405   44266 system_pods.go:61] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:30:32.573408   44266 system_pods.go:61] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:30:32.573414   44266 system_pods.go:74] duration metric: took 180.956026ms to wait for pod list to return data ...

	I0807 18:30:32.573421   44266 default_sa.go:34] waiting for default service account to be created ...

	I0807 18:30:32.763885   44266 request.go:629] Waited for 190.379686ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:30:32.763936   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:30:32.763941   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.763948   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.763954   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.767012   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:32.767286   44266 default_sa.go:45] found service account: "default"

	I0807 18:30:32.767313   44266 default_sa.go:55] duration metric: took 193.885113ms for default service account to be created ...

	I0807 18:30:32.767324   44266 system_pods.go:116] waiting for k8s-apps to be running ...

	I0807 18:30:32.963765   44266 request.go:629] Waited for 196.363852ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.963831   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.963837   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.963844   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.963850   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.970431   44266 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0807 18:30:32.975184   44266 system_pods.go:86] 17 kube-system pods found

	I0807 18:30:32.975211   44266 system_pods.go:89] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:30:32.975219   44266 system_pods.go:89] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:30:32.975225   44266 system_pods.go:89] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:30:32.975231   44266 system_pods.go:89] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:30:32.975237   44266 system_pods.go:89] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:30:32.975242   44266 system_pods.go:89] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:30:32.975249   44266 system_pods.go:89] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:30:32.975254   44266 system_pods.go:89] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:30:32.975261   44266 system_pods.go:89] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:30:32.975268   44266 system_pods.go:89] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:30:32.975277   44266 system_pods.go:89] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:30:32.975284   44266 system_pods.go:89] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:30:32.975291   44266 system_pods.go:89] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:30:32.975297   44266 system_pods.go:89] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:30:32.975303   44266 system_pods.go:89] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:30:32.975312   44266 system_pods.go:89] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:30:32.975318   44266 system_pods.go:89] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:30:32.975327   44266 system_pods.go:126] duration metric: took 207.996289ms to wait for k8s-apps to be running ...

	I0807 18:30:32.975339   44266 system_svc.go:44] waiting for kubelet service to be running ....

	I0807 18:30:32.975391   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:30:32.989953   44266 system_svc.go:56] duration metric: took 14.606769ms WaitForService to wait for kubelet

	I0807 18:30:32.989979   44266 kubeadm.go:582] duration metric: took 22.700179334s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 18:30:32.989999   44266 node_conditions.go:102] verifying NodePressure condition ...

	I0807 18:30:33.163417   44266 request.go:629] Waited for 173.330443ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes

	I0807 18:30:33.163468   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes

	I0807 18:30:33.163473   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:33.163480   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:33.163484   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:33.167772   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:33.168822   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:30:33.168846   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:30:33.168861   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:30:33.168866   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:30:33.168872   44266 node_conditions.go:105] duration metric: took 178.867475ms to run NodePressure ...

	I0807 18:30:33.168893   44266 start.go:241] waiting for startup goroutines ...

	I0807 18:30:33.168926   44266 start.go:255] writing updated cluster config ...

	I0807 18:30:33.170904   44266 out.go:177] 

	I0807 18:30:33.172264   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:30:33.172352   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:30:33.173860   44266 out.go:177] * Starting "ha-198246-m03" control-plane node in "ha-198246" cluster

	I0807 18:30:33.175358   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:30:33.175380   44266 cache.go:56] Caching tarball of preloaded images

	I0807 18:30:33.175467   44266 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 18:30:33.175477   44266 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 18:30:33.175556   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:30:33.175701   44266 start.go:360] acquireMachinesLock for ha-198246-m03: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 18:30:33.175740   44266 start.go:364] duration metric: took 21.742µs to acquireMachinesLock for "ha-198246-m03"

	I0807 18:30:33.175759   44266 start.go:93] Provisioning new machine with config: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-

dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:30:33.175842   44266 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0807 18:30:33.177325   44266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0807 18:30:33.177407   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:30:33.177444   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:30:33.191872   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46759

	I0807 18:30:33.192346   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:30:33.192788   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:30:33.192811   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:30:33.193150   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:30:33.193346   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:30:33.193498   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:30:33.193662   44266 start.go:159] libmachine.API.Create for "ha-198246" (driver="kvm2")

	I0807 18:30:33.193682   44266 client.go:168] LocalClient.Create starting

	I0807 18:30:33.193707   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 18:30:33.193739   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:30:33.193753   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:30:33.193811   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 18:30:33.193842   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:30:33.193854   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:30:33.193877   44266 main.go:141] libmachine: Running pre-create checks...

	I0807 18:30:33.193888   44266 main.go:141] libmachine: (ha-198246-m03) Calling .PreCreateCheck

	I0807 18:30:33.194049   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetConfigRaw

	I0807 18:30:33.194488   44266 main.go:141] libmachine: Creating machine...

	I0807 18:30:33.194501   44266 main.go:141] libmachine: (ha-198246-m03) Calling .Create

	I0807 18:30:33.194651   44266 main.go:141] libmachine: (ha-198246-m03) Creating KVM machine...

	I0807 18:30:33.195893   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found existing default KVM network

	I0807 18:30:33.196007   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found existing private KVM network mk-ha-198246

	I0807 18:30:33.196136   44266 main.go:141] libmachine: (ha-198246-m03) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03 ...

	I0807 18:30:33.196160   44266 main.go:141] libmachine: (ha-198246-m03) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 18:30:33.196236   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.196136   45290 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:30:33.196342   44266 main.go:141] libmachine: (ha-198246-m03) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 18:30:33.432780   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.432647   45290 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa...

	I0807 18:30:33.529287   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.529189   45290 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/ha-198246-m03.rawdisk...

	I0807 18:30:33.529318   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Writing magic tar header

	I0807 18:30:33.529332   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Writing SSH key tar header

	I0807 18:30:33.529343   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.529299   45290 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03 ...

	I0807 18:30:33.529393   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03

	I0807 18:30:33.529414   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 18:30:33.529433   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03 (perms=drwx------)

	I0807 18:30:33.529447   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:30:33.529464   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 18:30:33.529477   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 18:30:33.529492   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 18:30:33.529508   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins

	I0807 18:30:33.529523   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 18:30:33.529538   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home

	I0807 18:30:33.529554   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 18:30:33.529567   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 18:30:33.529579   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Skipping /home - not owner

	I0807 18:30:33.529595   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 18:30:33.529611   44266 main.go:141] libmachine: (ha-198246-m03) Creating domain...

	I0807 18:30:33.530487   44266 main.go:141] libmachine: (ha-198246-m03) define libvirt domain using xml: 

	I0807 18:30:33.530514   44266 main.go:141] libmachine: (ha-198246-m03) <domain type='kvm'>

	I0807 18:30:33.530527   44266 main.go:141] libmachine: (ha-198246-m03)   <name>ha-198246-m03</name>

	I0807 18:30:33.530534   44266 main.go:141] libmachine: (ha-198246-m03)   <memory unit='MiB'>2200</memory>

	I0807 18:30:33.530544   44266 main.go:141] libmachine: (ha-198246-m03)   <vcpu>2</vcpu>

	I0807 18:30:33.530555   44266 main.go:141] libmachine: (ha-198246-m03)   <features>

	I0807 18:30:33.530564   44266 main.go:141] libmachine: (ha-198246-m03)     <acpi/>

	I0807 18:30:33.530574   44266 main.go:141] libmachine: (ha-198246-m03)     <apic/>

	I0807 18:30:33.530582   44266 main.go:141] libmachine: (ha-198246-m03)     <pae/>

	I0807 18:30:33.530593   44266 main.go:141] libmachine: (ha-198246-m03)     

	I0807 18:30:33.530604   44266 main.go:141] libmachine: (ha-198246-m03)   </features>

	I0807 18:30:33.530615   44266 main.go:141] libmachine: (ha-198246-m03)   <cpu mode='host-passthrough'>

	I0807 18:30:33.530622   44266 main.go:141] libmachine: (ha-198246-m03)   

	I0807 18:30:33.530630   44266 main.go:141] libmachine: (ha-198246-m03)   </cpu>

	I0807 18:30:33.530637   44266 main.go:141] libmachine: (ha-198246-m03)   <os>

	I0807 18:30:33.530647   44266 main.go:141] libmachine: (ha-198246-m03)     <type>hvm</type>

	I0807 18:30:33.530659   44266 main.go:141] libmachine: (ha-198246-m03)     <boot dev='cdrom'/>

	I0807 18:30:33.530673   44266 main.go:141] libmachine: (ha-198246-m03)     <boot dev='hd'/>

	I0807 18:30:33.530702   44266 main.go:141] libmachine: (ha-198246-m03)     <bootmenu enable='no'/>

	I0807 18:30:33.530724   44266 main.go:141] libmachine: (ha-198246-m03)   </os>

	I0807 18:30:33.530735   44266 main.go:141] libmachine: (ha-198246-m03)   <devices>

	I0807 18:30:33.530748   44266 main.go:141] libmachine: (ha-198246-m03)     <disk type='file' device='cdrom'>

	I0807 18:30:33.530766   44266 main.go:141] libmachine: (ha-198246-m03)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/boot2docker.iso'/>

	I0807 18:30:33.530778   44266 main.go:141] libmachine: (ha-198246-m03)       <target dev='hdc' bus='scsi'/>

	I0807 18:30:33.530790   44266 main.go:141] libmachine: (ha-198246-m03)       <readonly/>

	I0807 18:30:33.530800   44266 main.go:141] libmachine: (ha-198246-m03)     </disk>

	I0807 18:30:33.530813   44266 main.go:141] libmachine: (ha-198246-m03)     <disk type='file' device='disk'>

	I0807 18:30:33.530826   44266 main.go:141] libmachine: (ha-198246-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 18:30:33.530840   44266 main.go:141] libmachine: (ha-198246-m03)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/ha-198246-m03.rawdisk'/>

	I0807 18:30:33.530856   44266 main.go:141] libmachine: (ha-198246-m03)       <target dev='hda' bus='virtio'/>

	I0807 18:30:33.530868   44266 main.go:141] libmachine: (ha-198246-m03)     </disk>

	I0807 18:30:33.530892   44266 main.go:141] libmachine: (ha-198246-m03)     <interface type='network'>

	I0807 18:30:33.530906   44266 main.go:141] libmachine: (ha-198246-m03)       <source network='mk-ha-198246'/>

	I0807 18:30:33.530917   44266 main.go:141] libmachine: (ha-198246-m03)       <model type='virtio'/>

	I0807 18:30:33.530927   44266 main.go:141] libmachine: (ha-198246-m03)     </interface>

	I0807 18:30:33.530938   44266 main.go:141] libmachine: (ha-198246-m03)     <interface type='network'>

	I0807 18:30:33.530952   44266 main.go:141] libmachine: (ha-198246-m03)       <source network='default'/>

	I0807 18:30:33.530963   44266 main.go:141] libmachine: (ha-198246-m03)       <model type='virtio'/>

	I0807 18:30:33.530976   44266 main.go:141] libmachine: (ha-198246-m03)     </interface>

	I0807 18:30:33.530986   44266 main.go:141] libmachine: (ha-198246-m03)     <serial type='pty'>

	I0807 18:30:33.530996   44266 main.go:141] libmachine: (ha-198246-m03)       <target port='0'/>

	I0807 18:30:33.531010   44266 main.go:141] libmachine: (ha-198246-m03)     </serial>

	I0807 18:30:33.531020   44266 main.go:141] libmachine: (ha-198246-m03)     <console type='pty'>

	I0807 18:30:33.531031   44266 main.go:141] libmachine: (ha-198246-m03)       <target type='serial' port='0'/>

	I0807 18:30:33.531043   44266 main.go:141] libmachine: (ha-198246-m03)     </console>

	I0807 18:30:33.531053   44266 main.go:141] libmachine: (ha-198246-m03)     <rng model='virtio'>

	I0807 18:30:33.531067   44266 main.go:141] libmachine: (ha-198246-m03)       <backend model='random'>/dev/random</backend>

	I0807 18:30:33.531078   44266 main.go:141] libmachine: (ha-198246-m03)     </rng>

	I0807 18:30:33.531119   44266 main.go:141] libmachine: (ha-198246-m03)     

	I0807 18:30:33.531138   44266 main.go:141] libmachine: (ha-198246-m03)     

	I0807 18:30:33.531151   44266 main.go:141] libmachine: (ha-198246-m03)   </devices>

	I0807 18:30:33.531165   44266 main.go:141] libmachine: (ha-198246-m03) </domain>

	I0807 18:30:33.531182   44266 main.go:141] libmachine: (ha-198246-m03) 

	I0807 18:30:33.537482   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9f:ab:f5 in network default

	I0807 18:30:33.538090   44266 main.go:141] libmachine: (ha-198246-m03) Ensuring networks are active...

	I0807 18:30:33.538108   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:33.538784   44266 main.go:141] libmachine: (ha-198246-m03) Ensuring network default is active

	I0807 18:30:33.539152   44266 main.go:141] libmachine: (ha-198246-m03) Ensuring network mk-ha-198246 is active

	I0807 18:30:33.539485   44266 main.go:141] libmachine: (ha-198246-m03) Getting domain xml...

	I0807 18:30:33.540252   44266 main.go:141] libmachine: (ha-198246-m03) Creating domain...

	I0807 18:30:34.756035   44266 main.go:141] libmachine: (ha-198246-m03) Waiting to get IP...

	I0807 18:30:34.756939   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:34.757511   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:34.757577   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:34.757477   45290 retry.go:31] will retry after 227.908957ms: waiting for machine to come up

	I0807 18:30:34.986907   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:34.987323   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:34.987354   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:34.987276   45290 retry.go:31] will retry after 246.835339ms: waiting for machine to come up

	I0807 18:30:35.235616   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:35.236094   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:35.236119   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:35.236046   45290 retry.go:31] will retry after 426.907083ms: waiting for machine to come up

	I0807 18:30:35.664761   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:35.665183   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:35.665243   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:35.665182   45290 retry.go:31] will retry after 507.132694ms: waiting for machine to come up

	I0807 18:30:36.173688   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:36.174085   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:36.174115   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:36.174025   45290 retry.go:31] will retry after 466.332078ms: waiting for machine to come up

	I0807 18:30:36.642374   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:36.642869   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:36.642896   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:36.642788   45290 retry.go:31] will retry after 802.371451ms: waiting for machine to come up

	I0807 18:30:37.446742   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:37.447182   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:37.447204   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:37.447149   45290 retry.go:31] will retry after 1.058258348s: waiting for machine to come up

	I0807 18:30:38.506869   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:38.507277   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:38.507303   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:38.507243   45290 retry.go:31] will retry after 1.24813663s: waiting for machine to come up

	I0807 18:30:39.757276   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:39.757679   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:39.757708   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:39.757653   45290 retry.go:31] will retry after 1.347201318s: waiting for machine to come up

	I0807 18:30:41.107002   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:41.107475   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:41.107501   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:41.107433   45290 retry.go:31] will retry after 2.164822694s: waiting for machine to come up

	I0807 18:30:43.273615   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:43.274030   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:43.274053   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:43.274008   45290 retry.go:31] will retry after 2.890209035s: waiting for machine to come up

	I0807 18:30:46.165557   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:46.166122   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:46.166152   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:46.166070   45290 retry.go:31] will retry after 3.463040417s: waiting for machine to come up

	I0807 18:30:49.630676   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:49.631090   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:49.631119   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:49.631053   45290 retry.go:31] will retry after 2.865023491s: waiting for machine to come up

	I0807 18:30:52.497203   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:52.497575   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:52.497598   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:52.497535   45290 retry.go:31] will retry after 4.944323257s: waiting for machine to come up

	I0807 18:30:57.446295   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:57.446732   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has current primary IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:57.446753   44266 main.go:141] libmachine: (ha-198246-m03) Found IP for machine: 192.168.39.227

	I0807 18:30:57.446766   44266 main.go:141] libmachine: (ha-198246-m03) Reserving static IP address...

	I0807 18:30:57.447262   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find host DHCP lease matching {name: "ha-198246-m03", mac: "52:54:00:9d:24:52", ip: "192.168.39.227"} in network mk-ha-198246

	I0807 18:30:57.521164   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Getting to WaitForSSH function...

	I0807 18:30:57.521190   44266 main.go:141] libmachine: (ha-198246-m03) Reserved static IP address: 192.168.39.227

	I0807 18:30:57.521199   44266 main.go:141] libmachine: (ha-198246-m03) Waiting for SSH to be available...

	I0807 18:30:57.523681   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:57.524059   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246

	I0807 18:30:57.524105   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find defined IP address of network mk-ha-198246 interface with MAC address 52:54:00:9d:24:52

	I0807 18:30:57.524328   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH client type: external

	I0807 18:30:57.524353   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa (-rw-------)

	I0807 18:30:57.524381   44266 main.go:141] libmachine: (ha-198246-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:30:57.524422   44266 main.go:141] libmachine: (ha-198246-m03) DBG | About to run SSH command:

	I0807 18:30:57.524444   44266 main.go:141] libmachine: (ha-198246-m03) DBG | exit 0

	I0807 18:30:57.529188   44266 main.go:141] libmachine: (ha-198246-m03) DBG | SSH cmd err, output: exit status 255: 

	I0807 18:30:57.529209   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0807 18:30:57.529217   44266 main.go:141] libmachine: (ha-198246-m03) DBG | command : exit 0

	I0807 18:30:57.529223   44266 main.go:141] libmachine: (ha-198246-m03) DBG | err     : exit status 255

	I0807 18:30:57.529230   44266 main.go:141] libmachine: (ha-198246-m03) DBG | output  : 

	I0807 18:31:00.531629   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Getting to WaitForSSH function...

	I0807 18:31:00.534035   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.534413   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.534441   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.534511   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH client type: external

	I0807 18:31:00.534527   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa (-rw-------)

	I0807 18:31:00.534578   44266 main.go:141] libmachine: (ha-198246-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.227 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:31:00.534598   44266 main.go:141] libmachine: (ha-198246-m03) DBG | About to run SSH command:

	I0807 18:31:00.534623   44266 main.go:141] libmachine: (ha-198246-m03) DBG | exit 0

	I0807 18:31:00.664624   44266 main.go:141] libmachine: (ha-198246-m03) DBG | SSH cmd err, output: <nil>: 

	I0807 18:31:00.664910   44266 main.go:141] libmachine: (ha-198246-m03) KVM machine creation complete!

	I0807 18:31:00.665347   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetConfigRaw

	I0807 18:31:00.665908   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:00.666128   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:00.666310   44266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 18:31:00.666326   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:31:00.667883   44266 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 18:31:00.667900   44266 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 18:31:00.667908   44266 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 18:31:00.667916   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:00.670520   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.671001   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.671032   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.671175   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:00.671364   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.671513   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.671630   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:00.671786   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:00.671980   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:00.671990   44266 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 18:31:00.787597   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:31:00.787623   44266 main.go:141] libmachine: Detecting the provisioner...

	I0807 18:31:00.787633   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:00.790865   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.791362   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.791388   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.791510   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:00.791714   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.791937   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.792190   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:00.792379   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:00.792539   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:00.792549   44266 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 18:31:00.909345   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 18:31:00.909405   44266 main.go:141] libmachine: found compatible host: buildroot

	I0807 18:31:00.909414   44266 main.go:141] libmachine: Provisioning with buildroot...

	I0807 18:31:00.909421   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:31:00.909684   44266 buildroot.go:166] provisioning hostname "ha-198246-m03"

	I0807 18:31:00.909709   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:31:00.909928   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:00.913329   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.913773   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.913798   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.913978   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:00.914169   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.914339   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.914512   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:00.914692   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:00.914895   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:00.914915   44266 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-198246-m03 && echo "ha-198246-m03" | sudo tee /etc/hostname

	I0807 18:31:01.046391   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-198246-m03

	I0807 18:31:01.046419   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.049459   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.049924   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.049953   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.050088   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.050268   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.050448   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.050586   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.050755   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:01.050909   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:01.050924   44266 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-198246-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-198246-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-198246-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 18:31:01.178381   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:31:01.178417   44266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 18:31:01.178436   44266 buildroot.go:174] setting up certificates

	I0807 18:31:01.178447   44266 provision.go:84] configureAuth start

	I0807 18:31:01.178459   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:31:01.178749   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:01.181683   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.182031   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.182058   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.182247   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.184746   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.185072   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.185101   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.185229   44266 provision.go:143] copyHostCerts

	I0807 18:31:01.185260   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:31:01.185298   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem, removing ...

	I0807 18:31:01.185309   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:31:01.185381   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 18:31:01.185480   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:31:01.185505   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem, removing ...

	I0807 18:31:01.185514   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:31:01.185554   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 18:31:01.185619   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:31:01.185643   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem, removing ...

	I0807 18:31:01.185648   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:31:01.185683   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 18:31:01.185753   44266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.ha-198246-m03 san=[127.0.0.1 192.168.39.227 ha-198246-m03 localhost minikube]

	I0807 18:31:01.354582   44266 provision.go:177] copyRemoteCerts

	I0807 18:31:01.354653   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 18:31:01.354683   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.357461   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.357784   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.357817   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.358072   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.358268   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.358436   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.358560   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:01.447576   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0807 18:31:01.447656   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 18:31:01.475031   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0807 18:31:01.475102   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0807 18:31:01.501202   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0807 18:31:01.501289   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0807 18:31:01.528456   44266 provision.go:87] duration metric: took 349.995722ms to configureAuth

	I0807 18:31:01.528486   44266 buildroot.go:189] setting minikube options for container-runtime

	I0807 18:31:01.528699   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:31:01.528777   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.531665   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.532012   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.532042   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.532225   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.532423   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.532595   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.532702   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.532873   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:01.533031   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:01.533047   44266 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 18:31:01.817075   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 18:31:01.817099   44266 main.go:141] libmachine: Checking connection to Docker...

	I0807 18:31:01.817118   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetURL

	I0807 18:31:01.818384   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using libvirt version 6000000

	I0807 18:31:01.821056   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.821418   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.821439   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.821580   44266 main.go:141] libmachine: Docker is up and running!

	I0807 18:31:01.821595   44266 main.go:141] libmachine: Reticulating splines...

	I0807 18:31:01.821603   44266 client.go:171] duration metric: took 28.627914411s to LocalClient.Create

	I0807 18:31:01.821631   44266 start.go:167] duration metric: took 28.627967701s to libmachine.API.Create "ha-198246"

	I0807 18:31:01.821643   44266 start.go:293] postStartSetup for "ha-198246-m03" (driver="kvm2")

	I0807 18:31:01.821659   44266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 18:31:01.821698   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:01.821917   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 18:31:01.821940   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.824112   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.824469   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.824488   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.824623   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.824800   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.824973   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.825155   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:01.915999   44266 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 18:31:01.920422   44266 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 18:31:01.920443   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 18:31:01.920514   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 18:31:01.920605   44266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> 280522.pem in /etc/ssl/certs

	I0807 18:31:01.920618   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /etc/ssl/certs/280522.pem

	I0807 18:31:01.920730   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0807 18:31:01.931294   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:31:01.955945   44266 start.go:296] duration metric: took 134.285824ms for postStartSetup

	I0807 18:31:01.956001   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetConfigRaw

	I0807 18:31:01.956611   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:01.959322   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.959688   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.959723   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.959995   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:31:01.960180   44266 start.go:128] duration metric: took 28.784328806s to createHost

	I0807 18:31:01.960233   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.962214   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.962551   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.962579   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.962733   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.962916   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.963080   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.963211   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.963362   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:01.963518   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:01.963528   44266 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0807 18:31:02.077437   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723055462.057555331

	I0807 18:31:02.077460   44266 fix.go:216] guest clock: 1723055462.057555331

	I0807 18:31:02.077470   44266 fix.go:229] Guest: 2024-08-07 18:31:02.057555331 +0000 UTC Remote: 2024-08-07 18:31:01.960191536 +0000 UTC m=+220.271212198 (delta=97.363795ms)

	I0807 18:31:02.077490   44266 fix.go:200] guest clock delta is within tolerance: 97.363795ms

	I0807 18:31:02.077497   44266 start.go:83] releasing machines lock for "ha-198246-m03", held for 28.901748397s

	I0807 18:31:02.077520   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.077788   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:02.081280   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.081885   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:02.081913   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.084121   44266 out.go:177] * Found network options:

	I0807 18:31:02.085422   44266 out.go:177]   - NO_PROXY=192.168.39.196,192.168.39.251

	W0807 18:31:02.086688   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	W0807 18:31:02.086711   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:31:02.086726   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.087351   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.087542   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.087647   44266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 18:31:02.087697   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	W0807 18:31:02.087728   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	W0807 18:31:02.087754   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:31:02.087831   44266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 18:31:02.087877   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:02.090758   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.090950   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.091267   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:02.091288   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.091311   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:02.091327   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.091450   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:02.091624   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:02.091638   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:02.091819   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:02.091826   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:02.091982   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:02.091975   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:02.092120   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:02.330635   44266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 18:31:02.338200   44266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 18:31:02.338275   44266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 18:31:02.355776   44266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 18:31:02.355798   44266 start.go:495] detecting cgroup driver to use...

	I0807 18:31:02.355869   44266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 18:31:02.373960   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 18:31:02.388788   44266 docker.go:217] disabling cri-docker service (if available) ...

	I0807 18:31:02.388863   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 18:31:02.402456   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 18:31:02.415862   44266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 18:31:02.528910   44266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 18:31:02.692177   44266 docker.go:233] disabling docker service ...

	I0807 18:31:02.692260   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 18:31:02.708366   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 18:31:02.722150   44266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 18:31:02.842254   44266 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 18:31:02.963283   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 18:31:02.979860   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 18:31:03.000776   44266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 18:31:03.000833   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.012949   44266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 18:31:03.013019   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.025364   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.037815   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.050150   44266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 18:31:03.062786   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.074694   44266 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.094223   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.106816   44266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 18:31:03.117233   44266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 18:31:03.117281   44266 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 18:31:03.130652   44266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 18:31:03.140978   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:31:03.261390   44266 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 18:31:03.415655   44266 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 18:31:03.415731   44266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 18:31:03.420847   44266 start.go:563] Will wait 60s for crictl version

	I0807 18:31:03.420894   44266 ssh_runner.go:195] Run: which crictl

	I0807 18:31:03.424888   44266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 18:31:03.466634   44266 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 18:31:03.466722   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:31:03.495718   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:31:03.666880   44266 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 18:31:03.742658   44266 out.go:177]   - env NO_PROXY=192.168.39.196

	I0807 18:31:03.816001   44266 out.go:177]   - env NO_PROXY=192.168.39.196,192.168.39.251

	I0807 18:31:03.888374   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:03.891307   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:03.891715   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:03.891745   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:03.891998   44266 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 18:31:03.896652   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:31:03.912117   44266 mustload.go:65] Loading cluster: ha-198246

	I0807 18:31:03.912501   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:31:03.912897   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:31:03.912950   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:31:03.928344   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43499

	I0807 18:31:03.928736   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:31:03.929306   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:31:03.929334   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:31:03.929692   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:31:03.929888   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:31:03.931789   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:31:03.932081   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:31:03.932119   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:31:03.947851   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33021

	I0807 18:31:03.948291   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:31:03.948876   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:31:03.948893   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:31:03.949204   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:31:03.949455   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:31:03.949625   44266 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246 for IP: 192.168.39.227

	I0807 18:31:03.949636   44266 certs.go:194] generating shared ca certs ...

	I0807 18:31:03.949650   44266 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:31:03.949763   44266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 18:31:03.949804   44266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 18:31:03.949809   44266 certs.go:256] generating profile certs ...

	I0807 18:31:03.949874   44266 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key

	I0807 18:31:03.949895   44266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5

	I0807 18:31:03.949910   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.196 192.168.39.251 192.168.39.227 192.168.39.254]

	I0807 18:31:04.235062   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5 ...

	I0807 18:31:04.235104   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5: {Name:mkc9ab09dfcc0a08e4cded1def253097d11345ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:31:04.235325   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5 ...

	I0807 18:31:04.235345   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5: {Name:mk706ab9d0d4064858493bbf1c933d49d1f0fd75 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:31:04.235444   44266 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt

	I0807 18:31:04.284244   44266 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key

	I0807 18:31:04.284561   44266 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key

	I0807 18:31:04.284585   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0807 18:31:04.284607   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0807 18:31:04.284635   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0807 18:31:04.284654   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0807 18:31:04.284671   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0807 18:31:04.284704   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0807 18:31:04.284726   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0807 18:31:04.284747   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0807 18:31:04.284824   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem (1338 bytes)

	W0807 18:31:04.284871   44266 certs.go:480] ignoring /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052_empty.pem, impossibly tiny 0 bytes

	I0807 18:31:04.284888   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 18:31:04.284977   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 18:31:04.285053   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 18:31:04.285089   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 18:31:04.285156   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:31:04.285203   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem -> /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.285227   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.285244   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:04.285288   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:31:04.288899   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:04.289445   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:31:04.289477   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:04.289641   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:31:04.289875   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:31:04.290047   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:31:04.290209   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:31:04.368646   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0807 18:31:04.375791   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0807 18:31:04.387726   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0807 18:31:04.392669   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0807 18:31:04.404818   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0807 18:31:04.409538   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0807 18:31:04.423952   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0807 18:31:04.429946   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0807 18:31:04.442196   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0807 18:31:04.447075   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0807 18:31:04.467205   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0807 18:31:04.472136   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0807 18:31:04.484789   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 18:31:04.513657   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 18:31:04.541568   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 18:31:04.570650   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 18:31:04.599209   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0807 18:31:04.624315   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0807 18:31:04.649418   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 18:31:04.674771   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 18:31:04.701297   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem --> /usr/share/ca-certificates/28052.pem (1338 bytes)

	I0807 18:31:04.728656   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /usr/share/ca-certificates/280522.pem (1708 bytes)

	I0807 18:31:04.756136   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 18:31:04.783116   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0807 18:31:04.800682   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0807 18:31:04.818998   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0807 18:31:04.836194   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0807 18:31:04.854131   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0807 18:31:04.871939   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0807 18:31:04.888443   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0807 18:31:04.905275   44266 ssh_runner.go:195] Run: openssl version

	I0807 18:31:04.911814   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/28052.pem && ln -fs /usr/share/ca-certificates/28052.pem /etc/ssl/certs/28052.pem"

	I0807 18:31:04.922949   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.927578   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  7 18:17 /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.927640   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.934032   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/28052.pem /etc/ssl/certs/51391683.0"

	I0807 18:31:04.945014   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/280522.pem && ln -fs /usr/share/ca-certificates/280522.pem /etc/ssl/certs/280522.pem"

	I0807 18:31:04.957480   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.962404   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  7 18:17 /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.962459   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.968351   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/280522.pem /etc/ssl/certs/3ec20f2e.0"

	I0807 18:31:04.980460   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 18:31:04.992337   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:04.997356   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:04.997422   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:05.003783   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 18:31:05.015178   44266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 18:31:05.019430   44266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 18:31:05.019490   44266 kubeadm.go:934] updating node {m03 192.168.39.227 8443 v1.30.3 crio true true} ...

	I0807 18:31:05.019580   44266 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-198246-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.227

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 18:31:05.019607   44266 kube-vip.go:115] generating kube-vip config ...

	I0807 18:31:05.019640   44266 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0807 18:31:05.036848   44266 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0807 18:31:05.036914   44266 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0807 18:31:05.036972   44266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 18:31:05.047848   44266 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0807 18:31:05.047893   44266 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0807 18:31:05.058827   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0807 18:31:05.058853   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:31:05.058935   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:31:05.058827   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256

	I0807 18:31:05.058826   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256

	I0807 18:31:05.059037   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:31:05.059054   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:31:05.059162   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:31:05.063740   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0807 18:31:05.063770   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0807 18:31:05.093775   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:31:05.093820   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0807 18:31:05.093855   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0807 18:31:05.093875   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:31:05.147621   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0807 18:31:05.147679   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0807 18:31:06.022179   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0807 18:31:06.032561   44266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0807 18:31:06.051718   44266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 18:31:06.069963   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0807 18:31:06.088103   44266 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0807 18:31:06.092277   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:31:06.105287   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:31:06.220917   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:31:06.238937   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:31:06.239328   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:31:06.239375   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:31:06.258371   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37405

	I0807 18:31:06.258888   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:31:06.259464   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:31:06.259488   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:31:06.259882   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:31:06.260092   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:31:06.260264   44266 start.go:317] joinCluster: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.227 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false

inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO

ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 18:31:06.260379   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0807 18:31:06.260399   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:31:06.263930   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:06.264431   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:31:06.264458   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:06.264644   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:31:06.264810   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:31:06.264929   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:31:06.265035   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:31:06.435193   44266 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.227 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:31:06.435239   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token od1f23.v6j6x0epna3a85qa --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m03 --control-plane --apiserver-advertise-address=192.168.39.227 --apiserver-bind-port=8443"

	I0807 18:31:30.206281   44266 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token od1f23.v6j6x0epna3a85qa --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m03 --control-plane --apiserver-advertise-address=192.168.39.227 --apiserver-bind-port=8443": (23.77100816s)

	I0807 18:31:30.206317   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0807 18:31:30.813324   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-198246-m03 minikube.k8s.io/updated_at=2024_08_07T18_31_30_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=ha-198246 minikube.k8s.io/primary=false

	I0807 18:31:30.964365   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-198246-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0807 18:31:31.090417   44266 start.go:319] duration metric: took 24.830149142s to joinCluster

	I0807 18:31:31.090498   44266 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.227 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:31:31.090781   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:31:31.093184   44266 out.go:177] * Verifying Kubernetes components...

	I0807 18:31:31.094437   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:31:31.342260   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:31:31.362745   44266 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:31:31.363071   44266 kapi.go:59] client config for ha-198246: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt", KeyFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key", CAFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02a80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0807 18:31:31.363166   44266 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.196:8443

	I0807 18:31:31.363437   44266 node_ready.go:35] waiting up to 6m0s for node "ha-198246-m03" to be "Ready" ...

	I0807 18:31:31.363528   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:31.363541   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:31.363551   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:31.363556   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:31.367408   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:31.864633   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:31.864676   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:31.864702   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:31.864711   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:31.868168   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:32.363859   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:32.363895   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:32.363903   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:32.363908   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:32.367827   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:32.863813   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:32.863834   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:32.863841   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:32.863846   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:32.867002   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:33.363594   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:33.363616   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:33.363625   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:33.363631   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:33.368287   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:33.369938   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:33.864014   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:33.864035   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:33.864043   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:33.864050   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:33.868446   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:34.364544   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:34.364563   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:34.364568   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:34.364571   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:34.368487   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:34.863667   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:34.863695   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:34.863705   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:34.863711   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:34.867251   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:35.364368   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:35.364391   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:35.364397   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:35.364405   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:35.368606   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:35.370093   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:35.864081   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:35.864108   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:35.864120   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:35.864126   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:35.867805   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:36.363814   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:36.363838   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:36.363848   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:36.363854   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:36.367626   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:36.863972   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:36.863992   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:36.864000   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:36.864004   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:36.867776   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:37.363945   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:37.363966   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:37.363974   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:37.363977   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:37.367672   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:37.864665   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:37.864704   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:37.864712   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:37.864715   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:37.868330   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:37.869986   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:38.363639   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:38.363660   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:38.363668   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:38.363672   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:38.367008   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:38.863892   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:38.863919   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:38.863931   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:38.863935   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:38.872605   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:31:39.364337   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:39.364368   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:39.364375   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:39.364379   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:39.367983   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:39.863967   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:39.863990   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:39.863999   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:39.864003   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:39.867134   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:40.363638   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:40.363664   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:40.363675   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:40.363680   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:40.367384   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:40.368391   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:40.863639   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:40.863658   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:40.863665   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:40.863669   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:40.866980   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:41.364633   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:41.364655   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:41.364665   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:41.364671   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:41.368280   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:41.864268   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:41.864288   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:41.864297   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:41.864301   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:41.868013   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:42.364521   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:42.364546   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:42.364557   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:42.364564   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:42.367904   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:42.368754   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:42.864040   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:42.864061   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:42.864069   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:42.864073   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:42.867582   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:43.363930   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:43.363950   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:43.363958   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:43.363961   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:43.368329   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:43.864004   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:43.864030   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:43.864042   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:43.864054   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:43.868118   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:44.364372   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:44.364399   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:44.364411   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:44.364416   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:44.367990   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:44.863922   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:44.863945   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:44.863957   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:44.863965   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:44.868231   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:44.869027   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:45.364338   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:45.364359   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:45.364367   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:45.364372   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:45.368558   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:45.863928   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:45.863949   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:45.863957   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:45.863962   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:45.867520   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:46.363984   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:46.364009   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:46.364017   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:46.364022   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:46.367693   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:46.864611   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:46.864635   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:46.864643   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:46.864647   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:46.868195   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:46.869168   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:47.363985   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:47.364006   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:47.364014   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:47.364018   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:47.367513   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:47.863715   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:47.863735   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:47.863743   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:47.863748   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:47.866941   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.364283   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:48.364304   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.364311   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.364315   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.368301   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.864297   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:48.864317   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.864326   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.864332   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.867691   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.868357   44266 node_ready.go:49] node "ha-198246-m03" has status "Ready":"True"

	I0807 18:31:48.868374   44266 node_ready.go:38] duration metric: took 17.504916336s for node "ha-198246-m03" to be "Ready" ...

	I0807 18:31:48.868382   44266 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:31:48.868439   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:48.868447   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.868454   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.868458   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.875973   44266 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0807 18:31:48.882318   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.882408   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rbnrx

	I0807 18:31:48.882420   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.882431   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.882444   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.885507   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.886130   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:48.886147   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.886156   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.886162   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.888994   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.889510   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.889528   44266 pod_ready.go:81] duration metric: took 7.186047ms for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.889537   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.889582   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-w6w6g

	I0807 18:31:48.889589   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.889596   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.889601   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.893021   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.894159   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:48.894181   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.894188   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.894192   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.896425   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.896893   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.896909   44266 pod_ready.go:81] duration metric: took 7.366231ms for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.896917   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.896961   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246

	I0807 18:31:48.896967   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.896975   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.896982   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.899237   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.899953   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:48.899970   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.899978   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.899983   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.902186   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.902691   44266 pod_ready.go:92] pod "etcd-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.902715   44266 pod_ready.go:81] duration metric: took 5.790956ms for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.902726   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.902784   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m02

	I0807 18:31:48.902795   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.902803   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.902814   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.905329   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.905806   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:48.905821   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.905828   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.905832   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.908047   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.908655   44266 pod_ready.go:92] pod "etcd-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.908670   44266 pod_ready.go:81] duration metric: took 5.936535ms for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.908678   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.064661   44266 request.go:629] Waited for 155.923893ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m03

	I0807 18:31:49.064753   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m03

	I0807 18:31:49.064759   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.064764   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.064772   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.068282   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:49.265339   44266 request.go:629] Waited for 196.371663ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:49.265425   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:49.265438   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.265449   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.265456   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.268957   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:49.269555   44266 pod_ready.go:92] pod "etcd-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:49.269571   44266 pod_ready.go:81] duration metric: took 360.885615ms for pod "etcd-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.269587   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.464819   44266 request.go:629] Waited for 195.162513ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:31:49.464903   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:31:49.464909   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.464916   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.464921   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.469362   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:49.664800   44266 request.go:629] Waited for 194.369823ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:49.664876   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:49.664881   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.664887   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.664909   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.668254   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:49.668909   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:49.668928   44266 pod_ready.go:81] duration metric: took 399.332717ms for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.668937   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.864884   44266 request.go:629] Waited for 195.895244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:31:49.864939   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:31:49.864944   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.864964   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.864968   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.868343   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.065388   44266 request.go:629] Waited for 196.362909ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:50.065438   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:50.065443   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.065450   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.065455   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.069435   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.070338   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:50.070357   44266 pod_ready.go:81] duration metric: took 401.414954ms for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.070367   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.264445   44266 request.go:629] Waited for 194.01249ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m03

	I0807 18:31:50.264517   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m03

	I0807 18:31:50.264525   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.264534   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.264540   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.268180   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.465319   44266 request.go:629] Waited for 196.408254ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:50.465387   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:50.465391   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.465398   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.465403   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.468707   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.469431   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:50.469449   44266 pod_ready.go:81] duration metric: took 399.076161ms for pod "kube-apiserver-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.469459   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.664732   44266 request.go:629] Waited for 195.186866ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:31:50.664805   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:31:50.664816   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.664827   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.664835   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.668528   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.864795   44266 request.go:629] Waited for 195.34558ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:50.864864   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:50.864871   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.864880   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.864888   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.867688   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:50.868601   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:50.868620   44266 pod_ready.go:81] duration metric: took 399.154742ms for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.868630   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.064678   44266 request.go:629] Waited for 195.987732ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:31:51.064754   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:31:51.064761   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.064772   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.064783   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.068355   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.265387   44266 request.go:629] Waited for 196.386347ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:51.265453   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:51.265460   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.265471   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.265480   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.269137   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.269661   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:51.269679   44266 pod_ready.go:81] duration metric: took 401.043609ms for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.269689   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.465093   44266 request.go:629] Waited for 195.339663ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m03

	I0807 18:31:51.465157   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m03

	I0807 18:31:51.465165   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.465174   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.465179   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.468791   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.664927   44266 request.go:629] Waited for 195.372605ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:51.664995   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:51.665006   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.665017   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.665027   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.668549   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.669363   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:51.669381   44266 pod_ready.go:81] duration metric: took 399.686225ms for pod "kube-controller-manager-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.669390   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.865256   44266 request.go:629] Waited for 195.79115ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:31:51.865313   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:31:51.865320   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.865329   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.865334   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.873470   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:31:52.064458   44266 request.go:629] Waited for 190.295419ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:52.064521   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:52.064526   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.064533   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.064538   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.067938   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.068805   44266 pod_ready.go:92] pod "kube-proxy-4l79v" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:52.068837   44266 pod_ready.go:81] duration metric: took 399.436427ms for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.068851   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-7mttr" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.264784   44266 request.go:629] Waited for 195.867102ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7mttr

	I0807 18:31:52.264838   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7mttr

	I0807 18:31:52.264843   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.264849   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.264852   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.269765   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:52.464903   44266 request.go:629] Waited for 194.439324ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:52.464972   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:52.464983   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.464993   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.465002   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.468248   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.468752   44266 pod_ready.go:92] pod "kube-proxy-7mttr" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:52.468774   44266 pod_ready.go:81] duration metric: took 399.914652ms for pod "kube-proxy-7mttr" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.468783   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.664867   44266 request.go:629] Waited for 196.022855ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:31:52.664951   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:31:52.664959   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.664973   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.664988   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.668228   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.865340   44266 request.go:629] Waited for 196.363915ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:52.865394   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:52.865399   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.865406   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.865411   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.868878   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.869535   44266 pod_ready.go:92] pod "kube-proxy-m5ng2" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:52.869556   44266 pod_ready.go:81] duration metric: took 400.766778ms for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.869565   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.064548   44266 request.go:629] Waited for 194.920878ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:31:53.064617   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:31:53.064625   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.064633   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.064640   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.068146   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.265207   44266 request.go:629] Waited for 196.43783ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:53.265255   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:53.265260   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.265267   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.265272   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.268523   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.269186   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:53.269204   44266 pod_ready.go:81] duration metric: took 399.633139ms for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.269217   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.465360   44266 request.go:629] Waited for 196.088508ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:31:53.465413   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:31:53.465418   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.465433   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.465450   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.468768   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.664761   44266 request.go:629] Waited for 195.371572ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:53.664812   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:53.664817   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.664824   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.664827   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.668421   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.669073   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:53.669096   44266 pod_ready.go:81] duration metric: took 399.871721ms for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.669110   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.865211   44266 request.go:629] Waited for 196.027374ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m03

	I0807 18:31:53.865290   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m03

	I0807 18:31:53.865298   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.865305   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.865314   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.868661   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:54.064951   44266 request.go:629] Waited for 195.756654ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:54.065010   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:54.065018   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.065027   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.065032   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.068111   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:54.068802   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:54.068820   44266 pod_ready.go:81] duration metric: took 399.702974ms for pod "kube-scheduler-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:54.068830   44266 pod_ready.go:38] duration metric: took 5.200435833s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:31:54.068843   44266 api_server.go:52] waiting for apiserver process to appear ...

	I0807 18:31:54.068887   44266 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:31:54.084598   44266 api_server.go:72] duration metric: took 22.994065627s to wait for apiserver process to appear ...

	I0807 18:31:54.084621   44266 api_server.go:88] waiting for apiserver healthz status ...

	I0807 18:31:54.084641   44266 api_server.go:253] Checking apiserver healthz at https://192.168.39.196:8443/healthz ...

	I0807 18:31:54.090716   44266 api_server.go:279] https://192.168.39.196:8443/healthz returned 200:

	ok

	I0807 18:31:54.090787   44266 round_trippers.go:463] GET https://192.168.39.196:8443/version

	I0807 18:31:54.090798   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.090908   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.090933   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.091732   44266 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0807 18:31:54.091793   44266 api_server.go:141] control plane version: v1.30.3

	I0807 18:31:54.091810   44266 api_server.go:131] duration metric: took 7.181714ms to wait for apiserver health ...

	I0807 18:31:54.091828   44266 system_pods.go:43] waiting for kube-system pods to appear ...

	I0807 18:31:54.264554   44266 request.go:629] Waited for 172.642251ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.264604   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.264611   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.264621   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.264626   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.272067   44266 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0807 18:31:54.279487   44266 system_pods.go:59] 24 kube-system pods found

	I0807 18:31:54.279517   44266 system_pods.go:61] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:31:54.279526   44266 system_pods.go:61] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:31:54.279532   44266 system_pods.go:61] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:31:54.279537   44266 system_pods.go:61] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:31:54.279542   44266 system_pods.go:61] "etcd-ha-198246-m03" [8df491af-6c48-41d6-873f-c1c39afac2f8] Running

	I0807 18:31:54.279547   44266 system_pods.go:61] "kindnet-7854s" [f87d6292-b9b6-4f63-912c-9dfda0471e2e] Running

	I0807 18:31:54.279552   44266 system_pods.go:61] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:31:54.279556   44266 system_pods.go:61] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:31:54.279562   44266 system_pods.go:61] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:31:54.279567   44266 system_pods.go:61] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:31:54.279573   44266 system_pods.go:61] "kube-apiserver-ha-198246-m03" [c589756a-dda8-44a8-82bb-60532e74eb8b] Running

	I0807 18:31:54.279581   44266 system_pods.go:61] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:31:54.279587   44266 system_pods.go:61] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:31:54.279592   44266 system_pods.go:61] "kube-controller-manager-ha-198246-m03" [5e0d97af-b071-4467-8c3a-dc71f904e84c] Running

	I0807 18:31:54.279597   44266 system_pods.go:61] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:31:54.279602   44266 system_pods.go:61] "kube-proxy-7mttr" [7cb96f6e-47a5-4d6c-a80e-77df1eafc970] Running

	I0807 18:31:54.279608   44266 system_pods.go:61] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:31:54.279616   44266 system_pods.go:61] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:31:54.279621   44266 system_pods.go:61] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:31:54.279626   44266 system_pods.go:61] "kube-scheduler-ha-198246-m03" [5fe100c3-b0a4-4499-a7e2-330c88ee8162] Running

	I0807 18:31:54.279633   44266 system_pods.go:61] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:31:54.279638   44266 system_pods.go:61] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:31:54.279643   44266 system_pods.go:61] "kube-vip-ha-198246-m03" [ba0ab294-fb6f-4161-82f7-288a2a0d4f13] Running

	I0807 18:31:54.279649   44266 system_pods.go:61] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:31:54.279657   44266 system_pods.go:74] duration metric: took 187.820696ms to wait for pod list to return data ...

	I0807 18:31:54.279670   44266 default_sa.go:34] waiting for default service account to be created ...

	I0807 18:31:54.465078   44266 request.go:629] Waited for 185.333525ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:31:54.465131   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:31:54.465136   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.465143   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.465169   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.467798   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:54.467923   44266 default_sa.go:45] found service account: "default"

	I0807 18:31:54.467940   44266 default_sa.go:55] duration metric: took 188.262232ms for default service account to be created ...

	I0807 18:31:54.467950   44266 system_pods.go:116] waiting for k8s-apps to be running ...

	I0807 18:31:54.664308   44266 request.go:629] Waited for 196.296927ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.664402   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.664413   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.664425   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.664436   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.673358   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:31:54.681646   44266 system_pods.go:86] 24 kube-system pods found

	I0807 18:31:54.681689   44266 system_pods.go:89] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:31:54.681698   44266 system_pods.go:89] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:31:54.681710   44266 system_pods.go:89] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:31:54.681722   44266 system_pods.go:89] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:31:54.681729   44266 system_pods.go:89] "etcd-ha-198246-m03" [8df491af-6c48-41d6-873f-c1c39afac2f8] Running

	I0807 18:31:54.681736   44266 system_pods.go:89] "kindnet-7854s" [f87d6292-b9b6-4f63-912c-9dfda0471e2e] Running

	I0807 18:31:54.681743   44266 system_pods.go:89] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:31:54.681760   44266 system_pods.go:89] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:31:54.681767   44266 system_pods.go:89] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:31:54.681773   44266 system_pods.go:89] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:31:54.681781   44266 system_pods.go:89] "kube-apiserver-ha-198246-m03" [c589756a-dda8-44a8-82bb-60532e74eb8b] Running

	I0807 18:31:54.681794   44266 system_pods.go:89] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:31:54.681805   44266 system_pods.go:89] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:31:54.681820   44266 system_pods.go:89] "kube-controller-manager-ha-198246-m03" [5e0d97af-b071-4467-8c3a-dc71f904e84c] Running

	I0807 18:31:54.681830   44266 system_pods.go:89] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:31:54.681838   44266 system_pods.go:89] "kube-proxy-7mttr" [7cb96f6e-47a5-4d6c-a80e-77df1eafc970] Running

	I0807 18:31:54.681848   44266 system_pods.go:89] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:31:54.682159   44266 system_pods.go:89] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:31:54.682175   44266 system_pods.go:89] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:31:54.682180   44266 system_pods.go:89] "kube-scheduler-ha-198246-m03" [5fe100c3-b0a4-4499-a7e2-330c88ee8162] Running

	I0807 18:31:54.682185   44266 system_pods.go:89] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:31:54.682188   44266 system_pods.go:89] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:31:54.682192   44266 system_pods.go:89] "kube-vip-ha-198246-m03" [ba0ab294-fb6f-4161-82f7-288a2a0d4f13] Running

	I0807 18:31:54.682196   44266 system_pods.go:89] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:31:54.682205   44266 system_pods.go:126] duration metric: took 214.246128ms to wait for k8s-apps to be running ...

	I0807 18:31:54.682217   44266 system_svc.go:44] waiting for kubelet service to be running ....

	I0807 18:31:54.682265   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:31:54.698973   44266 system_svc.go:56] duration metric: took 16.748968ms WaitForService to wait for kubelet

	I0807 18:31:54.699002   44266 kubeadm.go:582] duration metric: took 23.60847153s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 18:31:54.699020   44266 node_conditions.go:102] verifying NodePressure condition ...

	I0807 18:31:54.864327   44266 request.go:629] Waited for 165.224496ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes

	I0807 18:31:54.864388   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes

	I0807 18:31:54.864395   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.864407   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.864413   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.867905   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:54.868930   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:31:54.868950   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:31:54.868961   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:31:54.868964   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:31:54.868968   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:31:54.868971   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:31:54.868974   44266 node_conditions.go:105] duration metric: took 169.949978ms to run NodePressure ...

	I0807 18:31:54.868985   44266 start.go:241] waiting for startup goroutines ...

	I0807 18:31:54.869001   44266 start.go:255] writing updated cluster config ...

	I0807 18:31:54.869277   44266 ssh_runner.go:195] Run: rm -f paused

	I0807 18:31:54.921624   44266 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)

	I0807 18:31:54.924829   44266 out.go:177] * Done! kubectl is now configured to use "ha-198246" cluster and "default" namespace by default

	==> CRI-O <==

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.831808734Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3f821a2d-d23b-4080-99e1-cbf8a4f5e54e name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.832037588Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,PodSandboxId:4d0990efdcee83b764f38e56ae479be7f443d164067cefa10057f1576168f7c2,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1723055519101351291,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-chh26,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 42848aea-5e18-4f5c-b59d-f615d5128a74,},Annotations:map[string]string{io.kubernetes.container.hash: a6ef02f1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,PodSandboxId:a5394b2f1434ba21f4f4773555d63d3d4f295aff760fc79e94c5c175b4c8af4f,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319342376725,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-w6w6g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 143456ef-ffd1-4d42-b9d0-6b778094eca5,},Annotations:map[string]string{io.kubernetes.container.hash: 6be15b7,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"U

DP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,PodSandboxId:b57adade6ea152287caefc73242a7e723cff76836de4a80242c03abbb035bb13,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319067011712,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rbnrx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

96fa387b-f93b-40df-9ed6-78834f3d02df,},Annotations:map[string]string{io.kubernetes.container.hash: 727b5a83,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,PodSandboxId:885cc92388628d238f8733c8a4e19dbe966de1d74cae5f0b0260d47f543204eb,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING

,CreatedAt:1723055318987833300,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 88457253-9aa8-4bd7-974f-1b47b341d40c,},Annotations:map[string]string{io.kubernetes.container.hash: c688b40c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,PodSandboxId:bd5d340b4a58434695e62b4ffc8947cc9fe10963c7224febd850e872801a5ed1,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:917d7814b9b5b870a04ef7bbee5414485a7ba8385be9c26e1df27463f6fb6557,State:CON

TAINER_RUNNING,CreatedAt:1723055306768350208,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-sgl8v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 574aa453-48ef-44ff-b10a-13142fc8cf7f,},Annotations:map[string]string{io.kubernetes.container.hash: f4a4ed57,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,PodSandboxId:4aec116af531d8547d5001b805d7728adf6a1402d2f9fb4b9776f15011e8490d,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:1723055302

363392306,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4l79v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 649e12b4-4e77-48a9-af9c-691694c4ec99,},Annotations:map[string]string{io.kubernetes.container.hash: 6ac1dec9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,PodSandboxId:c3113eff4cbeab6d11557ebe28457c4fed8b799968cd7a8112552a9f26c0c7a1,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172305528372

0347825,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0f267a1609da84deb6a231872d87975b,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,PodSandboxId:1fcd84f97f1d17549fda334f2d795061561cad20b325aed47c328b7537d9e461,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1723055280599506170,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b2b91906fc54e8232161e687fc4a9af5,},Annotations:map[string]string{io.kubernetes.container.hash: 4422576b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,PodSandboxId:0e8285057cc0561c225b97a8688e2163325f9b61a96754f277a1b02818a5ef56,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1723055280563764082,Labels:map[string]string{io.kubernetes.container.name: e

tcd,io.kubernetes.pod.name: etcd-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c60b0b92792ae1d5ba11a7a2e649f612,},Annotations:map[string]string{io.kubernetes.container.hash: 51cc6761,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,PodSandboxId:7c56ff7ba09a0f2f1e24d97436a3c0bc5704d6f7f5f3d60c08c9f3cb424a6107,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1723055280588797776,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56b90546fb511b52cb0b98695e572bae,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,PodSandboxId:30588dee2a435159b1676038c3a1e71d8e794c98f645bd6032392139ac087781,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1723055280520038813,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b12d62604f0b70faa552e6c44d8cd532,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3f821a2d-d23b-4080-99e1-cbf8a4f5e54e name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.871622234Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=c2a82338-7f10-48f2-b9e5-bbb45e4eb388 name=/runtime.v1.RuntimeService/Version

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.871696208Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=c2a82338-7f10-48f2-b9e5-bbb45e4eb388 name=/runtime.v1.RuntimeService/Version

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.873015829Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=41a4b20e-d479-4d14-a924-c7e1d2985925 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.873536962Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1723055761873509407,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154770,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=41a4b20e-d479-4d14-a924-c7e1d2985925 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.874196608Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=3178da30-3df4-42c1-97c1-d04aed2aa6e6 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.874249256Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3178da30-3df4-42c1-97c1-d04aed2aa6e6 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.874560348Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,PodSandboxId:4d0990efdcee83b764f38e56ae479be7f443d164067cefa10057f1576168f7c2,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1723055519101351291,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-chh26,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 42848aea-5e18-4f5c-b59d-f615d5128a74,},Annotations:map[string]string{io.kubernetes.container.hash: a6ef02f1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,PodSandboxId:a5394b2f1434ba21f4f4773555d63d3d4f295aff760fc79e94c5c175b4c8af4f,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319342376725,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-w6w6g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 143456ef-ffd1-4d42-b9d0-6b778094eca5,},Annotations:map[string]string{io.kubernetes.container.hash: 6be15b7,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"U

DP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,PodSandboxId:b57adade6ea152287caefc73242a7e723cff76836de4a80242c03abbb035bb13,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319067011712,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rbnrx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

96fa387b-f93b-40df-9ed6-78834f3d02df,},Annotations:map[string]string{io.kubernetes.container.hash: 727b5a83,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,PodSandboxId:885cc92388628d238f8733c8a4e19dbe966de1d74cae5f0b0260d47f543204eb,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING

,CreatedAt:1723055318987833300,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 88457253-9aa8-4bd7-974f-1b47b341d40c,},Annotations:map[string]string{io.kubernetes.container.hash: c688b40c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,PodSandboxId:bd5d340b4a58434695e62b4ffc8947cc9fe10963c7224febd850e872801a5ed1,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:917d7814b9b5b870a04ef7bbee5414485a7ba8385be9c26e1df27463f6fb6557,State:CON

TAINER_RUNNING,CreatedAt:1723055306768350208,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-sgl8v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 574aa453-48ef-44ff-b10a-13142fc8cf7f,},Annotations:map[string]string{io.kubernetes.container.hash: f4a4ed57,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,PodSandboxId:4aec116af531d8547d5001b805d7728adf6a1402d2f9fb4b9776f15011e8490d,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:1723055302

363392306,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4l79v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 649e12b4-4e77-48a9-af9c-691694c4ec99,},Annotations:map[string]string{io.kubernetes.container.hash: 6ac1dec9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,PodSandboxId:c3113eff4cbeab6d11557ebe28457c4fed8b799968cd7a8112552a9f26c0c7a1,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172305528372

0347825,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0f267a1609da84deb6a231872d87975b,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,PodSandboxId:1fcd84f97f1d17549fda334f2d795061561cad20b325aed47c328b7537d9e461,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1723055280599506170,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b2b91906fc54e8232161e687fc4a9af5,},Annotations:map[string]string{io.kubernetes.container.hash: 4422576b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,PodSandboxId:0e8285057cc0561c225b97a8688e2163325f9b61a96754f277a1b02818a5ef56,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1723055280563764082,Labels:map[string]string{io.kubernetes.container.name: e

tcd,io.kubernetes.pod.name: etcd-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c60b0b92792ae1d5ba11a7a2e649f612,},Annotations:map[string]string{io.kubernetes.container.hash: 51cc6761,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,PodSandboxId:7c56ff7ba09a0f2f1e24d97436a3c0bc5704d6f7f5f3d60c08c9f3cb424a6107,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1723055280588797776,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56b90546fb511b52cb0b98695e572bae,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,PodSandboxId:30588dee2a435159b1676038c3a1e71d8e794c98f645bd6032392139ac087781,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1723055280520038813,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b12d62604f0b70faa552e6c44d8cd532,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3178da30-3df4-42c1-97c1-d04aed2aa6e6 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.912298039Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=80187ddf-7726-42c1-b0a8-6d02ba51faae name=/runtime.v1.RuntimeService/Version

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.912372568Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=80187ddf-7726-42c1-b0a8-6d02ba51faae name=/runtime.v1.RuntimeService/Version

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.914290844Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=8a0ceaff-c77d-4062-9539-12849746a133 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.915504751Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1723055761915422259,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154770,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=8a0ceaff-c77d-4062-9539-12849746a133 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.916005464Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=0b3b5b92-023d-40da-b76e-0a43591a0d9b name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.916057673Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=0b3b5b92-023d-40da-b76e-0a43591a0d9b name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.916553689Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,PodSandboxId:4d0990efdcee83b764f38e56ae479be7f443d164067cefa10057f1576168f7c2,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1723055519101351291,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-chh26,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 42848aea-5e18-4f5c-b59d-f615d5128a74,},Annotations:map[string]string{io.kubernetes.container.hash: a6ef02f1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,PodSandboxId:a5394b2f1434ba21f4f4773555d63d3d4f295aff760fc79e94c5c175b4c8af4f,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319342376725,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-w6w6g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 143456ef-ffd1-4d42-b9d0-6b778094eca5,},Annotations:map[string]string{io.kubernetes.container.hash: 6be15b7,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"U

DP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,PodSandboxId:b57adade6ea152287caefc73242a7e723cff76836de4a80242c03abbb035bb13,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319067011712,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rbnrx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

96fa387b-f93b-40df-9ed6-78834f3d02df,},Annotations:map[string]string{io.kubernetes.container.hash: 727b5a83,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,PodSandboxId:885cc92388628d238f8733c8a4e19dbe966de1d74cae5f0b0260d47f543204eb,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING

,CreatedAt:1723055318987833300,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 88457253-9aa8-4bd7-974f-1b47b341d40c,},Annotations:map[string]string{io.kubernetes.container.hash: c688b40c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,PodSandboxId:bd5d340b4a58434695e62b4ffc8947cc9fe10963c7224febd850e872801a5ed1,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:917d7814b9b5b870a04ef7bbee5414485a7ba8385be9c26e1df27463f6fb6557,State:CON

TAINER_RUNNING,CreatedAt:1723055306768350208,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-sgl8v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 574aa453-48ef-44ff-b10a-13142fc8cf7f,},Annotations:map[string]string{io.kubernetes.container.hash: f4a4ed57,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,PodSandboxId:4aec116af531d8547d5001b805d7728adf6a1402d2f9fb4b9776f15011e8490d,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:1723055302

363392306,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4l79v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 649e12b4-4e77-48a9-af9c-691694c4ec99,},Annotations:map[string]string{io.kubernetes.container.hash: 6ac1dec9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,PodSandboxId:c3113eff4cbeab6d11557ebe28457c4fed8b799968cd7a8112552a9f26c0c7a1,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172305528372

0347825,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0f267a1609da84deb6a231872d87975b,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,PodSandboxId:1fcd84f97f1d17549fda334f2d795061561cad20b325aed47c328b7537d9e461,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1723055280599506170,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b2b91906fc54e8232161e687fc4a9af5,},Annotations:map[string]string{io.kubernetes.container.hash: 4422576b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,PodSandboxId:0e8285057cc0561c225b97a8688e2163325f9b61a96754f277a1b02818a5ef56,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1723055280563764082,Labels:map[string]string{io.kubernetes.container.name: e

tcd,io.kubernetes.pod.name: etcd-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c60b0b92792ae1d5ba11a7a2e649f612,},Annotations:map[string]string{io.kubernetes.container.hash: 51cc6761,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,PodSandboxId:7c56ff7ba09a0f2f1e24d97436a3c0bc5704d6f7f5f3d60c08c9f3cb424a6107,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1723055280588797776,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56b90546fb511b52cb0b98695e572bae,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,PodSandboxId:30588dee2a435159b1676038c3a1e71d8e794c98f645bd6032392139ac087781,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1723055280520038813,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b12d62604f0b70faa552e6c44d8cd532,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=0b3b5b92-023d-40da-b76e-0a43591a0d9b name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.949734274Z" level=debug msg="Request: &StatusRequest{Verbose:false,}" file="otel-collector/interceptors.go:62" id=b37eb974-3653-4b4a-af4e-369dde91fe8d name=/runtime.v1.RuntimeService/Status

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.949812728Z" level=debug msg="Response: &StatusResponse{Status:&RuntimeStatus{Conditions:[]*RuntimeCondition{&RuntimeCondition{Type:RuntimeReady,Status:true,Reason:,Message:,},&RuntimeCondition{Type:NetworkReady,Status:true,Reason:,Message:,},},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=b37eb974-3653-4b4a-af4e-369dde91fe8d name=/runtime.v1.RuntimeService/Status

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.955914414Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=e0e81d24-317d-4a4a-b892-3a32f774b721 name=/runtime.v1.RuntimeService/Version

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.956006092Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=e0e81d24-317d-4a4a-b892-3a32f774b721 name=/runtime.v1.RuntimeService/Version

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.957320693Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=e64d7bff-f191-45da-bb9e-36e0fb1f7e67 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.957827455Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1723055761957797732,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154770,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=e64d7bff-f191-45da-bb9e-36e0fb1f7e67 name=/runtime.v1.ImageService/ImageFsInfo

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.958553632Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=1f876fea-c4f6-4904-be4a-8b2351410703 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.958608025Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=1f876fea-c4f6-4904-be4a-8b2351410703 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:36:01 ha-198246 crio[680]: time="2024-08-07 18:36:01.958855996Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,PodSandboxId:4d0990efdcee83b764f38e56ae479be7f443d164067cefa10057f1576168f7c2,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1723055519101351291,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-chh26,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 42848aea-5e18-4f5c-b59d-f615d5128a74,},Annotations:map[string]string{io.kubernetes.container.hash: a6ef02f1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,PodSandboxId:a5394b2f1434ba21f4f4773555d63d3d4f295aff760fc79e94c5c175b4c8af4f,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319342376725,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-w6w6g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 143456ef-ffd1-4d42-b9d0-6b778094eca5,},Annotations:map[string]string{io.kubernetes.container.hash: 6be15b7,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"U

DP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,PodSandboxId:b57adade6ea152287caefc73242a7e723cff76836de4a80242c03abbb035bb13,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319067011712,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rbnrx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

96fa387b-f93b-40df-9ed6-78834f3d02df,},Annotations:map[string]string{io.kubernetes.container.hash: 727b5a83,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,PodSandboxId:885cc92388628d238f8733c8a4e19dbe966de1d74cae5f0b0260d47f543204eb,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING

,CreatedAt:1723055318987833300,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 88457253-9aa8-4bd7-974f-1b47b341d40c,},Annotations:map[string]string{io.kubernetes.container.hash: c688b40c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,PodSandboxId:bd5d340b4a58434695e62b4ffc8947cc9fe10963c7224febd850e872801a5ed1,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:917d7814b9b5b870a04ef7bbee5414485a7ba8385be9c26e1df27463f6fb6557,State:CON

TAINER_RUNNING,CreatedAt:1723055306768350208,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-sgl8v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 574aa453-48ef-44ff-b10a-13142fc8cf7f,},Annotations:map[string]string{io.kubernetes.container.hash: f4a4ed57,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,PodSandboxId:4aec116af531d8547d5001b805d7728adf6a1402d2f9fb4b9776f15011e8490d,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:1723055302

363392306,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4l79v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 649e12b4-4e77-48a9-af9c-691694c4ec99,},Annotations:map[string]string{io.kubernetes.container.hash: 6ac1dec9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,PodSandboxId:c3113eff4cbeab6d11557ebe28457c4fed8b799968cd7a8112552a9f26c0c7a1,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172305528372

0347825,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0f267a1609da84deb6a231872d87975b,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,PodSandboxId:1fcd84f97f1d17549fda334f2d795061561cad20b325aed47c328b7537d9e461,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1723055280599506170,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b2b91906fc54e8232161e687fc4a9af5,},Annotations:map[string]string{io.kubernetes.container.hash: 4422576b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,PodSandboxId:0e8285057cc0561c225b97a8688e2163325f9b61a96754f277a1b02818a5ef56,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1723055280563764082,Labels:map[string]string{io.kubernetes.container.name: e

tcd,io.kubernetes.pod.name: etcd-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c60b0b92792ae1d5ba11a7a2e649f612,},Annotations:map[string]string{io.kubernetes.container.hash: 51cc6761,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,PodSandboxId:7c56ff7ba09a0f2f1e24d97436a3c0bc5704d6f7f5f3d60c08c9f3cb424a6107,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1723055280588797776,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56b90546fb511b52cb0b98695e572bae,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,PodSandboxId:30588dee2a435159b1676038c3a1e71d8e794c98f645bd6032392139ac087781,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1723055280520038813,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b12d62604f0b70faa552e6c44d8cd532,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=1f876fea-c4f6-4904-be4a-8b2351410703 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	80335e9819afd       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   4 minutes ago       Running             busybox                   0                   4d0990efdcee8       busybox-fc5497c4f-chh26

	806c3ba54cd9b       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      7 minutes ago       Running             coredns                   0                   a5394b2f1434b       coredns-7db6d8ff4d-w6w6g

	3f9784c457acb       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      7 minutes ago       Running             coredns                   0                   b57adade6ea15       coredns-7db6d8ff4d-rbnrx

	93fcff9b17b4b       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      7 minutes ago       Running             storage-provisioner       0                   885cc92388628       storage-provisioner

	5433090bdddca       docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3    7 minutes ago       Running             kindnet-cni               0                   bd5d340b4a584       kindnet-sgl8v

	c6c6220e1a7fb       55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1                                      7 minutes ago       Running             kube-proxy                0                   4aec116af531d       kube-proxy-4l79v

	305290711d544       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     7 minutes ago       Running             kube-vip                  0                   c3113eff4cbea       kube-vip-ha-198246

	4902df4367b62       1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d                                      8 minutes ago       Running             kube-apiserver            0                   1fcd84f97f1d1       kube-apiserver-ha-198246

	2ff4075c05c48       3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2                                      8 minutes ago       Running             kube-scheduler            0                   7c56ff7ba09a0       kube-scheduler-ha-198246

	981dfd0662596       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      8 minutes ago       Running             etcd                      0                   0e8285057cc05       etcd-ha-198246

	6c84edcc5a98f       76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e                                      8 minutes ago       Running             kube-controller-manager   0                   30588dee2a435       kube-controller-manager-ha-198246

	==> coredns [3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7] <==

	[INFO] 10.244.1.2:60491 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000238403s

	[INFO] 10.244.1.2:56734 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000110021s

	[INFO] 10.244.0.4:60444 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000100154s

	[INFO] 10.244.0.4:54868 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00007045s

	[INFO] 10.244.0.4:55542 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001278843s

	[INFO] 10.244.0.4:41062 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000090569s

	[INFO] 10.244.0.4:45221 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000159605s

	[INFO] 10.244.0.4:52919 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00008416s

	[INFO] 10.244.2.2:57336 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001947478s

	[INFO] 10.244.2.2:58778 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000148421s

	[INFO] 10.244.2.2:40534 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000094901s

	[INFO] 10.244.2.2:34562 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001435891s

	[INFO] 10.244.2.2:40255 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000066647s

	[INFO] 10.244.2.2:33303 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000074642s

	[INFO] 10.244.2.2:54865 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000065816s

	[INFO] 10.244.1.2:56362 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135028s

	[INFO] 10.244.1.2:50486 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000103508s

	[INFO] 10.244.0.4:60915 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000079398s

	[INFO] 10.244.2.2:36331 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000189607s

	[INFO] 10.244.1.2:44020 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000226665s

	[INFO] 10.244.1.2:47459 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000129465s

	[INFO] 10.244.0.4:59992 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000059798s

	[INFO] 10.244.0.4:55811 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000139124s

	[INFO] 10.244.2.2:42718 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132316s

	[INFO] 10.244.2.2:34338 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000147334s

	==> coredns [806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab] <==

	[INFO] 10.244.0.4:54342 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.000106253s

	[INFO] 10.244.2.2:37220 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.00009521s

	[INFO] 10.244.2.2:40447 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.001945707s

	[INFO] 10.244.2.2:46546 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.003736918s

	[INFO] 10.244.1.2:40239 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000121833s

	[INFO] 10.244.1.2:39185 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003274854s

	[INFO] 10.244.1.2:32995 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000301562s

	[INFO] 10.244.1.2:57764 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00324711s

	[INFO] 10.244.0.4:43175 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001969935s

	[INFO] 10.244.0.4:47947 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000090373s

	[INFO] 10.244.2.2:59435 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000185691s

	[INFO] 10.244.1.2:41342 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000215074s

	[INFO] 10.244.1.2:58323 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000133762s

	[INFO] 10.244.0.4:48395 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000131554s

	[INFO] 10.244.0.4:33157 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000121525s

	[INFO] 10.244.0.4:53506 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000084053s

	[INFO] 10.244.2.2:47826 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000205944s

	[INFO] 10.244.2.2:43418 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000113361s

	[INFO] 10.244.2.2:53197 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000103281s

	[INFO] 10.244.1.2:51874 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.0001263s

	[INFO] 10.244.1.2:40094 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000205313s

	[INFO] 10.244.0.4:55591 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.0001033s

	[INFO] 10.244.0.4:41281 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000083191s

	[INFO] 10.244.2.2:52214 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000093799s

	[INFO] 10.244.2.2:55578 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000146065s

	==> describe nodes <==

	Name:               ha-198246

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_07T18_28_07_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:28:04 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:35:54 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:03 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:03 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:03 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:38 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.196

	  Hostname:    ha-198246

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 e31604902e0745d1a1407795d2ccbfc0

	  System UUID:                e3160490-2e07-45d1-a140-7795d2ccbfc0

	  Boot ID:                    9b0f1850-84af-432c-85c0-f24cda670347

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-chh26              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m7s

	  kube-system                 coredns-7db6d8ff4d-rbnrx             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     7m42s

	  kube-system                 coredns-7db6d8ff4d-w6w6g             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     7m42s

	  kube-system                 etcd-ha-198246                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         7m58s

	  kube-system                 kindnet-sgl8v                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      7m42s

	  kube-system                 kube-apiserver-ha-198246             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m56s

	  kube-system                 kube-controller-manager-ha-198246    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m56s

	  kube-system                 kube-proxy-4l79v                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m42s

	  kube-system                 kube-scheduler-ha-198246             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m56s

	  kube-system                 kube-vip-ha-198246                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m58s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m41s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 7m39s  kube-proxy       

	  Normal  Starting                 7m56s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  7m56s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  7m56s  kubelet          Node ha-198246 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m56s  kubelet          Node ha-198246 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     7m56s  kubelet          Node ha-198246 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           7m42s  node-controller  Node ha-198246 event: Registered Node ha-198246 in Controller

	  Normal  NodeReady                7m24s  kubelet          Node ha-198246 status is now: NodeReady

	  Normal  RegisteredNode           5m37s  node-controller  Node ha-198246 event: Registered Node ha-198246 in Controller

	  Normal  RegisteredNode           4m18s  node-controller  Node ha-198246 event: Registered Node ha-198246 in Controller

	Name:               ha-198246-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_07T18_30_10_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:30:07 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246-m02

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:33:31 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.251

	  Hostname:    ha-198246-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 b8eadf45fa3a45c1ace8b37287f97c9d

	  System UUID:                b8eadf45-fa3a-45c1-ace8-b37287f97c9d

	  Boot ID:                    7900c294-c092-44a8-b18b-e0879a5b10ab

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-8g62d                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m7s

	  kube-system                 etcd-ha-198246-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m53s

	  kube-system                 kindnet-8x6fj                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m55s

	  kube-system                 kube-apiserver-ha-198246-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m53s

	  kube-system                 kube-controller-manager-ha-198246-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m49s

	  kube-system                 kube-proxy-m5ng2                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m55s

	  kube-system                 kube-scheduler-ha-198246-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m48s

	  kube-system                 kube-vip-ha-198246-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m50s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m50s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  5m55s (x8 over 5m55s)  kubelet          Node ha-198246-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m55s (x8 over 5m55s)  kubelet          Node ha-198246-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m55s (x7 over 5m55s)  kubelet          Node ha-198246-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5m55s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           5m52s                  node-controller  Node ha-198246-m02 event: Registered Node ha-198246-m02 in Controller

	  Normal  RegisteredNode           5m37s                  node-controller  Node ha-198246-m02 event: Registered Node ha-198246-m02 in Controller

	  Normal  RegisteredNode           4m18s                  node-controller  Node ha-198246-m02 event: Registered Node ha-198246-m02 in Controller

	  Normal  NodeNotReady             108s                   node-controller  Node ha-198246-m02 status is now: NodeNotReady

	Name:               ha-198246-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_07T18_31_30_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:31:26 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246-m03

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:35:52 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:26 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:26 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:26 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:48 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.227

	  Hostname:    ha-198246-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 60409ac81f5346078f5f2d7599678540

	  System UUID:                60409ac8-1f53-4607-8f5f-2d7599678540

	  Boot ID:                    30ed0e62-43cd-4d25-85c3-6ffd341eb52a

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-k2t25                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m7s

	  kube-system                 etcd-ha-198246-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m34s

	  kube-system                 kindnet-7854s                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m36s

	  kube-system                 kube-apiserver-ha-198246-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m34s

	  kube-system                 kube-controller-manager-ha-198246-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m31s

	  kube-system                 kube-proxy-7mttr                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m36s

	  kube-system                 kube-scheduler-ha-198246-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m27s

	  kube-system                 kube-vip-ha-198246-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m31s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m30s                  kube-proxy       

	  Normal  NodeHasSufficientPID     4m36s (x7 over 4m36s)  kubelet          Node ha-198246-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m36s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  4m35s (x8 over 4m36s)  kubelet          Node ha-198246-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m35s (x8 over 4m36s)  kubelet          Node ha-198246-m03 status is now: NodeHasNoDiskPressure

	  Normal  RegisteredNode           4m32s                  node-controller  Node ha-198246-m03 event: Registered Node ha-198246-m03 in Controller

	  Normal  RegisteredNode           4m32s                  node-controller  Node ha-198246-m03 event: Registered Node ha-198246-m03 in Controller

	  Normal  RegisteredNode           4m18s                  node-controller  Node ha-198246-m03 event: Registered Node ha-198246-m03 in Controller

	Name:               ha-198246-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_07T18_32_32_0700

	                    minikube.k8s.io/version=v1.33.1

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:32:32 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246-m04

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:35:56 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:32:32 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:32:32 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:32:32 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:33:21 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.150

	  Hostname:    ha-198246-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 e050b6016e8b45679acbdd2b5c7bde62

	  System UUID:                e050b601-6e8b-4567-9acb-dd2b5c7bde62

	  Boot ID:                    3b3e9caf-949c-417a-90da-edc98697cdac

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-5vj44       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m30s

	  kube-system                 kube-proxy-5ggpl    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m26s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m20s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  3m30s (x2 over 3m30s)  kubelet          Node ha-198246-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m30s (x2 over 3m30s)  kubelet          Node ha-198246-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m30s (x2 over 3m30s)  kubelet          Node ha-198246-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m30s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m28s                  node-controller  Node ha-198246-m04 event: Registered Node ha-198246-m04 in Controller

	  Normal  RegisteredNode           3m27s                  node-controller  Node ha-198246-m04 event: Registered Node ha-198246-m04 in Controller

	  Normal  RegisteredNode           3m27s                  node-controller  Node ha-198246-m04 event: Registered Node ha-198246-m04 in Controller

	  Normal  NodeReady                2m41s                  kubelet          Node ha-198246-m04 status is now: NodeReady

	==> dmesg <==

	[Aug 7 18:27] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050670] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.040191] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.791892] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.561405] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.603000] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000015] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[ +12.529902] systemd-fstab-generator[597]: Ignoring "noauto" option for root device

	[  +0.057949] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.071605] systemd-fstab-generator[609]: Ignoring "noauto" option for root device

	[  +0.183672] systemd-fstab-generator[623]: Ignoring "noauto" option for root device

	[  +0.110780] systemd-fstab-generator[635]: Ignoring "noauto" option for root device

	[  +0.300871] systemd-fstab-generator[665]: Ignoring "noauto" option for root device

	[  +4.248154] systemd-fstab-generator[764]: Ignoring "noauto" option for root device

	[  +4.501138] systemd-fstab-generator[945]: Ignoring "noauto" option for root device

	[  +0.062750] kauditd_printk_skb: 158 callbacks suppressed

	[Aug 7 18:28] systemd-fstab-generator[1363]: Ignoring "noauto" option for root device

	[  +0.095778] kauditd_printk_skb: 79 callbacks suppressed

	[ +15.277376] kauditd_printk_skb: 21 callbacks suppressed

	[  +5.193932] kauditd_printk_skb: 29 callbacks suppressed

	[Aug 7 18:30] kauditd_printk_skb: 24 callbacks suppressed

	==> etcd [981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5] <==

	{"level":"warn","ts":"2024-08-07T18:36:02.300601Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.312879Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.323028Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.329567Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.333644Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.340386Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.344385Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.351961Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.360025Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.36382Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.366965Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.377064Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.384615Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.391428Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.396189Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.399383Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.406396Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.420327Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.424785Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.440706Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.443085Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.455405Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.460725Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.488994Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:36:02.540651Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 18:36:02 up 8 min,  0 users,  load average: 0.33, 0.29, 0.17

	Linux ha-198246 5.10.207 #1 SMP Mon Jul 29 15:19:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554] <==

	I0807 18:35:28.091126       1 main.go:299] handling current node

	I0807 18:35:38.097627       1 main.go:295] Handling node with IPs: map[192.168.39.227:{}]

	I0807 18:35:38.098595       1 main.go:322] Node ha-198246-m03 has CIDR [10.244.2.0/24] 

	I0807 18:35:38.098913       1 main.go:295] Handling node with IPs: map[192.168.39.150:{}]

	I0807 18:35:38.099278       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	I0807 18:35:38.099617       1 main.go:295] Handling node with IPs: map[192.168.39.196:{}]

	I0807 18:35:38.099683       1 main.go:299] handling current node

	I0807 18:35:38.099730       1 main.go:295] Handling node with IPs: map[192.168.39.251:{}]

	I0807 18:35:38.099757       1 main.go:322] Node ha-198246-m02 has CIDR [10.244.1.0/24] 

	I0807 18:35:48.100006       1 main.go:295] Handling node with IPs: map[192.168.39.251:{}]

	I0807 18:35:48.100068       1 main.go:322] Node ha-198246-m02 has CIDR [10.244.1.0/24] 

	I0807 18:35:48.100219       1 main.go:295] Handling node with IPs: map[192.168.39.227:{}]

	I0807 18:35:48.100245       1 main.go:322] Node ha-198246-m03 has CIDR [10.244.2.0/24] 

	I0807 18:35:48.100312       1 main.go:295] Handling node with IPs: map[192.168.39.150:{}]

	I0807 18:35:48.100318       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	I0807 18:35:48.100371       1 main.go:295] Handling node with IPs: map[192.168.39.196:{}]

	I0807 18:35:48.100377       1 main.go:299] handling current node

	I0807 18:35:58.090836       1 main.go:295] Handling node with IPs: map[192.168.39.196:{}]

	I0807 18:35:58.090977       1 main.go:299] handling current node

	I0807 18:35:58.091007       1 main.go:295] Handling node with IPs: map[192.168.39.251:{}]

	I0807 18:35:58.091026       1 main.go:322] Node ha-198246-m02 has CIDR [10.244.1.0/24] 

	I0807 18:35:58.091175       1 main.go:295] Handling node with IPs: map[192.168.39.227:{}]

	I0807 18:35:58.091196       1 main.go:322] Node ha-198246-m03 has CIDR [10.244.2.0/24] 

	I0807 18:35:58.091280       1 main.go:295] Handling node with IPs: map[192.168.39.150:{}]

	I0807 18:35:58.091299       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473] <==

	I0807 18:28:05.757651       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0807 18:28:05.765720       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.196]

	I0807 18:28:05.766882       1 controller.go:615] quota admission added evaluator for: endpoints

	I0807 18:28:05.772395       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0807 18:28:05.830060       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0807 18:28:06.776266       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0807 18:28:06.809546       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0807 18:28:06.821673       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0807 18:28:20.248559       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0807 18:28:20.348011       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	E0807 18:32:00.535866       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57744: use of closed network connection

	E0807 18:32:00.744066       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57766: use of closed network connection

	E0807 18:32:00.952672       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57792: use of closed network connection

	E0807 18:32:01.172355       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57812: use of closed network connection

	E0807 18:32:01.352150       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57828: use of closed network connection

	E0807 18:32:01.532194       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57846: use of closed network connection

	E0807 18:32:01.714325       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57860: use of closed network connection

	E0807 18:32:01.900647       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57872: use of closed network connection

	E0807 18:32:02.087553       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57896: use of closed network connection

	E0807 18:32:02.383817       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57920: use of closed network connection

	E0807 18:32:02.568053       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57936: use of closed network connection

	E0807 18:32:02.768857       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57942: use of closed network connection

	E0807 18:32:02.971250       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57960: use of closed network connection

	E0807 18:32:03.156171       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57992: use of closed network connection

	E0807 18:32:03.335581       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58008: use of closed network connection

	==> kube-controller-manager [6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36] <==

	I0807 18:31:30.326416       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-198246-m03"

	I0807 18:31:55.863780       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="90.509454ms"

	I0807 18:31:55.909903       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.038129ms"

	I0807 18:31:56.006853       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="96.823451ms"

	I0807 18:31:56.148782       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="141.712519ms"

	I0807 18:31:56.149891       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="322.281µs"

	I0807 18:31:56.191596       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="41.550452ms"

	I0807 18:31:56.191748       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="81.564µs"

	I0807 18:31:56.760379       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.592µs"

	I0807 18:31:56.902720       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="44.37µs"

	I0807 18:31:57.234083       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="85.456µs"

	I0807 18:31:59.698073       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="12.032139ms"

	I0807 18:31:59.698278       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.373µs"

	I0807 18:31:59.804042       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="40.215774ms"

	I0807 18:31:59.804158       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="66.476µs"

	I0807 18:32:00.080762       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="12.328982ms"

	I0807 18:32:00.082206       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="43.736µs"

	E0807 18:32:32.063101       1 certificate_controller.go:146] Sync csr-btqqk failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-btqqk": the object has been modified; please apply your changes to the latest version and try again

	I0807 18:32:32.310340       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-198246-m04\" does not exist"

	I0807 18:32:32.379172       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-198246-m04" podCIDRs=["10.244.3.0/24"]

	I0807 18:32:35.352861       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-198246-m04"

	I0807 18:33:21.056413       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-198246-m04"

	I0807 18:34:14.817275       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-198246-m04"

	I0807 18:34:14.871985       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="10.917944ms"

	I0807 18:34:14.873327       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="44.625µs"

	==> kube-proxy [c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8] <==

	I0807 18:28:22.580618       1 server_linux.go:69] "Using iptables proxy"

	I0807 18:28:22.601637       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.196"]

	I0807 18:28:22.654297       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0807 18:28:22.654381       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0807 18:28:22.654403       1 server_linux.go:165] "Using iptables Proxier"

	I0807 18:28:22.658197       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0807 18:28:22.658748       1 server.go:872] "Version info" version="v1.30.3"

	I0807 18:28:22.658783       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0807 18:28:22.661148       1 config.go:192] "Starting service config controller"

	I0807 18:28:22.661385       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0807 18:28:22.661502       1 config.go:101] "Starting endpoint slice config controller"

	I0807 18:28:22.661508       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0807 18:28:22.662750       1 config.go:319] "Starting node config controller"

	I0807 18:28:22.662780       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0807 18:28:22.761662       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0807 18:28:22.761768       1 shared_informer.go:320] Caches are synced for service config

	I0807 18:28:22.763105       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56] <==

	E0807 18:28:05.163012       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0807 18:28:05.164577       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0807 18:28:05.164616       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0807 18:28:05.283884       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0807 18:28:05.283932       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0807 18:28:05.320413       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0807 18:28:05.320504       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0807 18:28:05.373610       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0807 18:28:05.373694       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	I0807 18:28:06.678552       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0807 18:32:32.502898       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-z8cdn\": pod kindnet-z8cdn is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-z8cdn" node="ha-198246-m04"

	E0807 18:32:32.503513       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod bc6ed049-d9fb-4132-b192-8015240cb919(kube-system/kindnet-z8cdn) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-z8cdn"

	E0807 18:32:32.503593       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-z8cdn\": pod kindnet-z8cdn is already assigned to node \"ha-198246-m04\"" pod="kube-system/kindnet-z8cdn"

	I0807 18:32:32.503644       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-z8cdn" node="ha-198246-m04"

	E0807 18:32:32.551938       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-cv65q\": pod kube-proxy-cv65q is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-cv65q" node="ha-198246-m04"

	E0807 18:32:32.553290       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-cv65q\": pod kube-proxy-cv65q is already assigned to node \"ha-198246-m04\"" pod="kube-system/kube-proxy-cv65q"

	E0807 18:32:32.556989       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-vndzm\": pod kindnet-vndzm is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-vndzm" node="ha-198246-m04"

	E0807 18:32:32.557081       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-vndzm\": pod kindnet-vndzm is already assigned to node \"ha-198246-m04\"" pod="kube-system/kindnet-vndzm"

	E0807 18:32:36.244172       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-5ggpl\": pod kube-proxy-5ggpl is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-5ggpl" node="ha-198246-m04"

	E0807 18:32:36.244315       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 2ed71e43-edd6-4262-a1ed-a3232e717574(kube-system/kube-proxy-5ggpl) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-5ggpl"

	E0807 18:32:36.244399       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-5ggpl\": pod kube-proxy-5ggpl is already assigned to node \"ha-198246-m04\"" pod="kube-system/kube-proxy-5ggpl"

	I0807 18:32:36.245064       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-5ggpl" node="ha-198246-m04"

	E0807 18:32:36.281841       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-tdszb\": pod kube-proxy-tdszb is being deleted, cannot be assigned to a host" plugin="DefaultBinder" pod="kube-system/kube-proxy-tdszb" node="ha-198246-m04"

	E0807 18:32:36.281939       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-tdszb\": pod kube-proxy-tdszb is being deleted, cannot be assigned to a host" pod="kube-system/kube-proxy-tdszb"

	E0807 18:32:36.330630       1 schedule_one.go:1095] "Error updating pod" err="pods \"kube-proxy-tdszb\" not found" pod="kube-system/kube-proxy-tdszb"

	==> kubelet <==

	Aug 07 18:31:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:31:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:31:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:31:55 ha-198246 kubelet[1372]: I0807 18:31:55.870940    1372 topology_manager.go:215] "Topology Admit Handler" podUID="42848aea-5e18-4f5c-b59d-f615d5128a74" podNamespace="default" podName="busybox-fc5497c4f-chh26"

	Aug 07 18:31:55 ha-198246 kubelet[1372]: I0807 18:31:55.995681    1372 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdsts\" (UniqueName: \"kubernetes.io/projected/42848aea-5e18-4f5c-b59d-f615d5128a74-kube-api-access-mdsts\") pod \"busybox-fc5497c4f-chh26\" (UID: \"42848aea-5e18-4f5c-b59d-f615d5128a74\") " pod="default/busybox-fc5497c4f-chh26"

	Aug 07 18:32:06 ha-198246 kubelet[1372]: E0807 18:32:06.768650    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:32:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:32:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:32:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:32:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:33:06 ha-198246 kubelet[1372]: E0807 18:33:06.768553    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:33:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:33:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:33:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:33:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:34:06 ha-198246 kubelet[1372]: E0807 18:34:06.758391    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:34:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:34:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:34:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:34:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:35:06 ha-198246 kubelet[1372]: E0807 18:35:06.757102    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:35:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:35:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:35:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:35:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-198246 -n ha-198246

helpers_test.go:261: (dbg) Run:  kubectl --context ha-198246 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (142.09s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 node start m02 -v=7 --alsologtostderr

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (3.192257422s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:07.145309   49432 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:07.145590   49432 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:07.145601   49432 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:07.145607   49432 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:07.145836   49432 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:07.146028   49432 out.go:298] Setting JSON to false

	I0807 18:36:07.146057   49432 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:07.146161   49432 notify.go:220] Checking for updates...

	I0807 18:36:07.146470   49432 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:07.146486   49432 status.go:255] checking status of ha-198246 ...

	I0807 18:36:07.146902   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:07.146964   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:07.165088   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38645

	I0807 18:36:07.165597   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:07.166153   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:07.166172   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:07.166559   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:07.166753   49432 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:07.168475   49432 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:07.168489   49432 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:07.168810   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:07.168867   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:07.184293   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34089

	I0807 18:36:07.184792   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:07.185322   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:07.185345   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:07.185637   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:07.185915   49432 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:07.189611   49432 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:07.190150   49432 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:07.190184   49432 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:07.190326   49432 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:07.190666   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:07.190707   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:07.206275   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35897

	I0807 18:36:07.206729   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:07.207301   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:07.207344   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:07.207666   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:07.207845   49432 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:07.208158   49432 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:07.208185   49432 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:07.212082   49432 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:07.212627   49432 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:07.212655   49432 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:07.212971   49432 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:07.213185   49432 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:07.213458   49432 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:07.213615   49432 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:07.304775   49432 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:07.312278   49432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:07.327385   49432 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:07.327411   49432 api_server.go:166] Checking apiserver status ...

	I0807 18:36:07.327439   49432 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:07.342324   49432 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:07.353473   49432 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:07.353534   49432 ssh_runner.go:195] Run: ls

	I0807 18:36:07.359369   49432 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:07.363934   49432 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:07.363959   49432 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:07.363971   49432 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:07.363992   49432 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:07.364342   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:07.364385   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:07.379363   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34341

	I0807 18:36:07.379787   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:07.380319   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:07.380342   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:07.380603   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:07.380878   49432 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:07.382612   49432 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:36:07.382641   49432 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:07.382919   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:07.382981   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:07.397768   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41441

	I0807 18:36:07.398286   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:07.398867   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:07.398886   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:07.399256   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:07.399570   49432 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:36:07.402388   49432 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:07.402873   49432 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:07.402911   49432 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:07.403070   49432 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:07.403370   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:07.403423   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:07.419635   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43043

	I0807 18:36:07.420125   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:07.420672   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:07.420698   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:07.421029   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:07.421224   49432 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:36:07.421397   49432 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:07.421416   49432 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:36:07.424289   49432 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:07.424770   49432 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:07.424793   49432 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:07.425018   49432 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:36:07.425233   49432 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:36:07.425424   49432 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:36:07.425568   49432 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:09.924578   49432 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:09.924664   49432 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:09.924677   49432 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:09.924692   49432 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:09.924709   49432 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:09.924716   49432 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:09.925032   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:09.925083   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:09.940029   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42831

	I0807 18:36:09.940459   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:09.940937   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:09.940957   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:09.941346   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:09.941598   49432 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:09.943278   49432 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:09.943301   49432 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:09.943704   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:09.943748   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:09.959498   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37337

	I0807 18:36:09.959888   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:09.960375   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:09.960394   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:09.960694   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:09.960929   49432 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:09.964061   49432 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:09.964537   49432 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:09.964568   49432 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:09.964749   49432 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:09.965057   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:09.965091   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:09.980393   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40899

	I0807 18:36:09.980811   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:09.981299   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:09.981324   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:09.981644   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:09.981843   49432 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:09.982025   49432 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:09.982042   49432 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:09.984764   49432 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:09.985202   49432 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:09.985231   49432 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:09.985371   49432 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:09.985522   49432 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:09.985686   49432 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:09.985817   49432 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:10.076869   49432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:10.093118   49432 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:10.093148   49432 api_server.go:166] Checking apiserver status ...

	I0807 18:36:10.093209   49432 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:10.107695   49432 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:10.117766   49432 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:10.117829   49432 ssh_runner.go:195] Run: ls

	I0807 18:36:10.127505   49432 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:10.131546   49432 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:10.131583   49432 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:10.131591   49432 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:10.131606   49432 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:10.131899   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:10.131933   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:10.146922   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46651

	I0807 18:36:10.147437   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:10.147877   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:10.147902   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:10.148235   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:10.148449   49432 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:10.150103   49432 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:10.150131   49432 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:10.150541   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:10.150593   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:10.165969   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33791

	I0807 18:36:10.166432   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:10.166961   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:10.166982   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:10.167327   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:10.167532   49432 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:10.170673   49432 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:10.171110   49432 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:10.171129   49432 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:10.171252   49432 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:10.171538   49432 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:10.171606   49432 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:10.187725   49432 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37251

	I0807 18:36:10.188165   49432 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:10.188684   49432 main.go:141] libmachine: Using API Version  1

	I0807 18:36:10.188707   49432 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:10.189051   49432 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:10.189258   49432 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:10.189453   49432 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:10.189473   49432 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:10.192836   49432 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:10.193335   49432 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:10.193351   49432 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:10.193511   49432 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:10.193696   49432 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:10.193863   49432 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:10.194000   49432 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:10.279879   49432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:10.295745   49432 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (2.549644818s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:10.867392   49517 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:10.867523   49517 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:10.867534   49517 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:10.867540   49517 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:10.867745   49517 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:10.867922   49517 out.go:298] Setting JSON to false

	I0807 18:36:10.867951   49517 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:10.867999   49517 notify.go:220] Checking for updates...

	I0807 18:36:10.868389   49517 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:10.868410   49517 status.go:255] checking status of ha-198246 ...

	I0807 18:36:10.868873   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:10.868934   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:10.887497   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33361

	I0807 18:36:10.887958   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:10.888593   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:10.888623   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:10.888981   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:10.889194   49517 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:10.890768   49517 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:10.890781   49517 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:10.891064   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:10.891096   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:10.906634   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42657

	I0807 18:36:10.907028   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:10.907508   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:10.907526   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:10.907813   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:10.907995   49517 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:10.910648   49517 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:10.911095   49517 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:10.911121   49517 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:10.911307   49517 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:10.911627   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:10.911672   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:10.927150   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44989

	I0807 18:36:10.927581   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:10.928083   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:10.928100   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:10.928507   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:10.928724   49517 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:10.928972   49517 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:10.929003   49517 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:10.931987   49517 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:10.932427   49517 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:10.932453   49517 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:10.932571   49517 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:10.932752   49517 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:10.933025   49517 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:10.933176   49517 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:11.016984   49517 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:11.023550   49517 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:11.038968   49517 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:11.039004   49517 api_server.go:166] Checking apiserver status ...

	I0807 18:36:11.039061   49517 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:11.053653   49517 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:11.064978   49517 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:11.065045   49517 ssh_runner.go:195] Run: ls

	I0807 18:36:11.070768   49517 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:11.076906   49517 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:11.076933   49517 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:11.076947   49517 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:11.076972   49517 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:11.077295   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:11.077337   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:11.093511   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34323

	I0807 18:36:11.093966   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:11.094505   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:11.094531   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:11.094822   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:11.095018   49517 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:11.096724   49517 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:36:11.096741   49517 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:11.097068   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:11.097104   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:11.111801   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37963

	I0807 18:36:11.112224   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:11.112618   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:11.112638   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:11.112977   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:11.113161   49517 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:36:11.116037   49517 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:11.116505   49517 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:11.116530   49517 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:11.116686   49517 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:11.117014   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:11.117059   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:11.135005   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33267

	I0807 18:36:11.135446   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:11.135973   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:11.136001   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:11.136364   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:11.136550   49517 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:36:11.136732   49517 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:11.136753   49517 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:36:11.139748   49517 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:11.140191   49517 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:11.140236   49517 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:11.140491   49517 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:36:11.140648   49517 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:36:11.140809   49517 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:36:11.140921   49517 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:12.996470   49517 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:12.996556   49517 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:12.996574   49517 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:12.996583   49517 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:12.996599   49517 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:12.996606   49517 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:12.996940   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:12.996994   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:13.012370   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42201

	I0807 18:36:13.012915   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:13.013434   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:13.013460   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:13.013772   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:13.014000   49517 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:13.015460   49517 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:13.015478   49517 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:13.016058   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:13.016111   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:13.031048   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35491

	I0807 18:36:13.031456   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:13.031904   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:13.031923   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:13.032282   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:13.032451   49517 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:13.035531   49517 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:13.036027   49517 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:13.036057   49517 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:13.036164   49517 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:13.036496   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:13.036537   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:13.051817   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34013

	I0807 18:36:13.052260   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:13.052732   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:13.052755   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:13.053066   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:13.053349   49517 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:13.053597   49517 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:13.053620   49517 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:13.056647   49517 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:13.057119   49517 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:13.057145   49517 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:13.057357   49517 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:13.057501   49517 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:13.057736   49517 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:13.057920   49517 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:13.148331   49517 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:13.164709   49517 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:13.164737   49517 api_server.go:166] Checking apiserver status ...

	I0807 18:36:13.164768   49517 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:13.187428   49517 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:13.200495   49517 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:13.200556   49517 ssh_runner.go:195] Run: ls

	I0807 18:36:13.205784   49517 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:13.210192   49517 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:13.210216   49517 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:13.210224   49517 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:13.210239   49517 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:13.210528   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:13.210561   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:13.226960   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40221

	I0807 18:36:13.227375   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:13.227801   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:13.227822   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:13.228194   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:13.228420   49517 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:13.229860   49517 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:13.229874   49517 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:13.230216   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:13.230251   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:13.245403   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34039

	I0807 18:36:13.245916   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:13.246448   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:13.246471   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:13.246798   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:13.247008   49517 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:13.250187   49517 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:13.250559   49517 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:13.250599   49517 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:13.250846   49517 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:13.251163   49517 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:13.251198   49517 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:13.267449   49517 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35543

	I0807 18:36:13.267873   49517 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:13.268390   49517 main.go:141] libmachine: Using API Version  1

	I0807 18:36:13.268419   49517 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:13.268774   49517 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:13.268986   49517 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:13.269190   49517 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:13.269211   49517 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:13.272320   49517 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:13.272867   49517 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:13.272903   49517 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:13.273070   49517 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:13.273251   49517 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:13.273427   49517 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:13.273623   49517 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:13.359981   49517 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:13.374757   49517 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (4.739977448s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:14.966384   49618 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:14.966482   49618 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:14.966488   49618 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:14.966494   49618 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:14.966730   49618 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:14.966940   49618 out.go:298] Setting JSON to false

	I0807 18:36:14.966965   49618 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:14.967075   49618 notify.go:220] Checking for updates...

	I0807 18:36:14.967468   49618 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:14.967490   49618 status.go:255] checking status of ha-198246 ...

	I0807 18:36:14.967971   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:14.968035   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:14.985499   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36677

	I0807 18:36:14.985956   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:14.986534   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:14.986560   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:14.986956   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:14.987205   49618 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:14.988815   49618 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:14.988832   49618 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:14.989163   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:14.989206   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:15.004096   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34017

	I0807 18:36:15.004548   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:15.005100   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:15.005122   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:15.005433   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:15.005627   49618 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:15.008434   49618 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:15.008792   49618 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:15.008841   49618 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:15.008933   49618 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:15.009299   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:15.009335   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:15.024265   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38627

	I0807 18:36:15.024731   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:15.025164   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:15.025183   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:15.025449   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:15.025675   49618 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:15.025870   49618 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:15.025898   49618 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:15.028586   49618 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:15.029036   49618 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:15.029056   49618 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:15.029199   49618 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:15.029366   49618 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:15.029545   49618 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:15.029677   49618 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:15.113105   49618 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:15.120436   49618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:15.138463   49618 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:15.138490   49618 api_server.go:166] Checking apiserver status ...

	I0807 18:36:15.138522   49618 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:15.153418   49618 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:15.164330   49618 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:15.164383   49618 ssh_runner.go:195] Run: ls

	I0807 18:36:15.169482   49618 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:15.175715   49618 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:15.175744   49618 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:15.175755   49618 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:15.175770   49618 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:15.176164   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:15.176226   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:15.191675   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43843

	I0807 18:36:15.192261   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:15.192800   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:15.192819   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:15.193151   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:15.193363   49618 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:15.195314   49618 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:36:15.195328   49618 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:15.195652   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:15.195690   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:15.210482   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40321

	I0807 18:36:15.210902   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:15.211416   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:15.211439   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:15.211832   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:15.212029   49618 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:36:15.215279   49618 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:15.215712   49618 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:15.215740   49618 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:15.215885   49618 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:15.216253   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:15.216294   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:15.231736   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39185

	I0807 18:36:15.232159   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:15.232663   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:15.232686   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:15.233078   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:15.233296   49618 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:36:15.233498   49618 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:15.233518   49618 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:36:15.236256   49618 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:15.236694   49618 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:15.236717   49618 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:15.236839   49618 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:36:15.236996   49618 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:36:15.237136   49618 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:36:15.237267   49618 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:16.068434   49618 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:16.068475   49618 retry.go:31] will retry after 155.188845ms: dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:19.300483   49618 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:19.300573   49618 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:19.300598   49618 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:19.300608   49618 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:19.300641   49618 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:19.300655   49618 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:19.301096   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:19.301155   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:19.316531   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38791

	I0807 18:36:19.317026   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:19.317468   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:19.317489   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:19.317765   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:19.317994   49618 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:19.319820   49618 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:19.319834   49618 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:19.320116   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:19.320156   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:19.334795   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32823

	I0807 18:36:19.335278   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:19.335843   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:19.335868   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:19.336244   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:19.336453   49618 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:19.339670   49618 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:19.340159   49618 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:19.340182   49618 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:19.340415   49618 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:19.340756   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:19.340793   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:19.358174   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44187

	I0807 18:36:19.358677   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:19.359222   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:19.359247   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:19.359634   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:19.359840   49618 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:19.360043   49618 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:19.360065   49618 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:19.363068   49618 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:19.363454   49618 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:19.363489   49618 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:19.363755   49618 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:19.363955   49618 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:19.364137   49618 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:19.364301   49618 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:19.451878   49618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:19.466547   49618 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:19.466576   49618 api_server.go:166] Checking apiserver status ...

	I0807 18:36:19.466610   49618 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:19.480792   49618 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:19.491023   49618 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:19.491082   49618 ssh_runner.go:195] Run: ls

	I0807 18:36:19.496012   49618 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:19.500600   49618 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:19.500622   49618 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:19.500630   49618 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:19.500644   49618 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:19.500932   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:19.500969   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:19.516672   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36417

	I0807 18:36:19.517152   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:19.517645   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:19.517660   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:19.517996   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:19.518221   49618 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:19.519839   49618 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:19.519853   49618 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:19.520138   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:19.520191   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:19.534832   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41455

	I0807 18:36:19.535283   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:19.535722   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:19.535780   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:19.536085   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:19.536311   49618 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:19.538901   49618 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:19.539396   49618 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:19.539443   49618 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:19.539621   49618 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:19.539908   49618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:19.539943   49618 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:19.555915   49618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46023

	I0807 18:36:19.556507   49618 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:19.557170   49618 main.go:141] libmachine: Using API Version  1

	I0807 18:36:19.557197   49618 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:19.557550   49618 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:19.557734   49618 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:19.557912   49618 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:19.557930   49618 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:19.560993   49618 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:19.561471   49618 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:19.561502   49618 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:19.561734   49618 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:19.561907   49618 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:19.562065   49618 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:19.562227   49618 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:19.648653   49618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:19.663001   49618 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (3.74339873s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:22.149093   49733 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:22.149221   49733 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:22.149232   49733 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:22.149239   49733 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:22.149422   49733 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:22.149612   49733 out.go:298] Setting JSON to false

	I0807 18:36:22.149643   49733 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:22.149742   49733 notify.go:220] Checking for updates...

	I0807 18:36:22.150154   49733 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:22.150177   49733 status.go:255] checking status of ha-198246 ...

	I0807 18:36:22.150629   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:22.150694   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:22.169949   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33565

	I0807 18:36:22.170429   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:22.171010   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:22.171030   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:22.171416   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:22.171605   49733 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:22.173475   49733 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:22.173492   49733 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:22.173784   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:22.173829   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:22.190002   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36955

	I0807 18:36:22.190430   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:22.190977   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:22.191000   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:22.191307   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:22.191537   49733 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:22.194507   49733 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:22.194883   49733 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:22.194909   49733 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:22.195122   49733 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:22.195424   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:22.195459   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:22.210189   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33303

	I0807 18:36:22.210612   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:22.211132   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:22.211160   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:22.211475   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:22.211668   49733 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:22.211862   49733 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:22.211888   49733 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:22.214592   49733 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:22.214927   49733 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:22.214954   49733 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:22.215085   49733 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:22.215290   49733 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:22.215436   49733 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:22.215567   49733 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:22.296960   49733 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:22.303791   49733 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:22.320124   49733 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:22.320153   49733 api_server.go:166] Checking apiserver status ...

	I0807 18:36:22.320186   49733 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:22.335347   49733 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:22.345914   49733 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:22.345967   49733 ssh_runner.go:195] Run: ls

	I0807 18:36:22.351674   49733 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:22.356541   49733 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:22.356566   49733 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:22.356576   49733 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:22.356604   49733 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:22.356980   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:22.357017   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:22.373553   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33593

	I0807 18:36:22.373993   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:22.374538   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:22.374561   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:22.374948   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:22.375181   49733 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:22.376821   49733 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:36:22.376836   49733 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:22.377124   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:22.377167   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:22.392953   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46305

	I0807 18:36:22.393384   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:22.393834   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:22.393855   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:22.394228   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:22.394413   49733 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:36:22.397195   49733 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:22.397612   49733 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:22.397657   49733 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:22.397816   49733 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:22.398154   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:22.398203   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:22.412721   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36439

	I0807 18:36:22.413191   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:22.413628   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:22.413644   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:22.413941   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:22.414095   49733 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:36:22.414273   49733 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:22.414307   49733 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:36:22.416763   49733 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:22.417214   49733 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:22.417238   49733 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:22.417343   49733 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:36:22.417502   49733 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:36:22.417621   49733 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:36:22.417747   49733 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:25.476526   49733 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:25.476610   49733 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:25.476623   49733 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:25.476630   49733 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:25.476653   49733 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:25.476660   49733 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:25.476970   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:25.477013   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:25.492726   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45123

	I0807 18:36:25.493217   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:25.493704   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:25.493729   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:25.494099   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:25.494294   49733 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:25.496069   49733 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:25.496087   49733 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:25.496467   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:25.496505   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:25.510934   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40939

	I0807 18:36:25.511310   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:25.511790   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:25.511811   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:25.512284   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:25.512551   49733 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:25.515528   49733 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:25.515921   49733 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:25.515955   49733 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:25.516068   49733 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:25.516410   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:25.516444   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:25.531690   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34477

	I0807 18:36:25.532253   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:25.532852   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:25.532879   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:25.533244   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:25.533456   49733 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:25.533645   49733 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:25.533671   49733 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:25.536839   49733 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:25.537438   49733 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:25.537462   49733 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:25.537663   49733 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:25.537873   49733 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:25.538091   49733 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:25.538238   49733 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:25.628902   49733 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:25.647324   49733 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:25.647348   49733 api_server.go:166] Checking apiserver status ...

	I0807 18:36:25.647379   49733 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:25.663953   49733 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:25.677634   49733 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:25.677686   49733 ssh_runner.go:195] Run: ls

	I0807 18:36:25.683026   49733 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:25.687247   49733 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:25.687270   49733 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:25.687277   49733 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:25.687291   49733 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:25.687654   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:25.687689   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:25.702475   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33277

	I0807 18:36:25.702936   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:25.703407   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:25.703427   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:25.703733   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:25.703950   49733 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:25.705788   49733 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:25.705806   49733 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:25.706105   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:25.706165   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:25.722462   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40401

	I0807 18:36:25.722895   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:25.723425   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:25.723453   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:25.723779   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:25.723985   49733 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:25.727108   49733 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:25.727526   49733 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:25.727564   49733 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:25.727730   49733 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:25.728081   49733 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:25.728140   49733 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:25.742853   49733 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33779

	I0807 18:36:25.743357   49733 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:25.743808   49733 main.go:141] libmachine: Using API Version  1

	I0807 18:36:25.743829   49733 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:25.744229   49733 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:25.744409   49733 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:25.744615   49733 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:25.744632   49733 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:25.747757   49733 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:25.748307   49733 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:25.748335   49733 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:25.748493   49733 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:25.748671   49733 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:25.748801   49733 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:25.748983   49733 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:25.836067   49733 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:25.851891   49733 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

E0807 18:36:31.077280   28052 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/functional-965692/client.crt: no such file or directory

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (4.685430283s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:27.616099   49833 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:27.616227   49833 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:27.616236   49833 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:27.616241   49833 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:27.616415   49833 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:27.616616   49833 out.go:298] Setting JSON to false

	I0807 18:36:27.616641   49833 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:27.616733   49833 notify.go:220] Checking for updates...

	I0807 18:36:27.617089   49833 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:27.617103   49833 status.go:255] checking status of ha-198246 ...

	I0807 18:36:27.617513   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:27.617552   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:27.637632   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40317

	I0807 18:36:27.638037   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:27.638672   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:27.638700   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:27.639002   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:27.639228   49833 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:27.640822   49833 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:27.640851   49833 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:27.641125   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:27.641164   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:27.655649   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45685

	I0807 18:36:27.656039   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:27.656505   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:27.656536   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:27.656848   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:27.657036   49833 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:27.659597   49833 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:27.659980   49833 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:27.659998   49833 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:27.660194   49833 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:27.660538   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:27.660574   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:27.675388   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42023

	I0807 18:36:27.675774   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:27.676266   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:27.676288   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:27.676589   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:27.676768   49833 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:27.676975   49833 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:27.676997   49833 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:27.679917   49833 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:27.680386   49833 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:27.680421   49833 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:27.680588   49833 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:27.680742   49833 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:27.680877   49833 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:27.681037   49833 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:27.764382   49833 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:27.771839   49833 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:27.787360   49833 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:27.787391   49833 api_server.go:166] Checking apiserver status ...

	I0807 18:36:27.787425   49833 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:27.802155   49833 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:27.813195   49833 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:27.813271   49833 ssh_runner.go:195] Run: ls

	I0807 18:36:27.821004   49833 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:27.825320   49833 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:27.825348   49833 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:27.825356   49833 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:27.825375   49833 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:27.825655   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:27.825714   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:27.841227   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35681

	I0807 18:36:27.841687   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:27.842255   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:27.842275   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:27.842604   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:27.842813   49833 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:27.844336   49833 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:36:27.844354   49833 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:27.844668   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:27.844714   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:27.859648   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37715

	I0807 18:36:27.860141   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:27.860648   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:27.860672   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:27.860988   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:27.861196   49833 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:36:27.864071   49833 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:27.864556   49833 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:27.864581   49833 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:27.864748   49833 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:27.865048   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:27.865100   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:27.879637   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45819

	I0807 18:36:27.880055   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:27.880586   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:27.880607   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:27.880898   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:27.881075   49833 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:36:27.881274   49833 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:27.881296   49833 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:36:27.884163   49833 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:27.884640   49833 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:27.884668   49833 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:27.884752   49833 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:36:27.884932   49833 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:36:27.885089   49833 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:36:27.885223   49833 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:28.548489   49833 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:28.548542   49833 retry.go:31] will retry after 295.725043ms: dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:31.908488   49833 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:31.908601   49833 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:31.908624   49833 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:31.908635   49833 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:31.908659   49833 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:31.908669   49833 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:31.908952   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:31.909006   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:31.923636   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34055

	I0807 18:36:31.924084   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:31.924553   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:31.924575   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:31.924874   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:31.925106   49833 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:31.926589   49833 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:31.926604   49833 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:31.926903   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:31.926950   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:31.942014   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33199

	I0807 18:36:31.942377   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:31.942820   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:31.942853   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:31.943207   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:31.943376   49833 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:31.946181   49833 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:31.946621   49833 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:31.946647   49833 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:31.946813   49833 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:31.947111   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:31.947155   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:31.961755   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46445

	I0807 18:36:31.962170   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:31.962656   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:31.962676   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:31.963063   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:31.963268   49833 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:31.963463   49833 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:31.963481   49833 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:31.966829   49833 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:31.967279   49833 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:31.967313   49833 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:31.967476   49833 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:31.967699   49833 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:31.967833   49833 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:31.967960   49833 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:32.051951   49833 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:32.067361   49833 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:32.067388   49833 api_server.go:166] Checking apiserver status ...

	I0807 18:36:32.067419   49833 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:32.080865   49833 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:32.090865   49833 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:32.090944   49833 ssh_runner.go:195] Run: ls

	I0807 18:36:32.095869   49833 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:32.101202   49833 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:32.101228   49833 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:32.101238   49833 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:32.101256   49833 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:32.101596   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:32.101630   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:32.117120   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38551

	I0807 18:36:32.117685   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:32.118163   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:32.118182   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:32.118520   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:32.118727   49833 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:32.120398   49833 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:32.120414   49833 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:32.120739   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:32.120779   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:32.136451   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45111

	I0807 18:36:32.136826   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:32.137321   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:32.137346   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:32.137638   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:32.137856   49833 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:32.140906   49833 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:32.141382   49833 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:32.141414   49833 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:32.141571   49833 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:32.141982   49833 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:32.142025   49833 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:32.157308   49833 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42187

	I0807 18:36:32.157692   49833 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:32.158159   49833 main.go:141] libmachine: Using API Version  1

	I0807 18:36:32.158178   49833 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:32.158524   49833 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:32.158756   49833 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:32.158937   49833 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:32.158961   49833 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:32.161838   49833 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:32.162279   49833 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:32.162303   49833 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:32.162485   49833 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:32.162642   49833 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:32.162803   49833 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:32.162959   49833 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:32.247728   49833 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:32.261659   49833 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 3 (3.738830133s)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:38.792572   49949 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:38.792842   49949 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:38.792855   49949 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:38.792861   49949 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:38.793070   49949 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:38.793242   49949 out.go:298] Setting JSON to false

	I0807 18:36:38.793264   49949 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:38.793297   49949 notify.go:220] Checking for updates...

	I0807 18:36:38.793594   49949 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:38.793608   49949 status.go:255] checking status of ha-198246 ...

	I0807 18:36:38.793985   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:38.794036   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:38.811816   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33631

	I0807 18:36:38.812350   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:38.812963   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:38.813008   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:38.813403   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:38.813627   49949 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:38.815303   49949 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:38.815320   49949 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:38.815629   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:38.815667   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:38.830117   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37553

	I0807 18:36:38.830482   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:38.830944   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:38.830964   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:38.831244   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:38.831414   49949 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:38.834380   49949 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:38.834818   49949 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:38.834846   49949 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:38.834983   49949 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:38.835281   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:38.835322   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:38.849699   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34323

	I0807 18:36:38.850149   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:38.850604   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:38.850624   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:38.850935   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:38.851117   49949 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:38.851375   49949 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:38.851395   49949 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:38.853968   49949 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:38.854462   49949 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:38.854496   49949 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:38.854594   49949 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:38.854783   49949 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:38.854953   49949 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:38.855145   49949 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:38.940316   49949 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:38.947218   49949 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:38.964729   49949 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:38.964758   49949 api_server.go:166] Checking apiserver status ...

	I0807 18:36:38.964796   49949 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:38.979905   49949 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:38.990170   49949 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:38.990223   49949 ssh_runner.go:195] Run: ls

	I0807 18:36:38.994752   49949 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:38.999082   49949 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:38.999105   49949 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:38.999129   49949 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:38.999143   49949 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:38.999477   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:38.999510   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:39.014128   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33175

	I0807 18:36:39.014577   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:39.015016   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:39.015038   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:39.015396   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:39.015591   49949 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:39.017047   49949 status.go:330] ha-198246-m02 host status = "Running" (err=<nil>)

	I0807 18:36:39.017065   49949 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:39.017345   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:39.017376   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:39.031690   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41883

	I0807 18:36:39.032144   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:39.032606   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:39.032630   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:39.032924   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:39.033110   49949 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:36:39.035975   49949 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:39.036512   49949 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:39.036551   49949 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:39.036769   49949 host.go:66] Checking if "ha-198246-m02" exists ...

	I0807 18:36:39.037065   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:39.037103   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:39.052987   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36759

	I0807 18:36:39.053411   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:39.053897   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:39.053918   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:39.054253   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:39.054450   49949 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:36:39.054653   49949 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:39.054673   49949 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:36:39.059440   49949 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:39.059935   49949 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:36:39.059965   49949 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:36:39.060163   49949 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:36:39.060381   49949 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:36:39.060549   49949 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:36:39.060689   49949 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	W0807 18:36:42.116485   49949 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.251:22: connect: no route to host

	W0807 18:36:42.116592   49949 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	E0807 18:36:42.116616   49949 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:42.116639   49949 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0807 18:36:42.116654   49949 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.251:22: connect: no route to host

	I0807 18:36:42.116665   49949 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:42.116999   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:42.117051   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:42.132210   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46109

	I0807 18:36:42.132624   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:42.133093   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:42.133114   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:42.133411   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:42.133615   49949 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:42.135360   49949 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:42.135382   49949 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:42.135714   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:42.135768   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:42.150610   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43611

	I0807 18:36:42.151023   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:42.151462   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:42.151490   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:42.151772   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:42.151968   49949 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:42.155226   49949 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:42.155694   49949 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:42.155732   49949 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:42.155857   49949 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:42.156193   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:42.156250   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:42.171053   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41639

	I0807 18:36:42.171453   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:42.171872   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:42.171895   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:42.172177   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:42.172355   49949 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:42.172539   49949 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:42.172567   49949 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:42.175508   49949 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:42.175877   49949 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:42.175901   49949 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:42.176036   49949 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:42.176174   49949 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:42.176341   49949 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:42.176480   49949 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:42.264821   49949 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:42.282770   49949 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:42.282802   49949 api_server.go:166] Checking apiserver status ...

	I0807 18:36:42.282836   49949 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:42.298124   49949 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:42.308822   49949 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:42.308881   49949 ssh_runner.go:195] Run: ls

	I0807 18:36:42.313604   49949 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:42.318637   49949 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:42.318662   49949 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:42.318674   49949 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:42.318693   49949 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:42.319056   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:42.319110   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:42.334007   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38327

	I0807 18:36:42.334420   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:42.334860   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:42.334883   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:42.335172   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:42.335356   49949 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:42.337202   49949 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:42.337220   49949 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:42.337531   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:42.337583   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:42.351994   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46865

	I0807 18:36:42.352483   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:42.353175   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:42.353195   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:42.353663   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:42.353856   49949 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:42.356638   49949 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:42.357027   49949 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:42.357050   49949 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:42.357198   49949 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:42.357517   49949 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:42.357552   49949 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:42.372527   49949 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34351

	I0807 18:36:42.372959   49949 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:42.373457   49949 main.go:141] libmachine: Using API Version  1

	I0807 18:36:42.373478   49949 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:42.373777   49949 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:42.373972   49949 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:42.374157   49949 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:42.374175   49949 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:42.376998   49949 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:42.377459   49949 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:42.377486   49949 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:42.377657   49949 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:42.377874   49949 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:42.378032   49949 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:42.378191   49949 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:42.468700   49949 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:42.487662   49949 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 7 (628.457484ms)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:36:51.143769   50086 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:36:51.144024   50086 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:51.144033   50086 out.go:304] Setting ErrFile to fd 2...

	I0807 18:36:51.144037   50086 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:36:51.144230   50086 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:36:51.144450   50086 out.go:298] Setting JSON to false

	I0807 18:36:51.144473   50086 mustload.go:65] Loading cluster: ha-198246

	I0807 18:36:51.144510   50086 notify.go:220] Checking for updates...

	I0807 18:36:51.144910   50086 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:36:51.144933   50086 status.go:255] checking status of ha-198246 ...

	I0807 18:36:51.145287   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.145345   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.162943   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46113

	I0807 18:36:51.163438   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.163990   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.164017   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.164481   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.164714   50086 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:36:51.166840   50086 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:36:51.166862   50086 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:51.167305   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.167354   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.183325   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36465

	I0807 18:36:51.183838   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.184323   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.184347   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.184618   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.184799   50086 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:36:51.187964   50086 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:51.188500   50086 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:51.188547   50086 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:51.188698   50086 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:36:51.189007   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.189048   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.204171   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36181

	I0807 18:36:51.204612   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.205138   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.205162   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.205452   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.205640   50086 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:36:51.205827   50086 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:51.205853   50086 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:36:51.208463   50086 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:51.208923   50086 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:36:51.208972   50086 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:36:51.209074   50086 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:36:51.209244   50086 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:36:51.209378   50086 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:36:51.209469   50086 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:36:51.289634   50086 ssh_runner.go:195] Run: systemctl --version

	I0807 18:36:51.296563   50086 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:51.313639   50086 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:51.313667   50086 api_server.go:166] Checking apiserver status ...

	I0807 18:36:51.313704   50086 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:51.329273   50086 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:36:51.339383   50086 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:51.339446   50086 ssh_runner.go:195] Run: ls

	I0807 18:36:51.344515   50086 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:51.349191   50086 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:51.349219   50086 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:36:51.349232   50086 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:51.349267   50086 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:36:51.349608   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.349646   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.365759   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33009

	I0807 18:36:51.366211   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.366701   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.366725   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.367092   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.367287   50086 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:36:51.368894   50086 status.go:330] ha-198246-m02 host status = "Stopped" (err=<nil>)

	I0807 18:36:51.368911   50086 status.go:343] host is not running, skipping remaining checks

	I0807 18:36:51.368920   50086 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:51.368941   50086 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:36:51.369360   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.369407   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.384440   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39805

	I0807 18:36:51.384890   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.385381   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.385403   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.385748   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.385938   50086 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:36:51.387704   50086 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:36:51.387720   50086 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:51.388009   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.388046   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.403401   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40191

	I0807 18:36:51.403868   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.404304   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.404332   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.404650   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.404815   50086 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:36:51.407692   50086 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:51.408123   50086 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:51.408148   50086 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:51.408298   50086 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:36:51.408620   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.408662   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.423689   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44767

	I0807 18:36:51.424074   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.424596   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.424620   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.424958   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.425183   50086 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:36:51.425354   50086 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:51.425371   50086 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:36:51.427899   50086 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:51.428285   50086 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:36:51.428308   50086 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:36:51.428453   50086 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:36:51.428591   50086 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:36:51.428769   50086 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:36:51.428902   50086 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:36:51.515834   50086 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:51.530416   50086 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:36:51.530442   50086 api_server.go:166] Checking apiserver status ...

	I0807 18:36:51.530471   50086 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:36:51.543479   50086 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:36:51.552815   50086 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:36:51.552861   50086 ssh_runner.go:195] Run: ls

	I0807 18:36:51.557369   50086 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:36:51.563495   50086 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:36:51.563520   50086 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:36:51.563530   50086 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:36:51.563557   50086 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:36:51.563873   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.563916   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.580469   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46273

	I0807 18:36:51.580901   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.581383   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.581402   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.581741   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.581935   50086 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:36:51.583426   50086 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:36:51.583441   50086 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:51.583717   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.583772   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.598904   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38127

	I0807 18:36:51.599354   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.599813   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.599829   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.600160   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.600383   50086 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:36:51.603194   50086 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:51.603650   50086 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:51.603685   50086 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:51.603848   50086 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:36:51.604175   50086 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:36:51.604251   50086 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:36:51.619009   50086 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35789

	I0807 18:36:51.619407   50086 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:36:51.619810   50086 main.go:141] libmachine: Using API Version  1

	I0807 18:36:51.619831   50086 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:36:51.620140   50086 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:36:51.620374   50086 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:36:51.620578   50086 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:36:51.620600   50086 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:36:51.623069   50086 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:51.623425   50086 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:36:51.623445   50086 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:36:51.623586   50086 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:36:51.623732   50086 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:36:51.623899   50086 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:36:51.624037   50086 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:36:51.712167   50086 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:36:51.729760   50086 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

E0807 18:36:58.764738   28052 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/functional-965692/client.crt: no such file or directory

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr: exit status 7 (624.097759ms)

-- stdout --

	ha-198246

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-198246-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-198246-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0807 18:37:05.440845   50206 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:37:05.440966   50206 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:37:05.440974   50206 out.go:304] Setting ErrFile to fd 2...

	I0807 18:37:05.440979   50206 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:37:05.441172   50206 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:37:05.441331   50206 out.go:298] Setting JSON to false

	I0807 18:37:05.441351   50206 mustload.go:65] Loading cluster: ha-198246

	I0807 18:37:05.441440   50206 notify.go:220] Checking for updates...

	I0807 18:37:05.441692   50206 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:37:05.441705   50206 status.go:255] checking status of ha-198246 ...

	I0807 18:37:05.442092   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.442143   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.458699   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41343

	I0807 18:37:05.459131   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.459698   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.459725   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.460052   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.460246   50206 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:37:05.461897   50206 status.go:330] ha-198246 host status = "Running" (err=<nil>)

	I0807 18:37:05.461913   50206 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:37:05.462309   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.462354   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.478065   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38445

	I0807 18:37:05.478539   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.479012   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.479041   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.479326   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.479483   50206 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:37:05.482790   50206 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:37:05.483233   50206 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:37:05.483253   50206 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:37:05.483397   50206 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:37:05.483702   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.483740   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.498932   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41355

	I0807 18:37:05.499281   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.499719   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.499744   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.500062   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.500264   50206 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:37:05.500478   50206 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:37:05.500507   50206 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:37:05.503378   50206 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:37:05.503793   50206 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:37:05.503823   50206 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:37:05.503937   50206 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:37:05.504118   50206 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:37:05.504292   50206 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:37:05.504471   50206 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:37:05.584479   50206 ssh_runner.go:195] Run: systemctl --version

	I0807 18:37:05.590864   50206 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:37:05.606000   50206 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:37:05.606024   50206 api_server.go:166] Checking apiserver status ...

	I0807 18:37:05.606052   50206 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:37:05.620240   50206 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup

	W0807 18:37:05.629711   50206 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1221/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:37:05.629776   50206 ssh_runner.go:195] Run: ls

	I0807 18:37:05.634306   50206 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:37:05.638410   50206 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:37:05.638431   50206 status.go:422] ha-198246 apiserver status = Running (err=<nil>)

	I0807 18:37:05.638441   50206 status.go:257] ha-198246 status: &{Name:ha-198246 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:37:05.638455   50206 status.go:255] checking status of ha-198246-m02 ...

	I0807 18:37:05.638767   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.638799   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.654720   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43631

	I0807 18:37:05.655157   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.655595   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.655614   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.655905   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.656084   50206 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:37:05.657602   50206 status.go:330] ha-198246-m02 host status = "Stopped" (err=<nil>)

	I0807 18:37:05.657616   50206 status.go:343] host is not running, skipping remaining checks

	I0807 18:37:05.657624   50206 status.go:257] ha-198246-m02 status: &{Name:ha-198246-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:37:05.657642   50206 status.go:255] checking status of ha-198246-m03 ...

	I0807 18:37:05.658041   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.658088   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.672652   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35199

	I0807 18:37:05.673088   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.673630   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.673655   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.674007   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.674206   50206 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:37:05.675971   50206 status.go:330] ha-198246-m03 host status = "Running" (err=<nil>)

	I0807 18:37:05.675985   50206 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:37:05.676399   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.676454   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.691360   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37743

	I0807 18:37:05.691717   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.692345   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.692368   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.692659   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.692846   50206 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:37:05.695739   50206 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:37:05.696157   50206 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:37:05.696180   50206 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:37:05.696315   50206 host.go:66] Checking if "ha-198246-m03" exists ...

	I0807 18:37:05.696604   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.696636   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.710759   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46409

	I0807 18:37:05.711165   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.711597   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.711630   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.711957   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.712180   50206 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:37:05.712380   50206 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:37:05.712399   50206 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:37:05.714915   50206 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:37:05.715302   50206 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:37:05.715328   50206 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:37:05.715471   50206 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:37:05.715647   50206 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:37:05.715783   50206 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:37:05.715946   50206 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:37:05.804350   50206 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:37:05.823794   50206 kubeconfig.go:125] found "ha-198246" server: "https://192.168.39.254:8443"

	I0807 18:37:05.823824   50206 api_server.go:166] Checking apiserver status ...

	I0807 18:37:05.823859   50206 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:37:05.837518   50206 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup

	W0807 18:37:05.848842   50206 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1569/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0807 18:37:05.848902   50206 ssh_runner.go:195] Run: ls

	I0807 18:37:05.856195   50206 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0807 18:37:05.860671   50206 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0807 18:37:05.860695   50206 status.go:422] ha-198246-m03 apiserver status = Running (err=<nil>)

	I0807 18:37:05.860702   50206 status.go:257] ha-198246-m03 status: &{Name:ha-198246-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0807 18:37:05.860716   50206 status.go:255] checking status of ha-198246-m04 ...

	I0807 18:37:05.861070   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.861104   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.875842   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36891

	I0807 18:37:05.876294   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.876740   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.876762   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.877078   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.877262   50206 main.go:141] libmachine: (ha-198246-m04) Calling .GetState

	I0807 18:37:05.879084   50206 status.go:330] ha-198246-m04 host status = "Running" (err=<nil>)

	I0807 18:37:05.879101   50206 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:37:05.879489   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.879534   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.897183   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38103

	I0807 18:37:05.897638   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.898081   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.898100   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.898391   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.898574   50206 main.go:141] libmachine: (ha-198246-m04) Calling .GetIP

	I0807 18:37:05.901398   50206 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:37:05.901853   50206 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:37:05.901881   50206 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:37:05.902054   50206 host.go:66] Checking if "ha-198246-m04" exists ...

	I0807 18:37:05.902459   50206 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:37:05.902503   50206 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:37:05.918630   50206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41577

	I0807 18:37:05.918994   50206 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:37:05.919486   50206 main.go:141] libmachine: Using API Version  1

	I0807 18:37:05.919504   50206 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:37:05.919821   50206 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:37:05.920043   50206 main.go:141] libmachine: (ha-198246-m04) Calling .DriverName

	I0807 18:37:05.920194   50206 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0807 18:37:05.920235   50206 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHHostname

	I0807 18:37:05.922701   50206 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:37:05.923107   50206 main.go:141] libmachine: (ha-198246-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:13:d6", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:32:18 +0000 UTC Type:0 Mac:52:54:00:5b:13:d6 Iaid: IPaddr:192.168.39.150 Prefix:24 Hostname:ha-198246-m04 Clientid:01:52:54:00:5b:13:d6}

	I0807 18:37:05.923127   50206 main.go:141] libmachine: (ha-198246-m04) DBG | domain ha-198246-m04 has defined IP address 192.168.39.150 and MAC address 52:54:00:5b:13:d6 in network mk-ha-198246

	I0807 18:37:05.923238   50206 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHPort

	I0807 18:37:05.923406   50206 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHKeyPath

	I0807 18:37:05.923568   50206 main.go:141] libmachine: (ha-198246-m04) Calling .GetSSHUsername

	I0807 18:37:05.923707   50206 sshutil.go:53] new ssh client: &{IP:192.168.39.150 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m04/id_rsa Username:docker}

	I0807 18:37:06.007803   50206 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:37:06.021981   50206 status.go:257] ha-198246-m04 status: &{Name:ha-198246-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-198246 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-198246 -n ha-198246

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-198246 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-198246 logs -n 25: (1.447934583s)

helpers_test.go:252: TestMultiControlPlane/serial/RestartSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246:/home/docker/cp-test_ha-198246-m03_ha-198246.txt                       |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246 sudo cat                                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m03_ha-198246.txt                                 |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m02:/home/docker/cp-test_ha-198246-m03_ha-198246-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m02 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m03_ha-198246-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m03:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04:/home/docker/cp-test_ha-198246-m03_ha-198246-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m04 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m03_ha-198246-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-198246 cp testdata/cp-test.txt                                                | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile4028937378/001/cp-test_ha-198246-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246:/home/docker/cp-test_ha-198246-m04_ha-198246.txt                       |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246 sudo cat                                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m04_ha-198246.txt                                 |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m02:/home/docker/cp-test_ha-198246-m04_ha-198246-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m02 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m04_ha-198246-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-198246 cp ha-198246-m04:/home/docker/cp-test.txt                              | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m03:/home/docker/cp-test_ha-198246-m04_ha-198246-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n                                                                 | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | ha-198246-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-198246 ssh -n ha-198246-m03 sudo cat                                          | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC | 07 Aug 24 18:33 UTC |

	|         | /home/docker/cp-test_ha-198246-m04_ha-198246-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-198246 node stop m02 -v=7                                                     | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:33 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-198246 node start m02 -v=7                                                    | ha-198246 | jenkins | v1.33.1 | 07 Aug 24 18:36 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/07 18:27:21

	Running on machine: ubuntu-20-agent-10

	Binary: Built with gc go1.22.5 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0807 18:27:21.721727   44266 out.go:291] Setting OutFile to fd 1 ...

	I0807 18:27:21.721967   44266 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:27:21.721975   44266 out.go:304] Setting ErrFile to fd 2...

	I0807 18:27:21.721979   44266 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0807 18:27:21.722152   44266 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19389-20864/.minikube/bin

	I0807 18:27:21.722687   44266 out.go:298] Setting JSON to false

	I0807 18:27:21.723512   44266 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":7788,"bootTime":1723047454,"procs":172,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0807 18:27:21.723565   44266 start.go:139] virtualization: kvm guest

	I0807 18:27:21.725729   44266 out.go:177] * [ha-198246] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0807 18:27:21.727183   44266 notify.go:220] Checking for updates...

	I0807 18:27:21.727193   44266 out.go:177]   - MINIKUBE_LOCATION=19389

	I0807 18:27:21.728548   44266 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0807 18:27:21.729974   44266 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:27:21.731326   44266 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:27:21.732576   44266 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0807 18:27:21.733798   44266 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0807 18:27:21.735342   44266 driver.go:392] Setting default libvirt URI to qemu:///system

	I0807 18:27:21.769737   44266 out.go:177] * Using the kvm2 driver based on user configuration

	I0807 18:27:21.771127   44266 start.go:297] selected driver: kvm2

	I0807 18:27:21.771144   44266 start.go:901] validating driver "kvm2" against <nil>

	I0807 18:27:21.771156   44266 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0807 18:27:21.771870   44266 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0807 18:27:21.771942   44266 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19389-20864/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0807 18:27:21.786733   44266 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0807 18:27:21.786777   44266 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0807 18:27:21.786970   44266 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 18:27:21.787023   44266 cni.go:84] Creating CNI manager for ""

	I0807 18:27:21.787034   44266 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0807 18:27:21.787041   44266 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0807 18:27:21.787097   44266 start.go:340] cluster config:

	{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0807 18:27:21.787200   44266 iso.go:125] acquiring lock: {Name:mkf212fcb23c5f8609a2c03b42fcca30ca8c42d1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0807 18:27:21.789527   44266 out.go:177] * Starting "ha-198246" primary control-plane node in "ha-198246" cluster

	I0807 18:27:21.790581   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:27:21.790607   44266 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4

	I0807 18:27:21.790615   44266 cache.go:56] Caching tarball of preloaded images

	I0807 18:27:21.790695   44266 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 18:27:21.790708   44266 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 18:27:21.790995   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:27:21.791015   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json: {Name:mk9ea4fdb45a0ad19fddd77d9e86e860b1888943 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:21.791157   44266 start.go:360] acquireMachinesLock for ha-198246: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 18:27:21.791197   44266 start.go:364] duration metric: took 17.005µs to acquireMachinesLock for "ha-198246"

	I0807 18:27:21.791219   44266 start.go:93] Provisioning new machine with config: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:27:21.791271   44266 start.go:125] createHost starting for "" (driver="kvm2")

	I0807 18:27:21.792742   44266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0807 18:27:21.792862   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:27:21.792923   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:27:21.806899   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38255

	I0807 18:27:21.807336   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:27:21.807888   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:27:21.807907   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:27:21.808260   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:27:21.808450   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:21.808588   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:21.808718   44266 start.go:159] libmachine.API.Create for "ha-198246" (driver="kvm2")

	I0807 18:27:21.808749   44266 client.go:168] LocalClient.Create starting

	I0807 18:27:21.808783   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 18:27:21.808815   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:27:21.808831   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:27:21.808893   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 18:27:21.808911   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:27:21.808924   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:27:21.808938   44266 main.go:141] libmachine: Running pre-create checks...

	I0807 18:27:21.808951   44266 main.go:141] libmachine: (ha-198246) Calling .PreCreateCheck

	I0807 18:27:21.809303   44266 main.go:141] libmachine: (ha-198246) Calling .GetConfigRaw

	I0807 18:27:21.809632   44266 main.go:141] libmachine: Creating machine...

	I0807 18:27:21.809644   44266 main.go:141] libmachine: (ha-198246) Calling .Create

	I0807 18:27:21.809775   44266 main.go:141] libmachine: (ha-198246) Creating KVM machine...

	I0807 18:27:21.810961   44266 main.go:141] libmachine: (ha-198246) DBG | found existing default KVM network

	I0807 18:27:21.811595   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:21.811462   44289 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1e0}

	I0807 18:27:21.811613   44266 main.go:141] libmachine: (ha-198246) DBG | created network xml: 

	I0807 18:27:21.811622   44266 main.go:141] libmachine: (ha-198246) DBG | <network>

	I0807 18:27:21.811630   44266 main.go:141] libmachine: (ha-198246) DBG |   <name>mk-ha-198246</name>

	I0807 18:27:21.811643   44266 main.go:141] libmachine: (ha-198246) DBG |   <dns enable='no'/>

	I0807 18:27:21.811649   44266 main.go:141] libmachine: (ha-198246) DBG |   

	I0807 18:27:21.811659   44266 main.go:141] libmachine: (ha-198246) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0807 18:27:21.811669   44266 main.go:141] libmachine: (ha-198246) DBG |     <dhcp>

	I0807 18:27:21.811682   44266 main.go:141] libmachine: (ha-198246) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0807 18:27:21.811690   44266 main.go:141] libmachine: (ha-198246) DBG |     </dhcp>

	I0807 18:27:21.811695   44266 main.go:141] libmachine: (ha-198246) DBG |   </ip>

	I0807 18:27:21.811700   44266 main.go:141] libmachine: (ha-198246) DBG |   

	I0807 18:27:21.811723   44266 main.go:141] libmachine: (ha-198246) DBG | </network>

	I0807 18:27:21.811744   44266 main.go:141] libmachine: (ha-198246) DBG | 

	I0807 18:27:21.816727   44266 main.go:141] libmachine: (ha-198246) DBG | trying to create private KVM network mk-ha-198246 192.168.39.0/24...

	I0807 18:27:21.878767   44266 main.go:141] libmachine: (ha-198246) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246 ...

	I0807 18:27:21.878803   44266 main.go:141] libmachine: (ha-198246) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 18:27:21.878813   44266 main.go:141] libmachine: (ha-198246) DBG | private KVM network mk-ha-198246 192.168.39.0/24 created

	I0807 18:27:21.878832   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:21.878720   44289 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:27:21.878874   44266 main.go:141] libmachine: (ha-198246) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 18:27:22.116138   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:22.116028   44289 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa...

	I0807 18:27:22.201603   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:22.201499   44289 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/ha-198246.rawdisk...

	I0807 18:27:22.201635   44266 main.go:141] libmachine: (ha-198246) DBG | Writing magic tar header

	I0807 18:27:22.201649   44266 main.go:141] libmachine: (ha-198246) DBG | Writing SSH key tar header

	I0807 18:27:22.201665   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:22.201611   44289 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246 ...

	I0807 18:27:22.201729   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246

	I0807 18:27:22.201753   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246 (perms=drwx------)

	I0807 18:27:22.201760   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 18:27:22.201769   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:27:22.201775   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 18:27:22.201784   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 18:27:22.201812   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home/jenkins

	I0807 18:27:22.201832   44266 main.go:141] libmachine: (ha-198246) DBG | Checking permissions on dir: /home

	I0807 18:27:22.201841   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 18:27:22.201848   44266 main.go:141] libmachine: (ha-198246) DBG | Skipping /home - not owner

	I0807 18:27:22.201885   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 18:27:22.201909   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 18:27:22.201940   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 18:27:22.201958   44266 main.go:141] libmachine: (ha-198246) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 18:27:22.201972   44266 main.go:141] libmachine: (ha-198246) Creating domain...

	I0807 18:27:22.202738   44266 main.go:141] libmachine: (ha-198246) define libvirt domain using xml: 

	I0807 18:27:22.202751   44266 main.go:141] libmachine: (ha-198246) <domain type='kvm'>

	I0807 18:27:22.202774   44266 main.go:141] libmachine: (ha-198246)   <name>ha-198246</name>

	I0807 18:27:22.202794   44266 main.go:141] libmachine: (ha-198246)   <memory unit='MiB'>2200</memory>

	I0807 18:27:22.202803   44266 main.go:141] libmachine: (ha-198246)   <vcpu>2</vcpu>

	I0807 18:27:22.202808   44266 main.go:141] libmachine: (ha-198246)   <features>

	I0807 18:27:22.202813   44266 main.go:141] libmachine: (ha-198246)     <acpi/>

	I0807 18:27:22.202817   44266 main.go:141] libmachine: (ha-198246)     <apic/>

	I0807 18:27:22.202822   44266 main.go:141] libmachine: (ha-198246)     <pae/>

	I0807 18:27:22.202827   44266 main.go:141] libmachine: (ha-198246)     

	I0807 18:27:22.202831   44266 main.go:141] libmachine: (ha-198246)   </features>

	I0807 18:27:22.202835   44266 main.go:141] libmachine: (ha-198246)   <cpu mode='host-passthrough'>

	I0807 18:27:22.202840   44266 main.go:141] libmachine: (ha-198246)   

	I0807 18:27:22.202844   44266 main.go:141] libmachine: (ha-198246)   </cpu>

	I0807 18:27:22.202848   44266 main.go:141] libmachine: (ha-198246)   <os>

	I0807 18:27:22.202852   44266 main.go:141] libmachine: (ha-198246)     <type>hvm</type>

	I0807 18:27:22.202857   44266 main.go:141] libmachine: (ha-198246)     <boot dev='cdrom'/>

	I0807 18:27:22.202864   44266 main.go:141] libmachine: (ha-198246)     <boot dev='hd'/>

	I0807 18:27:22.202878   44266 main.go:141] libmachine: (ha-198246)     <bootmenu enable='no'/>

	I0807 18:27:22.202882   44266 main.go:141] libmachine: (ha-198246)   </os>

	I0807 18:27:22.202898   44266 main.go:141] libmachine: (ha-198246)   <devices>

	I0807 18:27:22.202906   44266 main.go:141] libmachine: (ha-198246)     <disk type='file' device='cdrom'>

	I0807 18:27:22.202934   44266 main.go:141] libmachine: (ha-198246)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/boot2docker.iso'/>

	I0807 18:27:22.202951   44266 main.go:141] libmachine: (ha-198246)       <target dev='hdc' bus='scsi'/>

	I0807 18:27:22.202961   44266 main.go:141] libmachine: (ha-198246)       <readonly/>

	I0807 18:27:22.202972   44266 main.go:141] libmachine: (ha-198246)     </disk>

	I0807 18:27:22.202982   44266 main.go:141] libmachine: (ha-198246)     <disk type='file' device='disk'>

	I0807 18:27:22.202994   44266 main.go:141] libmachine: (ha-198246)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 18:27:22.203006   44266 main.go:141] libmachine: (ha-198246)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/ha-198246.rawdisk'/>

	I0807 18:27:22.203017   44266 main.go:141] libmachine: (ha-198246)       <target dev='hda' bus='virtio'/>

	I0807 18:27:22.203025   44266 main.go:141] libmachine: (ha-198246)     </disk>

	I0807 18:27:22.203039   44266 main.go:141] libmachine: (ha-198246)     <interface type='network'>

	I0807 18:27:22.203047   44266 main.go:141] libmachine: (ha-198246)       <source network='mk-ha-198246'/>

	I0807 18:27:22.203055   44266 main.go:141] libmachine: (ha-198246)       <model type='virtio'/>

	I0807 18:27:22.203066   44266 main.go:141] libmachine: (ha-198246)     </interface>

	I0807 18:27:22.203074   44266 main.go:141] libmachine: (ha-198246)     <interface type='network'>

	I0807 18:27:22.203086   44266 main.go:141] libmachine: (ha-198246)       <source network='default'/>

	I0807 18:27:22.203094   44266 main.go:141] libmachine: (ha-198246)       <model type='virtio'/>

	I0807 18:27:22.203103   44266 main.go:141] libmachine: (ha-198246)     </interface>

	I0807 18:27:22.203110   44266 main.go:141] libmachine: (ha-198246)     <serial type='pty'>

	I0807 18:27:22.203121   44266 main.go:141] libmachine: (ha-198246)       <target port='0'/>

	I0807 18:27:22.203127   44266 main.go:141] libmachine: (ha-198246)     </serial>

	I0807 18:27:22.203154   44266 main.go:141] libmachine: (ha-198246)     <console type='pty'>

	I0807 18:27:22.203178   44266 main.go:141] libmachine: (ha-198246)       <target type='serial' port='0'/>

	I0807 18:27:22.203188   44266 main.go:141] libmachine: (ha-198246)     </console>

	I0807 18:27:22.203200   44266 main.go:141] libmachine: (ha-198246)     <rng model='virtio'>

	I0807 18:27:22.203214   44266 main.go:141] libmachine: (ha-198246)       <backend model='random'>/dev/random</backend>

	I0807 18:27:22.203229   44266 main.go:141] libmachine: (ha-198246)     </rng>

	I0807 18:27:22.203239   44266 main.go:141] libmachine: (ha-198246)     

	I0807 18:27:22.203243   44266 main.go:141] libmachine: (ha-198246)     

	I0807 18:27:22.203251   44266 main.go:141] libmachine: (ha-198246)   </devices>

	I0807 18:27:22.203258   44266 main.go:141] libmachine: (ha-198246) </domain>

	I0807 18:27:22.203271   44266 main.go:141] libmachine: (ha-198246) 

	I0807 18:27:22.207680   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:90:2f:e2 in network default

	I0807 18:27:22.208187   44266 main.go:141] libmachine: (ha-198246) Ensuring networks are active...

	I0807 18:27:22.208224   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:22.208779   44266 main.go:141] libmachine: (ha-198246) Ensuring network default is active

	I0807 18:27:22.209008   44266 main.go:141] libmachine: (ha-198246) Ensuring network mk-ha-198246 is active

	I0807 18:27:22.209409   44266 main.go:141] libmachine: (ha-198246) Getting domain xml...

	I0807 18:27:22.209962   44266 main.go:141] libmachine: (ha-198246) Creating domain...

	I0807 18:27:23.404405   44266 main.go:141] libmachine: (ha-198246) Waiting to get IP...

	I0807 18:27:23.405206   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:23.405600   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:23.405641   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:23.405567   44289 retry.go:31] will retry after 306.958712ms: waiting for machine to come up

	I0807 18:27:23.713982   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:23.714499   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:23.714526   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:23.714462   44289 retry.go:31] will retry after 299.119708ms: waiting for machine to come up

	I0807 18:27:24.014947   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:24.015426   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:24.015446   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:24.015393   44289 retry.go:31] will retry after 384.564278ms: waiting for machine to come up

	I0807 18:27:24.402079   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:24.402483   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:24.402507   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:24.402453   44289 retry.go:31] will retry after 547.85343ms: waiting for machine to come up

	I0807 18:27:24.952336   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:24.952783   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:24.952809   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:24.952724   44289 retry.go:31] will retry after 591.886125ms: waiting for machine to come up

	I0807 18:27:25.546536   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:25.546960   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:25.546987   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:25.546919   44289 retry.go:31] will retry after 637.639818ms: waiting for machine to come up

	I0807 18:27:26.185754   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:26.186206   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:26.186253   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:26.186171   44289 retry.go:31] will retry after 1.07415852s: waiting for machine to come up

	I0807 18:27:27.261894   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:27.262328   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:27.262357   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:27.262273   44289 retry.go:31] will retry after 1.388616006s: waiting for machine to come up

	I0807 18:27:28.652877   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:28.653287   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:28.653318   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:28.653222   44289 retry.go:31] will retry after 1.163215795s: waiting for machine to come up

	I0807 18:27:29.818449   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:29.818914   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:29.818948   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:29.818858   44289 retry.go:31] will retry after 2.029996828s: waiting for machine to come up

	I0807 18:27:31.849800   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:31.850166   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:31.850195   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:31.850108   44289 retry.go:31] will retry after 1.806326332s: waiting for machine to come up

	I0807 18:27:33.659132   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:33.659739   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:33.659768   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:33.659685   44289 retry.go:31] will retry after 3.239044606s: waiting for machine to come up

	I0807 18:27:36.900422   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:36.900792   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:36.900819   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:36.900742   44289 retry.go:31] will retry after 3.037723315s: waiting for machine to come up

	I0807 18:27:39.941930   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:39.942412   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find current IP address of domain ha-198246 in network mk-ha-198246

	I0807 18:27:39.942441   44266 main.go:141] libmachine: (ha-198246) DBG | I0807 18:27:39.942337   44289 retry.go:31] will retry after 5.1268659s: waiting for machine to come up

	I0807 18:27:45.074427   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:45.074880   44266 main.go:141] libmachine: (ha-198246) Found IP for machine: 192.168.39.196

	I0807 18:27:45.074901   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has current primary IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:45.074909   44266 main.go:141] libmachine: (ha-198246) Reserving static IP address...

	I0807 18:27:45.075244   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find host DHCP lease matching {name: "ha-198246", mac: "52:54:00:b0:88:98", ip: "192.168.39.196"} in network mk-ha-198246

	I0807 18:27:45.145259   44266 main.go:141] libmachine: (ha-198246) DBG | Getting to WaitForSSH function...

	I0807 18:27:45.145285   44266 main.go:141] libmachine: (ha-198246) Reserved static IP address: 192.168.39.196

	I0807 18:27:45.145343   44266 main.go:141] libmachine: (ha-198246) Waiting for SSH to be available...

	I0807 18:27:45.147843   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:45.148233   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246

	I0807 18:27:45.148255   44266 main.go:141] libmachine: (ha-198246) DBG | unable to find defined IP address of network mk-ha-198246 interface with MAC address 52:54:00:b0:88:98

	I0807 18:27:45.148474   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH client type: external

	I0807 18:27:45.148506   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa (-rw-------)

	I0807 18:27:45.148558   44266 main.go:141] libmachine: (ha-198246) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:27:45.148578   44266 main.go:141] libmachine: (ha-198246) DBG | About to run SSH command:

	I0807 18:27:45.148592   44266 main.go:141] libmachine: (ha-198246) DBG | exit 0

	I0807 18:27:45.152274   44266 main.go:141] libmachine: (ha-198246) DBG | SSH cmd err, output: exit status 255: 

	I0807 18:27:45.152292   44266 main.go:141] libmachine: (ha-198246) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0807 18:27:45.152299   44266 main.go:141] libmachine: (ha-198246) DBG | command : exit 0

	I0807 18:27:45.152304   44266 main.go:141] libmachine: (ha-198246) DBG | err     : exit status 255

	I0807 18:27:45.152312   44266 main.go:141] libmachine: (ha-198246) DBG | output  : 

	I0807 18:27:48.153047   44266 main.go:141] libmachine: (ha-198246) DBG | Getting to WaitForSSH function...

	I0807 18:27:48.155522   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.155912   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.155936   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.156105   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH client type: external

	I0807 18:27:48.156130   44266 main.go:141] libmachine: (ha-198246) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa (-rw-------)

	I0807 18:27:48.156167   44266 main.go:141] libmachine: (ha-198246) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.196 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:27:48.156191   44266 main.go:141] libmachine: (ha-198246) DBG | About to run SSH command:

	I0807 18:27:48.156225   44266 main.go:141] libmachine: (ha-198246) DBG | exit 0

	I0807 18:27:48.280381   44266 main.go:141] libmachine: (ha-198246) DBG | SSH cmd err, output: <nil>: 

	I0807 18:27:48.280692   44266 main.go:141] libmachine: (ha-198246) KVM machine creation complete!

	I0807 18:27:48.281058   44266 main.go:141] libmachine: (ha-198246) Calling .GetConfigRaw

	I0807 18:27:48.281656   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:48.281875   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:48.282036   44266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 18:27:48.282050   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:27:48.283345   44266 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 18:27:48.283363   44266 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 18:27:48.283372   44266 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 18:27:48.283379   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.286023   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.286450   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.286469   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.286618   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.286773   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.286910   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.287021   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.287206   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.287379   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.287389   44266 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 18:27:48.387621   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:27:48.387645   44266 main.go:141] libmachine: Detecting the provisioner...

	I0807 18:27:48.387655   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.390612   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.391010   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.391041   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.391226   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.391498   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.391674   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.391801   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.392003   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.392181   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.392195   44266 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 18:27:48.492889   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 18:27:48.492963   44266 main.go:141] libmachine: found compatible host: buildroot

	I0807 18:27:48.492969   44266 main.go:141] libmachine: Provisioning with buildroot...

	I0807 18:27:48.492976   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:48.493236   44266 buildroot.go:166] provisioning hostname "ha-198246"

	I0807 18:27:48.493263   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:48.493468   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.496265   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.496578   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.496602   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.496742   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.496924   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.497076   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.497274   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.497500   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.497677   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.497689   44266 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-198246 && echo "ha-198246" | sudo tee /etc/hostname

	I0807 18:27:48.615801   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-198246

	I0807 18:27:48.615855   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.618925   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.619286   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.619315   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.619478   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.619662   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.619808   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.619965   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.620141   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:48.620341   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:48.620359   44266 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-198246' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-198246/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-198246' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 18:27:48.729682   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:27:48.729740   44266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 18:27:48.729770   44266 buildroot.go:174] setting up certificates

	I0807 18:27:48.729789   44266 provision.go:84] configureAuth start

	I0807 18:27:48.729808   44266 main.go:141] libmachine: (ha-198246) Calling .GetMachineName

	I0807 18:27:48.730094   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:48.732947   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.733289   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.733317   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.733475   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.735604   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.735911   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.735935   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.736091   44266 provision.go:143] copyHostCerts

	I0807 18:27:48.736118   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:27:48.736160   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem, removing ...

	I0807 18:27:48.736174   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:27:48.736261   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 18:27:48.736361   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:27:48.736380   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem, removing ...

	I0807 18:27:48.736386   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:27:48.736428   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 18:27:48.736530   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:27:48.736553   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem, removing ...

	I0807 18:27:48.736560   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:27:48.736583   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 18:27:48.736657   44266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.ha-198246 san=[127.0.0.1 192.168.39.196 ha-198246 localhost minikube]

	I0807 18:27:48.961157   44266 provision.go:177] copyRemoteCerts

	I0807 18:27:48.961215   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 18:27:48.961238   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:48.964265   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.964661   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:48.964697   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:48.964961   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:48.965206   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:48.965427   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:48.965581   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.047016   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0807 18:27:49.047096   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 18:27:49.071078   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0807 18:27:49.071152   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0807 18:27:49.095496   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0807 18:27:49.095566   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0807 18:27:49.120006   44266 provision.go:87] duration metric: took 390.201413ms to configureAuth

	I0807 18:27:49.120032   44266 buildroot.go:189] setting minikube options for container-runtime

	I0807 18:27:49.120250   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:27:49.120330   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.122781   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.123123   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.123148   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.123319   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.123504   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.123653   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.123754   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.123923   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:49.124077   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:49.124093   44266 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 18:27:49.379427   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 18:27:49.379449   44266 main.go:141] libmachine: Checking connection to Docker...

	I0807 18:27:49.379457   44266 main.go:141] libmachine: (ha-198246) Calling .GetURL

	I0807 18:27:49.381160   44266 main.go:141] libmachine: (ha-198246) DBG | Using libvirt version 6000000

	I0807 18:27:49.383505   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.383829   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.383861   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.384032   44266 main.go:141] libmachine: Docker is up and running!

	I0807 18:27:49.384051   44266 main.go:141] libmachine: Reticulating splines...

	I0807 18:27:49.384060   44266 client.go:171] duration metric: took 27.57529956s to LocalClient.Create

	I0807 18:27:49.384091   44266 start.go:167] duration metric: took 27.575373855s to libmachine.API.Create "ha-198246"

	I0807 18:27:49.384103   44266 start.go:293] postStartSetup for "ha-198246" (driver="kvm2")

	I0807 18:27:49.384117   44266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 18:27:49.384137   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.384384   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 18:27:49.384406   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.387011   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.387377   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.387400   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.387601   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.387778   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.387917   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.388019   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.467416   44266 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 18:27:49.471819   44266 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 18:27:49.471844   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 18:27:49.471913   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 18:27:49.471996   44266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> 280522.pem in /etc/ssl/certs

	I0807 18:27:49.472007   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /etc/ssl/certs/280522.pem

	I0807 18:27:49.472100   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0807 18:27:49.482472   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:27:49.507293   44266 start.go:296] duration metric: took 123.178167ms for postStartSetup

	I0807 18:27:49.507345   44266 main.go:141] libmachine: (ha-198246) Calling .GetConfigRaw

	I0807 18:27:49.507928   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:49.510575   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.511008   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.511039   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.511346   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:27:49.511529   44266 start.go:128] duration metric: took 27.720249653s to createHost

	I0807 18:27:49.511551   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.513835   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.514239   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.514268   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.514412   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.514597   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.514751   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.514864   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.515031   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:27:49.515233   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.196 22 <nil> <nil>}

	I0807 18:27:49.515246   44266 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0807 18:27:49.621198   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723055269.601266320

	I0807 18:27:49.621228   44266 fix.go:216] guest clock: 1723055269.601266320

	I0807 18:27:49.621239   44266 fix.go:229] Guest: 2024-08-07 18:27:49.60126632 +0000 UTC Remote: 2024-08-07 18:27:49.511541014 +0000 UTC m=+27.822561678 (delta=89.725306ms)

	I0807 18:27:49.621348   44266 fix.go:200] guest clock delta is within tolerance: 89.725306ms

	I0807 18:27:49.621358   44266 start.go:83] releasing machines lock for "ha-198246", held for 27.830148378s

	I0807 18:27:49.621384   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.621648   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:49.624076   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.624475   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.624506   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.624646   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.625094   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.625251   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:27:49.625329   44266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 18:27:49.625368   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.625433   44266 ssh_runner.go:195] Run: cat /version.json

	I0807 18:27:49.625456   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:27:49.628179   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628428   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628489   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.628513   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628653   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.628845   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.628875   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:49.628902   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:49.628989   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.629163   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:27:49.629174   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.629309   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:27:49.629489   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:27:49.629653   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:27:49.707121   44266 ssh_runner.go:195] Run: systemctl --version

	I0807 18:27:49.730199   44266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 18:27:49.894353   44266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 18:27:49.901460   44266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 18:27:49.901532   44266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 18:27:49.918470   44266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 18:27:49.918496   44266 start.go:495] detecting cgroup driver to use...

	I0807 18:27:49.918550   44266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 18:27:49.935346   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 18:27:49.950325   44266 docker.go:217] disabling cri-docker service (if available) ...

	I0807 18:27:49.950373   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 18:27:49.965026   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 18:27:49.979393   44266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 18:27:50.101391   44266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 18:27:50.266571   44266 docker.go:233] disabling docker service ...

	I0807 18:27:50.266633   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 18:27:50.280886   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 18:27:50.293687   44266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 18:27:50.411890   44266 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 18:27:50.531647   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 18:27:50.545917   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 18:27:50.565503   44266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 18:27:50.565564   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.577648   44266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 18:27:50.577727   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.589717   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.601142   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.612276   44266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 18:27:50.623423   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.634380   44266 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.652648   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:27:50.664994   44266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 18:27:50.675990   44266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 18:27:50.676071   44266 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 18:27:50.690790   44266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 18:27:50.702376   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:27:50.836087   44266 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 18:27:50.977071   44266 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 18:27:50.977144   44266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 18:27:50.982362   44266 start.go:563] Will wait 60s for crictl version

	I0807 18:27:50.982434   44266 ssh_runner.go:195] Run: which crictl

	I0807 18:27:50.986273   44266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 18:27:51.023888   44266 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 18:27:51.023993   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:27:51.051884   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:27:51.082665   44266 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 18:27:51.083804   44266 main.go:141] libmachine: (ha-198246) Calling .GetIP

	I0807 18:27:51.086499   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:51.086829   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:27:51.086855   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:27:51.087080   44266 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 18:27:51.091372   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:27:51.104446   44266 kubeadm.go:883] updating cluster {Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cl

usterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0807 18:27:51.104537   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:27:51.104583   44266 ssh_runner.go:195] Run: sudo crictl images --output json

	I0807 18:27:51.135506   44266 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.3". assuming images are not preloaded.

	I0807 18:27:51.135568   44266 ssh_runner.go:195] Run: which lz4

	I0807 18:27:51.140129   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0807 18:27:51.140252   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0807 18:27:51.144801   44266 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0807 18:27:51.144833   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (406200976 bytes)

	I0807 18:27:52.554895   44266 crio.go:462] duration metric: took 1.414692613s to copy over tarball

	I0807 18:27:52.555019   44266 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0807 18:27:54.702005   44266 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.146953106s)

	I0807 18:27:54.702032   44266 crio.go:469] duration metric: took 2.147109225s to extract the tarball

	I0807 18:27:54.702041   44266 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0807 18:27:54.740000   44266 ssh_runner.go:195] Run: sudo crictl images --output json

	I0807 18:27:54.786797   44266 crio.go:514] all images are preloaded for cri-o runtime.

	I0807 18:27:54.786816   44266 cache_images.go:84] Images are preloaded, skipping loading

	I0807 18:27:54.786825   44266 kubeadm.go:934] updating node { 192.168.39.196 8443 v1.30.3 crio true true} ...

	I0807 18:27:54.786956   44266 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-198246 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.196

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 18:27:54.787033   44266 ssh_runner.go:195] Run: crio config

	I0807 18:27:54.830632   44266 cni.go:84] Creating CNI manager for ""

	I0807 18:27:54.830659   44266 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0807 18:27:54.830671   44266 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0807 18:27:54.830691   44266 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.196 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-198246 NodeName:ha-198246 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.196"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.196 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0807 18:27:54.830808   44266 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.196

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-198246"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.196

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.196"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0807 18:27:54.830828   44266 kube-vip.go:115] generating kube-vip config ...

	I0807 18:27:54.830867   44266 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0807 18:27:54.849054   44266 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0807 18:27:54.849165   44266 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0807 18:27:54.849229   44266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 18:27:54.859040   44266 binaries.go:44] Found k8s binaries, skipping transfer

	I0807 18:27:54.859110   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0807 18:27:54.868475   44266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0807 18:27:54.885744   44266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 18:27:54.902712   44266 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0807 18:27:54.919755   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0807 18:27:54.936740   44266 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0807 18:27:54.940938   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:27:54.953525   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:27:55.078749   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:27:55.097378   44266 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246 for IP: 192.168.39.196

	I0807 18:27:55.097404   44266 certs.go:194] generating shared ca certs ...

	I0807 18:27:55.097422   44266 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.097635   44266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 18:27:55.097699   44266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 18:27:55.097714   44266 certs.go:256] generating profile certs ...

	I0807 18:27:55.097787   44266 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key

	I0807 18:27:55.097814   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt with IP's: []

	I0807 18:27:55.208693   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt ...

	I0807 18:27:55.208724   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt: {Name:mka7fa8cfb74ff61110b7cfa5be9a6c01adb62d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.208915   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key ...

	I0807 18:27:55.208929   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key: {Name:mk2f8f0495ba491dab5e08ca790f78097bcc62bb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.209031   44266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4

	I0807 18:27:55.209049   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.196 192.168.39.254]

	I0807 18:27:55.624285   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4 ...

	I0807 18:27:55.624314   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4: {Name:mkd68d7f250c70cd5fa8d28ad5bc1bbe0c86a654 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.624461   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4 ...

	I0807 18:27:55.624473   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4: {Name:mkff3833d02b04ce9c36a734c937e13f709f80e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.624542   44266 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.890fd0f4 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt

	I0807 18:27:55.624619   44266 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.890fd0f4 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key

	I0807 18:27:55.624669   44266 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key

	I0807 18:27:55.624697   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt with IP's: []

	I0807 18:27:55.759073   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt ...

	I0807 18:27:55.759102   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt: {Name:mkb3499dae347a7cfa9dfc4b50cfa2f9ee673ecb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.759241   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key ...

	I0807 18:27:55.759251   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key: {Name:mk07d2a285004089dd73e71e881ed70e932c4b60 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:27:55.759316   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0807 18:27:55.759333   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0807 18:27:55.759346   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0807 18:27:55.759360   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0807 18:27:55.759372   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0807 18:27:55.759384   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0807 18:27:55.759400   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0807 18:27:55.759412   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0807 18:27:55.759461   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem (1338 bytes)

	W0807 18:27:55.759494   44266 certs.go:480] ignoring /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052_empty.pem, impossibly tiny 0 bytes

	I0807 18:27:55.759504   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 18:27:55.759526   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 18:27:55.759550   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 18:27:55.759571   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 18:27:55.759608   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:27:55.759632   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:55.759646   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem -> /usr/share/ca-certificates/28052.pem

	I0807 18:27:55.759658   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /usr/share/ca-certificates/280522.pem

	I0807 18:27:55.760218   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 18:27:55.787520   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 18:27:55.815044   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 18:27:55.840056   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 18:27:55.867094   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0807 18:27:55.897468   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0807 18:27:55.954340   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 18:27:55.987648   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 18:27:56.013314   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 18:27:56.039452   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem --> /usr/share/ca-certificates/28052.pem (1338 bytes)

	I0807 18:27:56.065754   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /usr/share/ca-certificates/280522.pem (1708 bytes)

	I0807 18:27:56.091942   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0807 18:27:56.111135   44266 ssh_runner.go:195] Run: openssl version

	I0807 18:27:56.117304   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 18:27:56.128689   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:56.133805   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:56.133860   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:27:56.140551   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 18:27:56.152253   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/28052.pem && ln -fs /usr/share/ca-certificates/28052.pem /etc/ssl/certs/28052.pem"

	I0807 18:27:56.164005   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/28052.pem

	I0807 18:27:56.169124   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  7 18:17 /usr/share/ca-certificates/28052.pem

	I0807 18:27:56.169182   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/28052.pem

	I0807 18:27:56.175462   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/28052.pem /etc/ssl/certs/51391683.0"

	I0807 18:27:56.187518   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/280522.pem && ln -fs /usr/share/ca-certificates/280522.pem /etc/ssl/certs/280522.pem"

	I0807 18:27:56.201710   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/280522.pem

	I0807 18:27:56.206624   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  7 18:17 /usr/share/ca-certificates/280522.pem

	I0807 18:27:56.206673   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/280522.pem

	I0807 18:27:56.212905   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/280522.pem /etc/ssl/certs/3ec20f2e.0"

	I0807 18:27:56.224505   44266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 18:27:56.229013   44266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 18:27:56.229063   44266 kubeadm.go:392] StartCluster: {Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Clust

erName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 18:27:56.229135   44266 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0807 18:27:56.229186   44266 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0807 18:27:56.270696   44266 cri.go:89] found id: ""

	I0807 18:27:56.270773   44266 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0807 18:27:56.281401   44266 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0807 18:27:56.291997   44266 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0807 18:27:56.302725   44266 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0807 18:27:56.302745   44266 kubeadm.go:157] found existing configuration files:

	I0807 18:27:56.302792   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0807 18:27:56.312979   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0807 18:27:56.313046   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0807 18:27:56.323033   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0807 18:27:56.332468   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0807 18:27:56.332514   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0807 18:27:56.342420   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0807 18:27:56.351963   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0807 18:27:56.352032   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0807 18:27:56.361913   44266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0807 18:27:56.371591   44266 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0807 18:27:56.371657   44266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0807 18:27:56.381281   44266 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0807 18:27:56.488327   44266 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3

	I0807 18:27:56.488440   44266 kubeadm.go:310] [preflight] Running pre-flight checks

	I0807 18:27:56.624126   44266 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0807 18:27:56.624281   44266 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0807 18:27:56.624494   44266 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0807 18:27:56.873034   44266 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0807 18:27:56.990825   44266 out.go:204]   - Generating certificates and keys ...

	I0807 18:27:56.990959   44266 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0807 18:27:56.991052   44266 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0807 18:27:57.066929   44266 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0807 18:27:57.283110   44266 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0807 18:27:57.486271   44266 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0807 18:27:57.678831   44266 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0807 18:27:57.750579   44266 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0807 18:27:57.750810   44266 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-198246 localhost] and IPs [192.168.39.196 127.0.0.1 ::1]

	I0807 18:27:58.190149   44266 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0807 18:27:58.190378   44266 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-198246 localhost] and IPs [192.168.39.196 127.0.0.1 ::1]

	I0807 18:27:58.450761   44266 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0807 18:27:58.618895   44266 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0807 18:27:58.844633   44266 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0807 18:27:58.844738   44266 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0807 18:27:58.940356   44266 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0807 18:27:59.154431   44266 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0807 18:27:59.281640   44266 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0807 18:27:59.360167   44266 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0807 18:27:59.439806   44266 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0807 18:27:59.440368   44266 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0807 18:27:59.443581   44266 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0807 18:27:59.445418   44266 out.go:204]   - Booting up control plane ...

	I0807 18:27:59.445508   44266 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0807 18:27:59.446192   44266 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0807 18:27:59.446957   44266 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0807 18:27:59.461414   44266 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0807 18:27:59.462292   44266 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0807 18:27:59.462339   44266 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0807 18:27:59.600411   44266 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0807 18:27:59.600545   44266 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0807 18:28:00.099690   44266 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.352376ms

	I0807 18:28:00.099804   44266 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0807 18:28:05.959621   44266 kubeadm.go:310] [api-check] The API server is healthy after 5.862299271s

	I0807 18:28:05.975846   44266 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0807 18:28:06.014624   44266 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0807 18:28:06.042297   44266 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0807 18:28:06.042535   44266 kubeadm.go:310] [mark-control-plane] Marking the node ha-198246 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0807 18:28:06.057030   44266 kubeadm.go:310] [bootstrap-token] Using token: acde14.b8y6evu3gygtakpe

	I0807 18:28:06.058575   44266 out.go:204]   - Configuring RBAC rules ...

	I0807 18:28:06.058714   44266 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0807 18:28:06.066217   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0807 18:28:06.080020   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0807 18:28:06.087791   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0807 18:28:06.092681   44266 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0807 18:28:06.096020   44266 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0807 18:28:06.374616   44266 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0807 18:28:06.820636   44266 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0807 18:28:07.370115   44266 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0807 18:28:07.370141   44266 kubeadm.go:310] 

	I0807 18:28:07.370203   44266 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0807 18:28:07.370211   44266 kubeadm.go:310] 

	I0807 18:28:07.370295   44266 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0807 18:28:07.370303   44266 kubeadm.go:310] 

	I0807 18:28:07.370345   44266 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0807 18:28:07.370425   44266 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0807 18:28:07.370496   44266 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0807 18:28:07.370506   44266 kubeadm.go:310] 

	I0807 18:28:07.370578   44266 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0807 18:28:07.370587   44266 kubeadm.go:310] 

	I0807 18:28:07.370652   44266 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0807 18:28:07.370661   44266 kubeadm.go:310] 

	I0807 18:28:07.370747   44266 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0807 18:28:07.370856   44266 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0807 18:28:07.370953   44266 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0807 18:28:07.370964   44266 kubeadm.go:310] 

	I0807 18:28:07.371074   44266 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0807 18:28:07.371188   44266 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0807 18:28:07.371231   44266 kubeadm.go:310] 

	I0807 18:28:07.371348   44266 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token acde14.b8y6evu3gygtakpe \

	I0807 18:28:07.371521   44266 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 \

	I0807 18:28:07.371563   44266 kubeadm.go:310] 	--control-plane 

	I0807 18:28:07.371570   44266 kubeadm.go:310] 

	I0807 18:28:07.371677   44266 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0807 18:28:07.371685   44266 kubeadm.go:310] 

	I0807 18:28:07.371782   44266 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token acde14.b8y6evu3gygtakpe \

	I0807 18:28:07.371920   44266 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 

	I0807 18:28:07.372287   44266 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0807 18:28:07.372313   44266 cni.go:84] Creating CNI manager for ""

	I0807 18:28:07.372321   44266 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0807 18:28:07.374314   44266 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0807 18:28:07.375747   44266 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0807 18:28:07.381422   44266 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...

	I0807 18:28:07.381440   44266 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0807 18:28:07.402202   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0807 18:28:07.779600   44266 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0807 18:28:07.779665   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:07.779684   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-198246 minikube.k8s.io/updated_at=2024_08_07T18_28_07_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=ha-198246 minikube.k8s.io/primary=true

	I0807 18:28:07.798602   44266 ops.go:34] apiserver oom_adj: -16

	I0807 18:28:08.016757   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:08.517348   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:09.017382   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:09.516834   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:10.017237   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:10.517025   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:11.017393   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:11.517645   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:12.017006   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:12.517242   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:13.017450   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:13.517301   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:14.017420   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:14.517520   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:15.016948   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:15.517754   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:16.016906   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:16.517576   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:17.017692   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:17.517425   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:18.017663   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:18.517834   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:19.017814   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:19.516956   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:20.017249   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:20.516839   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0807 18:28:20.593055   44266 kubeadm.go:1113] duration metric: took 12.81344917s to wait for elevateKubeSystemPrivileges

	I0807 18:28:20.593093   44266 kubeadm.go:394] duration metric: took 24.364034512s to StartCluster

	I0807 18:28:20.593114   44266 settings.go:142] acquiring lock: {Name:mke44792daf8192c7cb4430e19df00c0686edd5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:20.593205   44266 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:28:20.593898   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/kubeconfig: {Name:mk9a4ad53bf4447453626a7769211592f39f92fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:20.594131   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0807 18:28:20.594146   44266 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0807 18:28:20.594202   44266 addons.go:69] Setting storage-provisioner=true in profile "ha-198246"

	I0807 18:28:20.594127   44266 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:28:20.594240   44266 start.go:241] waiting for startup goroutines ...

	I0807 18:28:20.594244   44266 addons.go:234] Setting addon storage-provisioner=true in "ha-198246"

	I0807 18:28:20.594253   44266 addons.go:69] Setting default-storageclass=true in profile "ha-198246"

	I0807 18:28:20.594272   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:28:20.594281   44266 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-198246"

	I0807 18:28:20.594338   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:20.594625   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.594626   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.594650   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.594656   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.609354   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36055

	I0807 18:28:20.609414   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38699

	I0807 18:28:20.609790   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.609862   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.610266   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.610283   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.610389   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.610410   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.610618   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.610723   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.610793   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:20.611217   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.611247   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.612810   44266 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:28:20.613017   44266 kapi.go:59] client config for ha-198246: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt", KeyFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key", CAFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02a80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0807 18:28:20.613524   44266 addons.go:234] Setting addon default-storageclass=true in "ha-198246"

	I0807 18:28:20.613554   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:28:20.613774   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.613789   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.613921   44266 cert_rotation.go:137] Starting client certificate rotation controller

	I0807 18:28:20.626271   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46075

	I0807 18:28:20.626822   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.627365   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.627390   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.627663   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.627835   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:20.628446   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42551

	I0807 18:28:20.628810   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.629360   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.629383   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.629588   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:28:20.629689   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.630104   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:20.630142   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:20.631750   44266 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0807 18:28:20.633155   44266 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0807 18:28:20.633177   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0807 18:28:20.633196   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:28:20.636123   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.636542   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:28:20.636568   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.636689   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:28:20.636880   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:28:20.637013   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:28:20.637127   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:28:20.646444   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38675

	I0807 18:28:20.646903   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:20.647381   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:20.647407   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:20.647701   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:20.647869   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:20.649389   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:28:20.649621   44266 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0807 18:28:20.649639   44266 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0807 18:28:20.649655   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:28:20.652497   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.652927   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:28:20.652955   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:20.653107   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:28:20.653303   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:28:20.653475   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:28:20.653622   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:28:20.708691   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0807 18:28:20.771288   44266 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0807 18:28:20.803911   44266 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0807 18:28:21.019837   44266 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0807 18:28:21.230253   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230275   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.230346   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230366   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.230561   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.230578   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.230586   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230594   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.230677   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.230683   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.230695   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.230703   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.230710   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.232188   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.232193   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.232228   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.232229   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.232250   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.232250   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.232412   44266 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0807 18:28:21.232423   44266 round_trippers.go:469] Request Headers:

	I0807 18:28:21.232433   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:28:21.232442   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:28:21.244939   44266 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I0807 18:28:21.245737   44266 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0807 18:28:21.245758   44266 round_trippers.go:469] Request Headers:

	I0807 18:28:21.245768   44266 round_trippers.go:473]     Content-Type: application/json

	I0807 18:28:21.245779   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:28:21.245784   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:28:21.248031   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:28:21.248194   44266 main.go:141] libmachine: Making call to close driver server

	I0807 18:28:21.248228   44266 main.go:141] libmachine: (ha-198246) Calling .Close

	I0807 18:28:21.248571   44266 main.go:141] libmachine: (ha-198246) DBG | Closing plugin on server side

	I0807 18:28:21.248579   44266 main.go:141] libmachine: Successfully made call to close driver server

	I0807 18:28:21.248602   44266 main.go:141] libmachine: Making call to close connection to plugin binary

	I0807 18:28:21.251329   44266 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0807 18:28:21.252717   44266 addons.go:510] duration metric: took 658.567856ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0807 18:28:21.252752   44266 start.go:246] waiting for cluster config update ...

	I0807 18:28:21.252766   44266 start.go:255] writing updated cluster config ...

	I0807 18:28:21.254496   44266 out.go:177] 

	I0807 18:28:21.255798   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:21.255869   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:28:21.257396   44266 out.go:177] * Starting "ha-198246-m02" control-plane node in "ha-198246" cluster

	I0807 18:28:21.258544   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:28:21.258563   44266 cache.go:56] Caching tarball of preloaded images

	I0807 18:28:21.258651   44266 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 18:28:21.258666   44266 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 18:28:21.258740   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:28:21.258909   44266 start.go:360] acquireMachinesLock for ha-198246-m02: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 18:28:21.258952   44266 start.go:364] duration metric: took 24.011µs to acquireMachinesLock for "ha-198246-m02"

	I0807 18:28:21.258975   44266 start.go:93] Provisioning new machine with config: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:28:21.259059   44266 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0807 18:28:21.260585   44266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0807 18:28:21.260664   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:21.260685   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:21.274940   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34303

	I0807 18:28:21.275393   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:21.275883   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:21.275912   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:21.276238   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:21.276417   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:21.276559   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:21.276724   44266 start.go:159] libmachine.API.Create for "ha-198246" (driver="kvm2")

	I0807 18:28:21.276747   44266 client.go:168] LocalClient.Create starting

	I0807 18:28:21.276782   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 18:28:21.276821   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:28:21.276844   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:28:21.276909   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 18:28:21.276934   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:28:21.276948   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:28:21.276978   44266 main.go:141] libmachine: Running pre-create checks...

	I0807 18:28:21.276990   44266 main.go:141] libmachine: (ha-198246-m02) Calling .PreCreateCheck

	I0807 18:28:21.277160   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetConfigRaw

	I0807 18:28:21.277503   44266 main.go:141] libmachine: Creating machine...

	I0807 18:28:21.277517   44266 main.go:141] libmachine: (ha-198246-m02) Calling .Create

	I0807 18:28:21.277664   44266 main.go:141] libmachine: (ha-198246-m02) Creating KVM machine...

	I0807 18:28:21.278838   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found existing default KVM network

	I0807 18:28:21.278997   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found existing private KVM network mk-ha-198246

	I0807 18:28:21.279157   44266 main.go:141] libmachine: (ha-198246-m02) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02 ...

	I0807 18:28:21.279196   44266 main.go:141] libmachine: (ha-198246-m02) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 18:28:21.279252   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.279170   44685 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:28:21.279333   44266 main.go:141] libmachine: (ha-198246-m02) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 18:28:21.511603   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.511453   44685 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa...

	I0807 18:28:21.728136   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.727998   44685 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/ha-198246-m02.rawdisk...

	I0807 18:28:21.728162   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Writing magic tar header

	I0807 18:28:21.728173   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Writing SSH key tar header

	I0807 18:28:21.728181   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:21.728108   44685 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02 ...

	I0807 18:28:21.728242   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02

	I0807 18:28:21.728271   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02 (perms=drwx------)

	I0807 18:28:21.728290   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 18:28:21.728311   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:28:21.728325   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 18:28:21.728339   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 18:28:21.728355   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 18:28:21.728367   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 18:28:21.728379   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home/jenkins

	I0807 18:28:21.728394   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Checking permissions on dir: /home

	I0807 18:28:21.728405   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Skipping /home - not owner

	I0807 18:28:21.728422   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 18:28:21.728437   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 18:28:21.728467   44266 main.go:141] libmachine: (ha-198246-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 18:28:21.728487   44266 main.go:141] libmachine: (ha-198246-m02) Creating domain...

	I0807 18:28:21.729349   44266 main.go:141] libmachine: (ha-198246-m02) define libvirt domain using xml: 

	I0807 18:28:21.729400   44266 main.go:141] libmachine: (ha-198246-m02) <domain type='kvm'>

	I0807 18:28:21.729415   44266 main.go:141] libmachine: (ha-198246-m02)   <name>ha-198246-m02</name>

	I0807 18:28:21.729428   44266 main.go:141] libmachine: (ha-198246-m02)   <memory unit='MiB'>2200</memory>

	I0807 18:28:21.729439   44266 main.go:141] libmachine: (ha-198246-m02)   <vcpu>2</vcpu>

	I0807 18:28:21.729455   44266 main.go:141] libmachine: (ha-198246-m02)   <features>

	I0807 18:28:21.729466   44266 main.go:141] libmachine: (ha-198246-m02)     <acpi/>

	I0807 18:28:21.729474   44266 main.go:141] libmachine: (ha-198246-m02)     <apic/>

	I0807 18:28:21.729486   44266 main.go:141] libmachine: (ha-198246-m02)     <pae/>

	I0807 18:28:21.729493   44266 main.go:141] libmachine: (ha-198246-m02)     

	I0807 18:28:21.729502   44266 main.go:141] libmachine: (ha-198246-m02)   </features>

	I0807 18:28:21.729510   44266 main.go:141] libmachine: (ha-198246-m02)   <cpu mode='host-passthrough'>

	I0807 18:28:21.729518   44266 main.go:141] libmachine: (ha-198246-m02)   

	I0807 18:28:21.729530   44266 main.go:141] libmachine: (ha-198246-m02)   </cpu>

	I0807 18:28:21.729541   44266 main.go:141] libmachine: (ha-198246-m02)   <os>

	I0807 18:28:21.729550   44266 main.go:141] libmachine: (ha-198246-m02)     <type>hvm</type>

	I0807 18:28:21.729563   44266 main.go:141] libmachine: (ha-198246-m02)     <boot dev='cdrom'/>

	I0807 18:28:21.729574   44266 main.go:141] libmachine: (ha-198246-m02)     <boot dev='hd'/>

	I0807 18:28:21.729587   44266 main.go:141] libmachine: (ha-198246-m02)     <bootmenu enable='no'/>

	I0807 18:28:21.729597   44266 main.go:141] libmachine: (ha-198246-m02)   </os>

	I0807 18:28:21.729627   44266 main.go:141] libmachine: (ha-198246-m02)   <devices>

	I0807 18:28:21.729665   44266 main.go:141] libmachine: (ha-198246-m02)     <disk type='file' device='cdrom'>

	I0807 18:28:21.729686   44266 main.go:141] libmachine: (ha-198246-m02)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/boot2docker.iso'/>

	I0807 18:28:21.729699   44266 main.go:141] libmachine: (ha-198246-m02)       <target dev='hdc' bus='scsi'/>

	I0807 18:28:21.729711   44266 main.go:141] libmachine: (ha-198246-m02)       <readonly/>

	I0807 18:28:21.729721   44266 main.go:141] libmachine: (ha-198246-m02)     </disk>

	I0807 18:28:21.729734   44266 main.go:141] libmachine: (ha-198246-m02)     <disk type='file' device='disk'>

	I0807 18:28:21.729748   44266 main.go:141] libmachine: (ha-198246-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 18:28:21.729765   44266 main.go:141] libmachine: (ha-198246-m02)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/ha-198246-m02.rawdisk'/>

	I0807 18:28:21.729773   44266 main.go:141] libmachine: (ha-198246-m02)       <target dev='hda' bus='virtio'/>

	I0807 18:28:21.729781   44266 main.go:141] libmachine: (ha-198246-m02)     </disk>

	I0807 18:28:21.729789   44266 main.go:141] libmachine: (ha-198246-m02)     <interface type='network'>

	I0807 18:28:21.729799   44266 main.go:141] libmachine: (ha-198246-m02)       <source network='mk-ha-198246'/>

	I0807 18:28:21.729807   44266 main.go:141] libmachine: (ha-198246-m02)       <model type='virtio'/>

	I0807 18:28:21.729816   44266 main.go:141] libmachine: (ha-198246-m02)     </interface>

	I0807 18:28:21.729832   44266 main.go:141] libmachine: (ha-198246-m02)     <interface type='network'>

	I0807 18:28:21.729845   44266 main.go:141] libmachine: (ha-198246-m02)       <source network='default'/>

	I0807 18:28:21.729856   44266 main.go:141] libmachine: (ha-198246-m02)       <model type='virtio'/>

	I0807 18:28:21.729868   44266 main.go:141] libmachine: (ha-198246-m02)     </interface>

	I0807 18:28:21.729875   44266 main.go:141] libmachine: (ha-198246-m02)     <serial type='pty'>

	I0807 18:28:21.729887   44266 main.go:141] libmachine: (ha-198246-m02)       <target port='0'/>

	I0807 18:28:21.729895   44266 main.go:141] libmachine: (ha-198246-m02)     </serial>

	I0807 18:28:21.729923   44266 main.go:141] libmachine: (ha-198246-m02)     <console type='pty'>

	I0807 18:28:21.729945   44266 main.go:141] libmachine: (ha-198246-m02)       <target type='serial' port='0'/>

	I0807 18:28:21.729956   44266 main.go:141] libmachine: (ha-198246-m02)     </console>

	I0807 18:28:21.729961   44266 main.go:141] libmachine: (ha-198246-m02)     <rng model='virtio'>

	I0807 18:28:21.729976   44266 main.go:141] libmachine: (ha-198246-m02)       <backend model='random'>/dev/random</backend>

	I0807 18:28:21.729987   44266 main.go:141] libmachine: (ha-198246-m02)     </rng>

	I0807 18:28:21.729995   44266 main.go:141] libmachine: (ha-198246-m02)     

	I0807 18:28:21.730002   44266 main.go:141] libmachine: (ha-198246-m02)     

	I0807 18:28:21.730010   44266 main.go:141] libmachine: (ha-198246-m02)   </devices>

	I0807 18:28:21.730016   44266 main.go:141] libmachine: (ha-198246-m02) </domain>

	I0807 18:28:21.730025   44266 main.go:141] libmachine: (ha-198246-m02) 

	I0807 18:28:21.736803   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:b2:15:7e in network default

	I0807 18:28:21.737390   44266 main.go:141] libmachine: (ha-198246-m02) Ensuring networks are active...

	I0807 18:28:21.737416   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:21.738108   44266 main.go:141] libmachine: (ha-198246-m02) Ensuring network default is active

	I0807 18:28:21.738450   44266 main.go:141] libmachine: (ha-198246-m02) Ensuring network mk-ha-198246 is active

	I0807 18:28:21.738836   44266 main.go:141] libmachine: (ha-198246-m02) Getting domain xml...

	I0807 18:28:21.739511   44266 main.go:141] libmachine: (ha-198246-m02) Creating domain...

	I0807 18:28:22.980593   44266 main.go:141] libmachine: (ha-198246-m02) Waiting to get IP...

	I0807 18:28:22.981319   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:22.981653   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:22.981678   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:22.981626   44685 retry.go:31] will retry after 277.857687ms: waiting for machine to come up

	I0807 18:28:23.261356   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:23.261928   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:23.261955   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:23.261836   44685 retry.go:31] will retry after 296.896309ms: waiting for machine to come up

	I0807 18:28:23.560474   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:23.560953   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:23.560974   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:23.560905   44685 retry.go:31] will retry after 431.200025ms: waiting for machine to come up

	I0807 18:28:23.993408   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:23.993831   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:23.993860   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:23.993783   44685 retry.go:31] will retry after 489.747622ms: waiting for machine to come up

	I0807 18:28:24.485553   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:24.486096   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:24.486118   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:24.486038   44685 retry.go:31] will retry after 595.37365ms: waiting for machine to come up

	I0807 18:28:25.082858   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:25.083273   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:25.083297   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:25.083229   44685 retry.go:31] will retry after 864.817898ms: waiting for machine to come up

	I0807 18:28:25.949301   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:25.949755   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:25.949787   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:25.949705   44685 retry.go:31] will retry after 980.056682ms: waiting for machine to come up

	I0807 18:28:26.931211   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:26.931633   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:26.931667   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:26.931574   44685 retry.go:31] will retry after 1.374312311s: waiting for machine to come up

	I0807 18:28:28.308159   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:28.308539   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:28.308588   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:28.308503   44685 retry.go:31] will retry after 1.32565444s: waiting for machine to come up

	I0807 18:28:29.635739   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:29.636210   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:29.636236   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:29.636128   44685 retry.go:31] will retry after 2.094612533s: waiting for machine to come up

	I0807 18:28:31.731860   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:31.732338   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:31.732366   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:31.732297   44685 retry.go:31] will retry after 2.384083205s: waiting for machine to come up

	I0807 18:28:34.117344   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:34.117765   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:34.117789   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:34.117726   44685 retry.go:31] will retry after 3.244651745s: waiting for machine to come up

	I0807 18:28:37.364060   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:37.364496   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find current IP address of domain ha-198246-m02 in network mk-ha-198246

	I0807 18:28:37.364524   44266 main.go:141] libmachine: (ha-198246-m02) DBG | I0807 18:28:37.364456   44685 retry.go:31] will retry after 3.883256435s: waiting for machine to come up

	I0807 18:28:41.249166   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.249651   44266 main.go:141] libmachine: (ha-198246-m02) Found IP for machine: 192.168.39.251

	I0807 18:28:41.249682   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has current primary IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.249838   44266 main.go:141] libmachine: (ha-198246-m02) Reserving static IP address...

	I0807 18:28:41.250128   44266 main.go:141] libmachine: (ha-198246-m02) DBG | unable to find host DHCP lease matching {name: "ha-198246-m02", mac: "52:54:00:c8:91:fc", ip: "192.168.39.251"} in network mk-ha-198246

	I0807 18:28:41.326471   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Getting to WaitForSSH function...

	I0807 18:28:41.326495   44266 main.go:141] libmachine: (ha-198246-m02) Reserved static IP address: 192.168.39.251

	I0807 18:28:41.326537   44266 main.go:141] libmachine: (ha-198246-m02) Waiting for SSH to be available...

	I0807 18:28:41.329224   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.329503   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.329528   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.329675   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Using SSH client type: external

	I0807 18:28:41.329699   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa (-rw-------)

	I0807 18:28:41.329726   44266 main.go:141] libmachine: (ha-198246-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.251 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:28:41.329738   44266 main.go:141] libmachine: (ha-198246-m02) DBG | About to run SSH command:

	I0807 18:28:41.329752   44266 main.go:141] libmachine: (ha-198246-m02) DBG | exit 0

	I0807 18:28:41.456688   44266 main.go:141] libmachine: (ha-198246-m02) DBG | SSH cmd err, output: <nil>: 

	I0807 18:28:41.457054   44266 main.go:141] libmachine: (ha-198246-m02) KVM machine creation complete!

	I0807 18:28:41.457342   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetConfigRaw

	I0807 18:28:41.457876   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:41.458082   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:41.458245   44266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 18:28:41.458260   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetState

	I0807 18:28:41.459550   44266 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 18:28:41.459565   44266 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 18:28:41.459572   44266 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 18:28:41.459578   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.461855   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.462198   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.462225   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.462361   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.462552   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.462697   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.462811   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.463068   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.463266   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.463277   44266 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 18:28:41.563789   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:28:41.563815   44266 main.go:141] libmachine: Detecting the provisioner...

	I0807 18:28:41.563825   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.566883   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.567241   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.567263   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.567445   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.567660   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.567837   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.567975   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.568253   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.568452   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.568470   44266 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 18:28:41.669364   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 18:28:41.669425   44266 main.go:141] libmachine: found compatible host: buildroot

	I0807 18:28:41.669432   44266 main.go:141] libmachine: Provisioning with buildroot...

	I0807 18:28:41.669440   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:41.669653   44266 buildroot.go:166] provisioning hostname "ha-198246-m02"

	I0807 18:28:41.669679   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:41.669860   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.672464   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.672770   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.672793   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.672942   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.673104   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.673265   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.673412   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.673627   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.673943   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.673966   44266 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-198246-m02 && echo "ha-198246-m02" | sudo tee /etc/hostname

	I0807 18:28:41.792440   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-198246-m02

	I0807 18:28:41.792466   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.795604   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.795966   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.795984   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.796230   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:41.796424   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.796595   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:41.796740   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:41.796885   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:41.797037   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:41.797053   44266 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-198246-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-198246-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-198246-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 18:28:41.906596   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:28:41.906633   44266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 18:28:41.906652   44266 buildroot.go:174] setting up certificates

	I0807 18:28:41.906662   44266 provision.go:84] configureAuth start

	I0807 18:28:41.906670   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetMachineName

	I0807 18:28:41.906995   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:41.909871   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.910201   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.910258   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.910405   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:41.912630   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.912923   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:41.912952   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:41.913098   44266 provision.go:143] copyHostCerts

	I0807 18:28:41.913133   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:28:41.913171   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem, removing ...

	I0807 18:28:41.913181   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:28:41.913262   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 18:28:41.913348   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:28:41.913371   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem, removing ...

	I0807 18:28:41.913380   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:28:41.913419   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 18:28:41.913479   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:28:41.913502   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem, removing ...

	I0807 18:28:41.913510   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:28:41.913543   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 18:28:41.913607   44266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.ha-198246-m02 san=[127.0.0.1 192.168.39.251 ha-198246-m02 localhost minikube]

	I0807 18:28:42.029415   44266 provision.go:177] copyRemoteCerts

	I0807 18:28:42.029466   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 18:28:42.029488   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.031816   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.032108   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.032134   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.032373   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.032590   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.032761   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.032906   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.115186   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0807 18:28:42.115248   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0807 18:28:42.139771   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0807 18:28:42.139888   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0807 18:28:42.166463   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0807 18:28:42.166547   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 18:28:42.191360   44266 provision.go:87] duration metric: took 284.686105ms to configureAuth

	I0807 18:28:42.191394   44266 buildroot.go:189] setting minikube options for container-runtime

	I0807 18:28:42.191575   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:42.191639   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.194385   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.194831   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.194853   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.195191   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.195376   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.195544   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.195680   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.195895   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:42.196044   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:42.196058   44266 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 18:28:42.467289   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 18:28:42.467319   44266 main.go:141] libmachine: Checking connection to Docker...

	I0807 18:28:42.467328   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetURL

	I0807 18:28:42.468563   44266 main.go:141] libmachine: (ha-198246-m02) DBG | Using libvirt version 6000000

	I0807 18:28:42.470865   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.471205   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.471243   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.471411   44266 main.go:141] libmachine: Docker is up and running!

	I0807 18:28:42.471434   44266 main.go:141] libmachine: Reticulating splines...

	I0807 18:28:42.471451   44266 client.go:171] duration metric: took 21.19468682s to LocalClient.Create

	I0807 18:28:42.471481   44266 start.go:167] duration metric: took 21.194756451s to libmachine.API.Create "ha-198246"

	I0807 18:28:42.471493   44266 start.go:293] postStartSetup for "ha-198246-m02" (driver="kvm2")

	I0807 18:28:42.471507   44266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 18:28:42.471534   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.471773   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 18:28:42.471806   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.474080   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.474413   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.474433   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.474545   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.474739   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.474895   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.475097   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.560490   44266 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 18:28:42.565161   44266 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 18:28:42.565195   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 18:28:42.565275   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 18:28:42.565387   44266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> 280522.pem in /etc/ssl/certs

	I0807 18:28:42.565402   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /etc/ssl/certs/280522.pem

	I0807 18:28:42.565531   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0807 18:28:42.576441   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:28:42.601887   44266 start.go:296] duration metric: took 130.379831ms for postStartSetup

	I0807 18:28:42.601945   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetConfigRaw

	I0807 18:28:42.602524   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:42.605525   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.605930   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.605957   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.606232   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:28:42.606422   44266 start.go:128] duration metric: took 21.347355066s to createHost

	I0807 18:28:42.606445   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.608659   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.609011   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.609037   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.609154   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.609339   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.609509   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.609670   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.609881   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:28:42.610037   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.251 22 <nil> <nil>}

	I0807 18:28:42.610048   44266 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0807 18:28:42.712453   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723055322.681885034

	I0807 18:28:42.712476   44266 fix.go:216] guest clock: 1723055322.681885034

	I0807 18:28:42.712486   44266 fix.go:229] Guest: 2024-08-07 18:28:42.681885034 +0000 UTC Remote: 2024-08-07 18:28:42.606435256 +0000 UTC m=+80.917455918 (delta=75.449778ms)

	I0807 18:28:42.712505   44266 fix.go:200] guest clock delta is within tolerance: 75.449778ms

	I0807 18:28:42.712511   44266 start.go:83] releasing machines lock for "ha-198246-m02", held for 21.453548489s

	I0807 18:28:42.712528   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.712799   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:42.715436   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.715971   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.716003   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.718499   44266 out.go:177] * Found network options:

	I0807 18:28:42.719912   44266 out.go:177]   - NO_PROXY=192.168.39.196

	W0807 18:28:42.721156   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:28:42.721186   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.721776   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.721994   44266 main.go:141] libmachine: (ha-198246-m02) Calling .DriverName

	I0807 18:28:42.722091   44266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 18:28:42.722129   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	W0807 18:28:42.722390   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:28:42.722461   44266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 18:28:42.722484   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHHostname

	I0807 18:28:42.724944   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725052   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725311   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.725352   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725460   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.725478   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:42.725500   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:42.725609   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.725652   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHPort

	I0807 18:28:42.725814   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.725827   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHKeyPath

	I0807 18:28:42.725956   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetSSHUsername

	I0807 18:28:42.725974   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.726095   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.251 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m02/id_rsa Username:docker}

	I0807 18:28:42.958805   44266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 18:28:42.964806   44266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 18:28:42.964894   44266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 18:28:42.981388   44266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 18:28:42.981416   44266 start.go:495] detecting cgroup driver to use...

	I0807 18:28:42.981488   44266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 18:28:42.997458   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 18:28:43.012016   44266 docker.go:217] disabling cri-docker service (if available) ...

	I0807 18:28:43.012089   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 18:28:43.025912   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 18:28:43.039739   44266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 18:28:43.155400   44266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 18:28:43.303225   44266 docker.go:233] disabling docker service ...

	I0807 18:28:43.303286   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 18:28:43.318739   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 18:28:43.332532   44266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 18:28:43.472596   44266 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 18:28:43.605966   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 18:28:43.619925   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 18:28:43.638588   44266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 18:28:43.638650   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.649283   44266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 18:28:43.649357   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.659951   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.670486   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.680962   44266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 18:28:43.691796   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.702576   44266 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.720080   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:28:43.730366   44266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 18:28:43.739403   44266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 18:28:43.739465   44266 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 18:28:43.752984   44266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 18:28:43.764481   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:28:43.897332   44266 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 18:28:44.051283   44266 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 18:28:44.051350   44266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 18:28:44.056138   44266 start.go:563] Will wait 60s for crictl version

	I0807 18:28:44.056186   44266 ssh_runner.go:195] Run: which crictl

	I0807 18:28:44.060100   44266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 18:28:44.107041   44266 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 18:28:44.107160   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:28:44.136233   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:28:44.172438   44266 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 18:28:44.174040   44266 out.go:177]   - env NO_PROXY=192.168.39.196

	I0807 18:28:44.175421   44266 main.go:141] libmachine: (ha-198246-m02) Calling .GetIP

	I0807 18:28:44.178934   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:44.179638   44266 main.go:141] libmachine: (ha-198246-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c8:91:fc", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:28:36 +0000 UTC Type:0 Mac:52:54:00:c8:91:fc Iaid: IPaddr:192.168.39.251 Prefix:24 Hostname:ha-198246-m02 Clientid:01:52:54:00:c8:91:fc}

	I0807 18:28:44.179664   44266 main.go:141] libmachine: (ha-198246-m02) DBG | domain ha-198246-m02 has defined IP address 192.168.39.251 and MAC address 52:54:00:c8:91:fc in network mk-ha-198246

	I0807 18:28:44.179936   44266 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 18:28:44.184425   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:28:44.197404   44266 mustload.go:65] Loading cluster: ha-198246

	I0807 18:28:44.197592   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:28:44.197871   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:44.197898   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:44.212129   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33201

	I0807 18:28:44.212590   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:44.213046   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:44.213066   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:44.213444   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:44.213618   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:28:44.215209   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:28:44.215490   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:28:44.215512   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:28:44.229524   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34027

	I0807 18:28:44.229880   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:28:44.230343   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:28:44.230365   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:28:44.230754   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:28:44.230920   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:28:44.231062   44266 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246 for IP: 192.168.39.251

	I0807 18:28:44.231075   44266 certs.go:194] generating shared ca certs ...

	I0807 18:28:44.231089   44266 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:44.231203   44266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 18:28:44.231239   44266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 18:28:44.231248   44266 certs.go:256] generating profile certs ...

	I0807 18:28:44.231307   44266 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key

	I0807 18:28:44.231330   44266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680

	I0807 18:28:44.231342   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.196 192.168.39.251 192.168.39.254]

	I0807 18:28:44.559979   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680 ...

	I0807 18:28:44.560015   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680: {Name:mk532d2b707d0b4ff2030a049398865e8e454aaa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:44.560219   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680 ...

	I0807 18:28:44.560234   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680: {Name:mkd4bd0dec009d42e6ef356f3ddf31b6cb75091b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:28:44.560311   44266 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.f3bca680 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt

	I0807 18:28:44.560448   44266 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.f3bca680 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key

	I0807 18:28:44.560582   44266 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key

	I0807 18:28:44.560598   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0807 18:28:44.560612   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0807 18:28:44.560628   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0807 18:28:44.560643   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0807 18:28:44.560658   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0807 18:28:44.560672   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0807 18:28:44.560687   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0807 18:28:44.560701   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0807 18:28:44.560749   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem (1338 bytes)

	W0807 18:28:44.560780   44266 certs.go:480] ignoring /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052_empty.pem, impossibly tiny 0 bytes

	I0807 18:28:44.560791   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 18:28:44.560824   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 18:28:44.560849   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 18:28:44.560873   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 18:28:44.560916   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:28:44.560944   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem -> /usr/share/ca-certificates/28052.pem

	I0807 18:28:44.560960   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /usr/share/ca-certificates/280522.pem

	I0807 18:28:44.560975   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:44.561016   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:28:44.564346   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:44.564706   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:28:44.564750   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:28:44.564946   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:28:44.565119   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:28:44.565260   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:28:44.565409   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:28:44.636542   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0807 18:28:44.641908   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0807 18:28:44.653641   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0807 18:28:44.658316   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0807 18:28:44.670858   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0807 18:28:44.676928   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0807 18:28:44.688768   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0807 18:28:44.693467   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0807 18:28:44.706551   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0807 18:28:44.711030   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0807 18:28:44.721174   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0807 18:28:44.725233   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0807 18:28:44.735693   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 18:28:44.760511   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 18:28:44.784292   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 18:28:44.808965   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 18:28:44.832316   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0807 18:28:44.855893   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0807 18:28:44.879876   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 18:28:44.903976   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 18:28:44.927934   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem --> /usr/share/ca-certificates/28052.pem (1338 bytes)

	I0807 18:28:44.951549   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /usr/share/ca-certificates/280522.pem (1708 bytes)

	I0807 18:28:44.976102   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 18:28:45.000438   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0807 18:28:45.017427   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0807 18:28:45.034095   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0807 18:28:45.051357   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0807 18:28:45.068164   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0807 18:28:45.084903   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0807 18:28:45.102266   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0807 18:28:45.119661   44266 ssh_runner.go:195] Run: openssl version

	I0807 18:28:45.125624   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/28052.pem && ln -fs /usr/share/ca-certificates/28052.pem /etc/ssl/certs/28052.pem"

	I0807 18:28:45.137494   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/28052.pem

	I0807 18:28:45.142382   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  7 18:17 /usr/share/ca-certificates/28052.pem

	I0807 18:28:45.142458   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/28052.pem

	I0807 18:28:45.148370   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/28052.pem /etc/ssl/certs/51391683.0"

	I0807 18:28:45.159984   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/280522.pem && ln -fs /usr/share/ca-certificates/280522.pem /etc/ssl/certs/280522.pem"

	I0807 18:28:45.171372   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/280522.pem

	I0807 18:28:45.176093   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  7 18:17 /usr/share/ca-certificates/280522.pem

	I0807 18:28:45.176163   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/280522.pem

	I0807 18:28:45.182048   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/280522.pem /etc/ssl/certs/3ec20f2e.0"

	I0807 18:28:45.193770   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 18:28:45.205285   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:45.209824   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:45.209886   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:28:45.215494   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 18:28:45.226843   44266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 18:28:45.231043   44266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 18:28:45.231100   44266 kubeadm.go:934] updating node {m02 192.168.39.251 8443 v1.30.3 crio true true} ...

	I0807 18:28:45.231200   44266 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-198246-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.251

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 18:28:45.231226   44266 kube-vip.go:115] generating kube-vip config ...

	I0807 18:28:45.231271   44266 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0807 18:28:45.250153   44266 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0807 18:28:45.250214   44266 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0807 18:28:45.250259   44266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 18:28:45.260907   44266 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0807 18:28:45.260967   44266 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0807 18:28:45.270880   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0807 18:28:45.270914   44266 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet

	I0807 18:28:45.270924   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:28:45.270930   44266 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm

	I0807 18:28:45.270992   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:28:45.275789   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0807 18:28:45.275817   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0807 18:29:16.535217   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:29:16.535295   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:29:16.541424   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0807 18:29:16.541476   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0807 18:29:46.649609   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:29:46.666629   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:29:46.666743   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:29:46.671680   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0807 18:29:46.671715   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0807 18:29:47.065172   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0807 18:29:47.074897   44266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0807 18:29:47.091782   44266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 18:29:47.108598   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0807 18:29:47.125245   44266 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0807 18:29:47.129682   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:29:47.142072   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:29:47.274574   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:29:47.291877   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:29:47.292235   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:29:47.292273   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:29:47.307242   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39989

	I0807 18:29:47.307720   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:29:47.308297   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:29:47.308318   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:29:47.308692   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:29:47.308878   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:29:47.309043   44266 start.go:317] joinCluster: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiratio

n:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 18:29:47.309174   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0807 18:29:47.309196   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:29:47.312164   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:29:47.312576   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:29:47.312598   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:29:47.312741   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:29:47.312882   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:29:47.313026   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:29:47.313145   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:29:47.474155   44266 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:29:47.474212   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 78qnj6.khw60v382x7suzf2 --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m02 --control-plane --apiserver-advertise-address=192.168.39.251 --apiserver-bind-port=8443"

	I0807 18:30:09.531673   44266 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 78qnj6.khw60v382x7suzf2 --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m02 --control-plane --apiserver-advertise-address=192.168.39.251 --apiserver-bind-port=8443": (22.057432801s)

	I0807 18:30:09.531712   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0807 18:30:10.063192   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-198246-m02 minikube.k8s.io/updated_at=2024_08_07T18_30_10_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=ha-198246 minikube.k8s.io/primary=false

	I0807 18:30:10.185705   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-198246-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0807 18:30:10.289663   44266 start.go:319] duration metric: took 22.980616289s to joinCluster

	I0807 18:30:10.289758   44266 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:30:10.290021   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:30:10.291609   44266 out.go:177] * Verifying Kubernetes components...

	I0807 18:30:10.293124   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:30:10.576909   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:30:10.661898   44266 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:30:10.662179   44266 kapi.go:59] client config for ha-198246: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt", KeyFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key", CAFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02a80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0807 18:30:10.662254   44266 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.196:8443

	I0807 18:30:10.662605   44266 node_ready.go:35] waiting up to 6m0s for node "ha-198246-m02" to be "Ready" ...

	I0807 18:30:10.662743   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:10.662754   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:10.662761   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:10.662767   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:10.674699   44266 round_trippers.go:574] Response Status: 200 OK in 11 milliseconds

	I0807 18:30:11.163679   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:11.163703   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:11.163714   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:11.163720   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:11.167619   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:11.662940   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:11.662963   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:11.662969   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:11.662974   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:11.667816   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:12.163352   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:12.163385   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:12.163396   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:12.163402   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:12.172406   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:30:12.662926   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:12.662951   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:12.662956   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:12.662961   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:12.667516   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:12.668218   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:13.163680   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:13.163706   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:13.163714   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:13.163719   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:13.168225   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:13.663108   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:13.663128   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:13.663136   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:13.663140   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:13.667026   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:14.163223   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:14.163246   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:14.163255   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:14.163263   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:14.167544   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:14.663519   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:14.663545   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:14.663556   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:14.663562   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:14.667595   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:15.163698   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:15.163725   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:15.163738   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:15.163746   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:15.167266   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:15.167770   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:15.662914   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:15.662941   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:15.662951   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:15.662957   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:15.666490   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:16.163391   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:16.163419   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:16.163429   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:16.163435   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:16.167182   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:16.663906   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:16.663932   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:16.663943   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:16.663948   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:16.668176   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:17.162965   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:17.163049   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:17.163068   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:17.163080   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:17.167431   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:17.168285   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:17.663405   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:17.663429   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:17.663440   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:17.663447   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:17.667918   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:18.162918   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:18.162941   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:18.162949   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:18.162953   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:18.166467   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:18.663722   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:18.663747   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:18.663757   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:18.663762   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:18.668276   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:19.162945   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:19.162966   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:19.162973   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:19.162978   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:19.166353   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:19.663155   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:19.663178   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:19.663187   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:19.663192   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:19.667298   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:19.668045   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:20.163460   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:20.163483   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:20.163490   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:20.163493   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:20.166765   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:20.662987   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:20.663010   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:20.663021   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:20.663027   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:20.666411   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:21.163219   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:21.163241   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:21.163249   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:21.163252   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:21.167248   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:21.663138   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:21.663163   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:21.663171   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:21.663177   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:21.666630   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:22.163469   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:22.163496   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:22.163507   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:22.163513   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:22.166849   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:22.167436   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:22.663333   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:22.663354   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:22.663364   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:22.663369   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:22.667068   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:23.163229   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:23.163251   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:23.163259   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:23.163263   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:23.167845   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:23.663204   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:23.663224   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:23.663232   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:23.663236   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:23.667349   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:24.163700   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:24.163721   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:24.163727   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:24.163730   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:24.166893   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:24.167762   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:24.663135   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:24.663185   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:24.663196   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:24.663200   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:24.667220   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:25.163134   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:25.163158   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:25.163167   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:25.163171   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:25.167004   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:25.663113   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:25.663133   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:25.663141   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:25.663144   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:25.666348   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:26.162882   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:26.162907   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:26.162918   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:26.162923   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:26.166232   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:26.663636   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:26.663655   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:26.663663   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:26.663668   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:26.668096   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:26.668860   44266 node_ready.go:53] node "ha-198246-m02" has status "Ready":"False"

	I0807 18:30:27.162906   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:27.162932   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:27.162956   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:27.162961   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:27.166246   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:27.662814   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:27.662838   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:27.662849   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:27.662855   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:27.666937   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:28.163385   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:28.163408   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:28.163419   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:28.163425   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:28.166996   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:28.663197   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:28.663220   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:28.663227   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:28.663231   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:28.666970   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.163041   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.163064   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.163072   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.163077   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.166751   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.167186   44266 node_ready.go:49] node "ha-198246-m02" has status "Ready":"True"

	I0807 18:30:29.167202   44266 node_ready.go:38] duration metric: took 18.504556301s for node "ha-198246-m02" to be "Ready" ...

	I0807 18:30:29.167209   44266 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:30:29.167270   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:29.167282   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.167291   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.167298   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.172316   44266 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0807 18:30:29.179632   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.179698   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rbnrx

	I0807 18:30:29.179705   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.179713   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.179716   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.182900   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.183633   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.183648   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.183658   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.183664   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.186729   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.187287   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.187309   44266 pod_ready.go:81] duration metric: took 7.655346ms for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.187321   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.187382   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-w6w6g

	I0807 18:30:29.187393   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.187403   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.187407   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.190210   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.190826   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.190843   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.190852   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.190860   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.193702   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.194277   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.194298   44266 pod_ready.go:81] duration metric: took 6.969332ms for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.194310   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.194367   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246

	I0807 18:30:29.194377   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.194385   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.194388   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.197299   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.197836   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.197850   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.197857   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.197862   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.200079   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.200638   44266 pod_ready.go:92] pod "etcd-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.200658   44266 pod_ready.go:81] duration metric: took 6.339465ms for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.200671   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.200727   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m02

	I0807 18:30:29.200736   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.200746   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.200754   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.202945   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.203877   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.203893   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.203901   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.203907   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.205928   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:29.206548   44266 pod_ready.go:92] pod "etcd-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.206567   44266 pod_ready.go:81] duration metric: took 5.88553ms for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.206585   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.363426   44266 request.go:629] Waited for 156.781521ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:30:29.363516   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:30:29.363524   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.363536   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.363544   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.367464   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.563699   44266 request.go:629] Waited for 195.39754ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.563755   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:29.563761   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.563771   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.563776   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.568245   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:29.568903   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.568920   44266 pod_ready.go:81] duration metric: took 362.325252ms for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.568929   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.764067   44266 request.go:629] Waited for 195.080715ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:30:29.764156   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:30:29.764163   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.764175   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.764183   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.767929   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.964048   44266 request.go:629] Waited for 195.354316ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.964123   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:29.964133   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:29.964143   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:29.964148   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:29.967577   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:29.968090   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:29.968117   44266 pod_ready.go:81] duration metric: took 399.182286ms for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:29.968126   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.163142   44266 request.go:629] Waited for 194.953767ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:30:30.163221   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:30:30.163231   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.163244   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.163253   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.166706   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.363808   44266 request.go:629] Waited for 196.398052ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:30.363874   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:30.363885   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.363895   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.363904   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.367698   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.368173   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:30.368190   44266 pod_ready.go:81] duration metric: took 400.057957ms for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.368215   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.563270   44266 request.go:629] Waited for 194.991431ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:30:30.563343   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:30:30.563350   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.563360   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.563365   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.566556   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.763133   44266 request.go:629] Waited for 196.018941ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:30.763191   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:30.763198   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.763206   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.763217   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.766348   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:30.767082   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:30.767100   44266 pod_ready.go:81] duration metric: took 398.876067ms for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.767118   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:30.963064   44266 request.go:629] Waited for 195.878143ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:30:30.963131   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:30:30.963137   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:30.963144   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:30.963151   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:30.966736   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:31.163920   44266 request.go:629] Waited for 196.37962ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.164005   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.164017   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.164028   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.164037   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.168411   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:31.168975   44266 pod_ready.go:92] pod "kube-proxy-4l79v" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:31.168994   44266 pod_ready.go:81] duration metric: took 401.867348ms for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.169006   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.363592   44266 request.go:629] Waited for 194.511545ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:30:31.363668   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:30:31.363675   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.363685   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.363691   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.368028   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:31.563121   44266 request.go:629] Waited for 194.293236ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:31.563213   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:31.563223   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.563234   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.563244   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.566830   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:31.567571   44266 pod_ready.go:92] pod "kube-proxy-m5ng2" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:31.567600   44266 pod_ready.go:81] duration metric: took 398.576464ms for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.567631   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.764083   44266 request.go:629] Waited for 196.35828ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:30:31.764163   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:30:31.764177   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.764191   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.764199   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.767212   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:30:31.963277   44266 request.go:629] Waited for 195.395503ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.963339   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:30:31.963343   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:31.963350   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:31.963354   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:31.966678   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:31.967366   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:31.967384   44266 pod_ready.go:81] duration metric: took 399.739353ms for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:31.967393   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:32.163518   44266 request.go:629] Waited for 196.071536ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:30:32.163576   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:30:32.163581   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.163589   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.163593   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.167125   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:32.363259   44266 request.go:629] Waited for 195.352702ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:32.363309   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:30:32.363314   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.363325   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.363330   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.366413   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:32.367013   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:30:32.367033   44266 pod_ready.go:81] duration metric: took 399.634584ms for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:30:32.367043   44266 pod_ready.go:38] duration metric: took 3.199823963s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:30:32.367059   44266 api_server.go:52] waiting for apiserver process to appear ...

	I0807 18:30:32.367111   44266 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:30:32.385352   44266 api_server.go:72] duration metric: took 22.095548352s to wait for apiserver process to appear ...

	I0807 18:30:32.385377   44266 api_server.go:88] waiting for apiserver healthz status ...

	I0807 18:30:32.385393   44266 api_server.go:253] Checking apiserver healthz at https://192.168.39.196:8443/healthz ...

	I0807 18:30:32.391376   44266 api_server.go:279] https://192.168.39.196:8443/healthz returned 200:

	ok

	I0807 18:30:32.391449   44266 round_trippers.go:463] GET https://192.168.39.196:8443/version

	I0807 18:30:32.391462   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.391472   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.391483   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.392358   44266 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0807 18:30:32.392431   44266 api_server.go:141] control plane version: v1.30.3

	I0807 18:30:32.392445   44266 api_server.go:131] duration metric: took 7.062347ms to wait for apiserver health ...

	I0807 18:30:32.392452   44266 system_pods.go:43] waiting for kube-system pods to appear ...

	I0807 18:30:32.563869   44266 request.go:629] Waited for 171.348742ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.563921   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.563931   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.563938   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.563942   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.569072   44266 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0807 18:30:32.573329   44266 system_pods.go:59] 17 kube-system pods found

	I0807 18:30:32.573357   44266 system_pods.go:61] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:30:32.573361   44266 system_pods.go:61] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:30:32.573364   44266 system_pods.go:61] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:30:32.573367   44266 system_pods.go:61] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:30:32.573370   44266 system_pods.go:61] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:30:32.573373   44266 system_pods.go:61] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:30:32.573376   44266 system_pods.go:61] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:30:32.573380   44266 system_pods.go:61] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:30:32.573383   44266 system_pods.go:61] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:30:32.573386   44266 system_pods.go:61] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:30:32.573390   44266 system_pods.go:61] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:30:32.573393   44266 system_pods.go:61] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:30:32.573396   44266 system_pods.go:61] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:30:32.573398   44266 system_pods.go:61] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:30:32.573402   44266 system_pods.go:61] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:30:32.573405   44266 system_pods.go:61] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:30:32.573408   44266 system_pods.go:61] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:30:32.573414   44266 system_pods.go:74] duration metric: took 180.956026ms to wait for pod list to return data ...

	I0807 18:30:32.573421   44266 default_sa.go:34] waiting for default service account to be created ...

	I0807 18:30:32.763885   44266 request.go:629] Waited for 190.379686ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:30:32.763936   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:30:32.763941   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.763948   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.763954   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.767012   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:30:32.767286   44266 default_sa.go:45] found service account: "default"

	I0807 18:30:32.767313   44266 default_sa.go:55] duration metric: took 193.885113ms for default service account to be created ...

	I0807 18:30:32.767324   44266 system_pods.go:116] waiting for k8s-apps to be running ...

	I0807 18:30:32.963765   44266 request.go:629] Waited for 196.363852ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.963831   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:30:32.963837   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:32.963844   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:32.963850   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:32.970431   44266 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0807 18:30:32.975184   44266 system_pods.go:86] 17 kube-system pods found

	I0807 18:30:32.975211   44266 system_pods.go:89] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:30:32.975219   44266 system_pods.go:89] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:30:32.975225   44266 system_pods.go:89] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:30:32.975231   44266 system_pods.go:89] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:30:32.975237   44266 system_pods.go:89] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:30:32.975242   44266 system_pods.go:89] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:30:32.975249   44266 system_pods.go:89] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:30:32.975254   44266 system_pods.go:89] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:30:32.975261   44266 system_pods.go:89] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:30:32.975268   44266 system_pods.go:89] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:30:32.975277   44266 system_pods.go:89] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:30:32.975284   44266 system_pods.go:89] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:30:32.975291   44266 system_pods.go:89] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:30:32.975297   44266 system_pods.go:89] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:30:32.975303   44266 system_pods.go:89] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:30:32.975312   44266 system_pods.go:89] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:30:32.975318   44266 system_pods.go:89] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:30:32.975327   44266 system_pods.go:126] duration metric: took 207.996289ms to wait for k8s-apps to be running ...

	I0807 18:30:32.975339   44266 system_svc.go:44] waiting for kubelet service to be running ....

	I0807 18:30:32.975391   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:30:32.989953   44266 system_svc.go:56] duration metric: took 14.606769ms WaitForService to wait for kubelet

	I0807 18:30:32.989979   44266 kubeadm.go:582] duration metric: took 22.700179334s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 18:30:32.989999   44266 node_conditions.go:102] verifying NodePressure condition ...

	I0807 18:30:33.163417   44266 request.go:629] Waited for 173.330443ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes

	I0807 18:30:33.163468   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes

	I0807 18:30:33.163473   44266 round_trippers.go:469] Request Headers:

	I0807 18:30:33.163480   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:30:33.163484   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:30:33.167772   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:30:33.168822   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:30:33.168846   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:30:33.168861   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:30:33.168866   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:30:33.168872   44266 node_conditions.go:105] duration metric: took 178.867475ms to run NodePressure ...

	I0807 18:30:33.168893   44266 start.go:241] waiting for startup goroutines ...

	I0807 18:30:33.168926   44266 start.go:255] writing updated cluster config ...

	I0807 18:30:33.170904   44266 out.go:177] 

	I0807 18:30:33.172264   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:30:33.172352   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:30:33.173860   44266 out.go:177] * Starting "ha-198246-m03" control-plane node in "ha-198246" cluster

	I0807 18:30:33.175358   44266 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio

	I0807 18:30:33.175380   44266 cache.go:56] Caching tarball of preloaded images

	I0807 18:30:33.175467   44266 preload.go:172] Found /home/jenkins/minikube-integration/19389-20864/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0807 18:30:33.175477   44266 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio

	I0807 18:30:33.175556   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:30:33.175701   44266 start.go:360] acquireMachinesLock for ha-198246-m03: {Name:mk247a56355bd763fa3061d99f6a9ceb3bbb34dc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0807 18:30:33.175740   44266 start.go:364] duration metric: took 21.742µs to acquireMachinesLock for "ha-198246-m03"

	I0807 18:30:33.175759   44266 start.go:93] Provisioning new machine with config: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-

dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:30:33.175842   44266 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0807 18:30:33.177325   44266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0807 18:30:33.177407   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:30:33.177444   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:30:33.191872   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46759

	I0807 18:30:33.192346   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:30:33.192788   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:30:33.192811   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:30:33.193150   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:30:33.193346   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:30:33.193498   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:30:33.193662   44266 start.go:159] libmachine.API.Create for "ha-198246" (driver="kvm2")

	I0807 18:30:33.193682   44266 client.go:168] LocalClient.Create starting

	I0807 18:30:33.193707   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem

	I0807 18:30:33.193739   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:30:33.193753   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:30:33.193811   44266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem

	I0807 18:30:33.193842   44266 main.go:141] libmachine: Decoding PEM data...

	I0807 18:30:33.193854   44266 main.go:141] libmachine: Parsing certificate...

	I0807 18:30:33.193877   44266 main.go:141] libmachine: Running pre-create checks...

	I0807 18:30:33.193888   44266 main.go:141] libmachine: (ha-198246-m03) Calling .PreCreateCheck

	I0807 18:30:33.194049   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetConfigRaw

	I0807 18:30:33.194488   44266 main.go:141] libmachine: Creating machine...

	I0807 18:30:33.194501   44266 main.go:141] libmachine: (ha-198246-m03) Calling .Create

	I0807 18:30:33.194651   44266 main.go:141] libmachine: (ha-198246-m03) Creating KVM machine...

	I0807 18:30:33.195893   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found existing default KVM network

	I0807 18:30:33.196007   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found existing private KVM network mk-ha-198246

	I0807 18:30:33.196136   44266 main.go:141] libmachine: (ha-198246-m03) Setting up store path in /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03 ...

	I0807 18:30:33.196160   44266 main.go:141] libmachine: (ha-198246-m03) Building disk image from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso

	I0807 18:30:33.196236   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.196136   45290 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:30:33.196342   44266 main.go:141] libmachine: (ha-198246-m03) Downloading /home/jenkins/minikube-integration/19389-20864/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19389-20864/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...

	I0807 18:30:33.432780   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.432647   45290 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa...

	I0807 18:30:33.529287   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.529189   45290 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/ha-198246-m03.rawdisk...

	I0807 18:30:33.529318   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Writing magic tar header

	I0807 18:30:33.529332   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Writing SSH key tar header

	I0807 18:30:33.529343   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:33.529299   45290 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03 ...

	I0807 18:30:33.529393   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03

	I0807 18:30:33.529414   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube/machines

	I0807 18:30:33.529433   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03 (perms=drwx------)

	I0807 18:30:33.529447   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864/.minikube

	I0807 18:30:33.529464   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19389-20864

	I0807 18:30:33.529477   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0807 18:30:33.529492   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube/machines (perms=drwxr-xr-x)

	I0807 18:30:33.529508   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home/jenkins

	I0807 18:30:33.529523   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864/.minikube (perms=drwxr-xr-x)

	I0807 18:30:33.529538   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Checking permissions on dir: /home

	I0807 18:30:33.529554   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration/19389-20864 (perms=drwxrwxr-x)

	I0807 18:30:33.529567   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0807 18:30:33.529579   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Skipping /home - not owner

	I0807 18:30:33.529595   44266 main.go:141] libmachine: (ha-198246-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0807 18:30:33.529611   44266 main.go:141] libmachine: (ha-198246-m03) Creating domain...

	I0807 18:30:33.530487   44266 main.go:141] libmachine: (ha-198246-m03) define libvirt domain using xml: 

	I0807 18:30:33.530514   44266 main.go:141] libmachine: (ha-198246-m03) <domain type='kvm'>

	I0807 18:30:33.530527   44266 main.go:141] libmachine: (ha-198246-m03)   <name>ha-198246-m03</name>

	I0807 18:30:33.530534   44266 main.go:141] libmachine: (ha-198246-m03)   <memory unit='MiB'>2200</memory>

	I0807 18:30:33.530544   44266 main.go:141] libmachine: (ha-198246-m03)   <vcpu>2</vcpu>

	I0807 18:30:33.530555   44266 main.go:141] libmachine: (ha-198246-m03)   <features>

	I0807 18:30:33.530564   44266 main.go:141] libmachine: (ha-198246-m03)     <acpi/>

	I0807 18:30:33.530574   44266 main.go:141] libmachine: (ha-198246-m03)     <apic/>

	I0807 18:30:33.530582   44266 main.go:141] libmachine: (ha-198246-m03)     <pae/>

	I0807 18:30:33.530593   44266 main.go:141] libmachine: (ha-198246-m03)     

	I0807 18:30:33.530604   44266 main.go:141] libmachine: (ha-198246-m03)   </features>

	I0807 18:30:33.530615   44266 main.go:141] libmachine: (ha-198246-m03)   <cpu mode='host-passthrough'>

	I0807 18:30:33.530622   44266 main.go:141] libmachine: (ha-198246-m03)   

	I0807 18:30:33.530630   44266 main.go:141] libmachine: (ha-198246-m03)   </cpu>

	I0807 18:30:33.530637   44266 main.go:141] libmachine: (ha-198246-m03)   <os>

	I0807 18:30:33.530647   44266 main.go:141] libmachine: (ha-198246-m03)     <type>hvm</type>

	I0807 18:30:33.530659   44266 main.go:141] libmachine: (ha-198246-m03)     <boot dev='cdrom'/>

	I0807 18:30:33.530673   44266 main.go:141] libmachine: (ha-198246-m03)     <boot dev='hd'/>

	I0807 18:30:33.530702   44266 main.go:141] libmachine: (ha-198246-m03)     <bootmenu enable='no'/>

	I0807 18:30:33.530724   44266 main.go:141] libmachine: (ha-198246-m03)   </os>

	I0807 18:30:33.530735   44266 main.go:141] libmachine: (ha-198246-m03)   <devices>

	I0807 18:30:33.530748   44266 main.go:141] libmachine: (ha-198246-m03)     <disk type='file' device='cdrom'>

	I0807 18:30:33.530766   44266 main.go:141] libmachine: (ha-198246-m03)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/boot2docker.iso'/>

	I0807 18:30:33.530778   44266 main.go:141] libmachine: (ha-198246-m03)       <target dev='hdc' bus='scsi'/>

	I0807 18:30:33.530790   44266 main.go:141] libmachine: (ha-198246-m03)       <readonly/>

	I0807 18:30:33.530800   44266 main.go:141] libmachine: (ha-198246-m03)     </disk>

	I0807 18:30:33.530813   44266 main.go:141] libmachine: (ha-198246-m03)     <disk type='file' device='disk'>

	I0807 18:30:33.530826   44266 main.go:141] libmachine: (ha-198246-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0807 18:30:33.530840   44266 main.go:141] libmachine: (ha-198246-m03)       <source file='/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/ha-198246-m03.rawdisk'/>

	I0807 18:30:33.530856   44266 main.go:141] libmachine: (ha-198246-m03)       <target dev='hda' bus='virtio'/>

	I0807 18:30:33.530868   44266 main.go:141] libmachine: (ha-198246-m03)     </disk>

	I0807 18:30:33.530892   44266 main.go:141] libmachine: (ha-198246-m03)     <interface type='network'>

	I0807 18:30:33.530906   44266 main.go:141] libmachine: (ha-198246-m03)       <source network='mk-ha-198246'/>

	I0807 18:30:33.530917   44266 main.go:141] libmachine: (ha-198246-m03)       <model type='virtio'/>

	I0807 18:30:33.530927   44266 main.go:141] libmachine: (ha-198246-m03)     </interface>

	I0807 18:30:33.530938   44266 main.go:141] libmachine: (ha-198246-m03)     <interface type='network'>

	I0807 18:30:33.530952   44266 main.go:141] libmachine: (ha-198246-m03)       <source network='default'/>

	I0807 18:30:33.530963   44266 main.go:141] libmachine: (ha-198246-m03)       <model type='virtio'/>

	I0807 18:30:33.530976   44266 main.go:141] libmachine: (ha-198246-m03)     </interface>

	I0807 18:30:33.530986   44266 main.go:141] libmachine: (ha-198246-m03)     <serial type='pty'>

	I0807 18:30:33.530996   44266 main.go:141] libmachine: (ha-198246-m03)       <target port='0'/>

	I0807 18:30:33.531010   44266 main.go:141] libmachine: (ha-198246-m03)     </serial>

	I0807 18:30:33.531020   44266 main.go:141] libmachine: (ha-198246-m03)     <console type='pty'>

	I0807 18:30:33.531031   44266 main.go:141] libmachine: (ha-198246-m03)       <target type='serial' port='0'/>

	I0807 18:30:33.531043   44266 main.go:141] libmachine: (ha-198246-m03)     </console>

	I0807 18:30:33.531053   44266 main.go:141] libmachine: (ha-198246-m03)     <rng model='virtio'>

	I0807 18:30:33.531067   44266 main.go:141] libmachine: (ha-198246-m03)       <backend model='random'>/dev/random</backend>

	I0807 18:30:33.531078   44266 main.go:141] libmachine: (ha-198246-m03)     </rng>

	I0807 18:30:33.531119   44266 main.go:141] libmachine: (ha-198246-m03)     

	I0807 18:30:33.531138   44266 main.go:141] libmachine: (ha-198246-m03)     

	I0807 18:30:33.531151   44266 main.go:141] libmachine: (ha-198246-m03)   </devices>

	I0807 18:30:33.531165   44266 main.go:141] libmachine: (ha-198246-m03) </domain>

	I0807 18:30:33.531182   44266 main.go:141] libmachine: (ha-198246-m03) 

	I0807 18:30:33.537482   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9f:ab:f5 in network default

	I0807 18:30:33.538090   44266 main.go:141] libmachine: (ha-198246-m03) Ensuring networks are active...

	I0807 18:30:33.538108   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:33.538784   44266 main.go:141] libmachine: (ha-198246-m03) Ensuring network default is active

	I0807 18:30:33.539152   44266 main.go:141] libmachine: (ha-198246-m03) Ensuring network mk-ha-198246 is active

	I0807 18:30:33.539485   44266 main.go:141] libmachine: (ha-198246-m03) Getting domain xml...

	I0807 18:30:33.540252   44266 main.go:141] libmachine: (ha-198246-m03) Creating domain...

	I0807 18:30:34.756035   44266 main.go:141] libmachine: (ha-198246-m03) Waiting to get IP...

	I0807 18:30:34.756939   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:34.757511   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:34.757577   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:34.757477   45290 retry.go:31] will retry after 227.908957ms: waiting for machine to come up

	I0807 18:30:34.986907   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:34.987323   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:34.987354   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:34.987276   45290 retry.go:31] will retry after 246.835339ms: waiting for machine to come up

	I0807 18:30:35.235616   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:35.236094   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:35.236119   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:35.236046   45290 retry.go:31] will retry after 426.907083ms: waiting for machine to come up

	I0807 18:30:35.664761   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:35.665183   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:35.665243   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:35.665182   45290 retry.go:31] will retry after 507.132694ms: waiting for machine to come up

	I0807 18:30:36.173688   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:36.174085   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:36.174115   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:36.174025   45290 retry.go:31] will retry after 466.332078ms: waiting for machine to come up

	I0807 18:30:36.642374   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:36.642869   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:36.642896   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:36.642788   45290 retry.go:31] will retry after 802.371451ms: waiting for machine to come up

	I0807 18:30:37.446742   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:37.447182   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:37.447204   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:37.447149   45290 retry.go:31] will retry after 1.058258348s: waiting for machine to come up

	I0807 18:30:38.506869   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:38.507277   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:38.507303   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:38.507243   45290 retry.go:31] will retry after 1.24813663s: waiting for machine to come up

	I0807 18:30:39.757276   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:39.757679   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:39.757708   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:39.757653   45290 retry.go:31] will retry after 1.347201318s: waiting for machine to come up

	I0807 18:30:41.107002   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:41.107475   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:41.107501   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:41.107433   45290 retry.go:31] will retry after 2.164822694s: waiting for machine to come up

	I0807 18:30:43.273615   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:43.274030   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:43.274053   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:43.274008   45290 retry.go:31] will retry after 2.890209035s: waiting for machine to come up

	I0807 18:30:46.165557   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:46.166122   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:46.166152   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:46.166070   45290 retry.go:31] will retry after 3.463040417s: waiting for machine to come up

	I0807 18:30:49.630676   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:49.631090   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:49.631119   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:49.631053   45290 retry.go:31] will retry after 2.865023491s: waiting for machine to come up

	I0807 18:30:52.497203   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:52.497575   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find current IP address of domain ha-198246-m03 in network mk-ha-198246

	I0807 18:30:52.497598   44266 main.go:141] libmachine: (ha-198246-m03) DBG | I0807 18:30:52.497535   45290 retry.go:31] will retry after 4.944323257s: waiting for machine to come up

	I0807 18:30:57.446295   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:57.446732   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has current primary IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:57.446753   44266 main.go:141] libmachine: (ha-198246-m03) Found IP for machine: 192.168.39.227

	I0807 18:30:57.446766   44266 main.go:141] libmachine: (ha-198246-m03) Reserving static IP address...

	I0807 18:30:57.447262   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find host DHCP lease matching {name: "ha-198246-m03", mac: "52:54:00:9d:24:52", ip: "192.168.39.227"} in network mk-ha-198246

	I0807 18:30:57.521164   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Getting to WaitForSSH function...

	I0807 18:30:57.521190   44266 main.go:141] libmachine: (ha-198246-m03) Reserved static IP address: 192.168.39.227

	I0807 18:30:57.521199   44266 main.go:141] libmachine: (ha-198246-m03) Waiting for SSH to be available...

	I0807 18:30:57.523681   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:30:57.524059   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246

	I0807 18:30:57.524105   44266 main.go:141] libmachine: (ha-198246-m03) DBG | unable to find defined IP address of network mk-ha-198246 interface with MAC address 52:54:00:9d:24:52

	I0807 18:30:57.524328   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH client type: external

	I0807 18:30:57.524353   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa (-rw-------)

	I0807 18:30:57.524381   44266 main.go:141] libmachine: (ha-198246-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:30:57.524422   44266 main.go:141] libmachine: (ha-198246-m03) DBG | About to run SSH command:

	I0807 18:30:57.524444   44266 main.go:141] libmachine: (ha-198246-m03) DBG | exit 0

	I0807 18:30:57.529188   44266 main.go:141] libmachine: (ha-198246-m03) DBG | SSH cmd err, output: exit status 255: 

	I0807 18:30:57.529209   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0807 18:30:57.529217   44266 main.go:141] libmachine: (ha-198246-m03) DBG | command : exit 0

	I0807 18:30:57.529223   44266 main.go:141] libmachine: (ha-198246-m03) DBG | err     : exit status 255

	I0807 18:30:57.529230   44266 main.go:141] libmachine: (ha-198246-m03) DBG | output  : 

	I0807 18:31:00.531629   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Getting to WaitForSSH function...

	I0807 18:31:00.534035   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.534413   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.534441   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.534511   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH client type: external

	I0807 18:31:00.534527   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa (-rw-------)

	I0807 18:31:00.534578   44266 main.go:141] libmachine: (ha-198246-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.227 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0807 18:31:00.534598   44266 main.go:141] libmachine: (ha-198246-m03) DBG | About to run SSH command:

	I0807 18:31:00.534623   44266 main.go:141] libmachine: (ha-198246-m03) DBG | exit 0

	I0807 18:31:00.664624   44266 main.go:141] libmachine: (ha-198246-m03) DBG | SSH cmd err, output: <nil>: 

	I0807 18:31:00.664910   44266 main.go:141] libmachine: (ha-198246-m03) KVM machine creation complete!

	I0807 18:31:00.665347   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetConfigRaw

	I0807 18:31:00.665908   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:00.666128   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:00.666310   44266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0807 18:31:00.666326   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetState

	I0807 18:31:00.667883   44266 main.go:141] libmachine: Detecting operating system of created instance...

	I0807 18:31:00.667900   44266 main.go:141] libmachine: Waiting for SSH to be available...

	I0807 18:31:00.667908   44266 main.go:141] libmachine: Getting to WaitForSSH function...

	I0807 18:31:00.667916   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:00.670520   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.671001   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.671032   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.671175   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:00.671364   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.671513   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.671630   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:00.671786   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:00.671980   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:00.671990   44266 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0807 18:31:00.787597   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:31:00.787623   44266 main.go:141] libmachine: Detecting the provisioner...

	I0807 18:31:00.787633   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:00.790865   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.791362   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.791388   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.791510   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:00.791714   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.791937   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.792190   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:00.792379   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:00.792539   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:00.792549   44266 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0807 18:31:00.909345   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0807 18:31:00.909405   44266 main.go:141] libmachine: found compatible host: buildroot

	I0807 18:31:00.909414   44266 main.go:141] libmachine: Provisioning with buildroot...

	I0807 18:31:00.909421   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:31:00.909684   44266 buildroot.go:166] provisioning hostname "ha-198246-m03"

	I0807 18:31:00.909709   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:31:00.909928   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:00.913329   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.913773   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:00.913798   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:00.913978   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:00.914169   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.914339   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:00.914512   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:00.914692   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:00.914895   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:00.914915   44266 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-198246-m03 && echo "ha-198246-m03" | sudo tee /etc/hostname

	I0807 18:31:01.046391   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-198246-m03

	I0807 18:31:01.046419   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.049459   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.049924   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.049953   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.050088   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.050268   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.050448   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.050586   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.050755   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:01.050909   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:01.050924   44266 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-198246-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-198246-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-198246-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0807 18:31:01.178381   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0807 18:31:01.178417   44266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19389-20864/.minikube CaCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19389-20864/.minikube}

	I0807 18:31:01.178436   44266 buildroot.go:174] setting up certificates

	I0807 18:31:01.178447   44266 provision.go:84] configureAuth start

	I0807 18:31:01.178459   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetMachineName

	I0807 18:31:01.178749   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:01.181683   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.182031   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.182058   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.182247   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.184746   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.185072   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.185101   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.185229   44266 provision.go:143] copyHostCerts

	I0807 18:31:01.185260   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:31:01.185298   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem, removing ...

	I0807 18:31:01.185309   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem

	I0807 18:31:01.185381   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/key.pem (1679 bytes)

	I0807 18:31:01.185480   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:31:01.185505   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem, removing ...

	I0807 18:31:01.185514   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem

	I0807 18:31:01.185554   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/ca.pem (1082 bytes)

	I0807 18:31:01.185619   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:31:01.185643   44266 exec_runner.go:144] found /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem, removing ...

	I0807 18:31:01.185648   44266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem

	I0807 18:31:01.185683   44266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19389-20864/.minikube/cert.pem (1123 bytes)

	I0807 18:31:01.185753   44266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem org=jenkins.ha-198246-m03 san=[127.0.0.1 192.168.39.227 ha-198246-m03 localhost minikube]

	I0807 18:31:01.354582   44266 provision.go:177] copyRemoteCerts

	I0807 18:31:01.354653   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0807 18:31:01.354683   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.357461   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.357784   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.357817   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.358072   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.358268   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.358436   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.358560   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:01.447576   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0807 18:31:01.447656   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0807 18:31:01.475031   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0807 18:31:01.475102   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0807 18:31:01.501202   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0807 18:31:01.501289   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0807 18:31:01.528456   44266 provision.go:87] duration metric: took 349.995722ms to configureAuth

	I0807 18:31:01.528486   44266 buildroot.go:189] setting minikube options for container-runtime

	I0807 18:31:01.528699   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:31:01.528777   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.531665   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.532012   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.532042   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.532225   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.532423   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.532595   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.532702   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.532873   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:01.533031   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:01.533047   44266 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0807 18:31:01.817075   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0807 18:31:01.817099   44266 main.go:141] libmachine: Checking connection to Docker...

	I0807 18:31:01.817118   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetURL

	I0807 18:31:01.818384   44266 main.go:141] libmachine: (ha-198246-m03) DBG | Using libvirt version 6000000

	I0807 18:31:01.821056   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.821418   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.821439   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.821580   44266 main.go:141] libmachine: Docker is up and running!

	I0807 18:31:01.821595   44266 main.go:141] libmachine: Reticulating splines...

	I0807 18:31:01.821603   44266 client.go:171] duration metric: took 28.627914411s to LocalClient.Create

	I0807 18:31:01.821631   44266 start.go:167] duration metric: took 28.627967701s to libmachine.API.Create "ha-198246"

	I0807 18:31:01.821643   44266 start.go:293] postStartSetup for "ha-198246-m03" (driver="kvm2")

	I0807 18:31:01.821659   44266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0807 18:31:01.821698   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:01.821917   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0807 18:31:01.821940   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.824112   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.824469   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.824488   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.824623   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.824800   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.824973   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.825155   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:01.915999   44266 ssh_runner.go:195] Run: cat /etc/os-release

	I0807 18:31:01.920422   44266 info.go:137] Remote host: Buildroot 2023.02.9

	I0807 18:31:01.920443   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/addons for local assets ...

	I0807 18:31:01.920514   44266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19389-20864/.minikube/files for local assets ...

	I0807 18:31:01.920605   44266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> 280522.pem in /etc/ssl/certs

	I0807 18:31:01.920618   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /etc/ssl/certs/280522.pem

	I0807 18:31:01.920730   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0807 18:31:01.931294   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:31:01.955945   44266 start.go:296] duration metric: took 134.285824ms for postStartSetup

	I0807 18:31:01.956001   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetConfigRaw

	I0807 18:31:01.956611   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:01.959322   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.959688   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.959723   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.959995   44266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/config.json ...

	I0807 18:31:01.960180   44266 start.go:128] duration metric: took 28.784328806s to createHost

	I0807 18:31:01.960233   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:01.962214   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.962551   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:01.962579   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:01.962733   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:01.962916   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.963080   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:01.963211   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:01.963362   44266 main.go:141] libmachine: Using SSH client type: native

	I0807 18:31:01.963518   44266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil>  [] 0s} 192.168.39.227 22 <nil> <nil>}

	I0807 18:31:01.963528   44266 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0807 18:31:02.077437   44266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723055462.057555331

	I0807 18:31:02.077460   44266 fix.go:216] guest clock: 1723055462.057555331

	I0807 18:31:02.077470   44266 fix.go:229] Guest: 2024-08-07 18:31:02.057555331 +0000 UTC Remote: 2024-08-07 18:31:01.960191536 +0000 UTC m=+220.271212198 (delta=97.363795ms)

	I0807 18:31:02.077490   44266 fix.go:200] guest clock delta is within tolerance: 97.363795ms

	I0807 18:31:02.077497   44266 start.go:83] releasing machines lock for "ha-198246-m03", held for 28.901748397s

	I0807 18:31:02.077520   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.077788   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:02.081280   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.081885   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:02.081913   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.084121   44266 out.go:177] * Found network options:

	I0807 18:31:02.085422   44266 out.go:177]   - NO_PROXY=192.168.39.196,192.168.39.251

	W0807 18:31:02.086688   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	W0807 18:31:02.086711   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:31:02.086726   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.087351   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.087542   44266 main.go:141] libmachine: (ha-198246-m03) Calling .DriverName

	I0807 18:31:02.087647   44266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0807 18:31:02.087697   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	W0807 18:31:02.087728   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	W0807 18:31:02.087754   44266 proxy.go:119] fail to check proxy env: Error ip not in block

	I0807 18:31:02.087831   44266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0807 18:31:02.087877   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHHostname

	I0807 18:31:02.090758   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.090950   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.091267   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:02.091288   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.091311   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:02.091327   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:02.091450   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:02.091624   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHPort

	I0807 18:31:02.091638   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:02.091819   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHKeyPath

	I0807 18:31:02.091826   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:02.091982   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetSSHUsername

	I0807 18:31:02.091975   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:02.092120   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246-m03/id_rsa Username:docker}

	I0807 18:31:02.330635   44266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0807 18:31:02.338200   44266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0807 18:31:02.338275   44266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0807 18:31:02.355776   44266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0807 18:31:02.355798   44266 start.go:495] detecting cgroup driver to use...

	I0807 18:31:02.355869   44266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0807 18:31:02.373960   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0807 18:31:02.388788   44266 docker.go:217] disabling cri-docker service (if available) ...

	I0807 18:31:02.388863   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0807 18:31:02.402456   44266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0807 18:31:02.415862   44266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0807 18:31:02.528910   44266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0807 18:31:02.692177   44266 docker.go:233] disabling docker service ...

	I0807 18:31:02.692260   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0807 18:31:02.708366   44266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0807 18:31:02.722150   44266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0807 18:31:02.842254   44266 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0807 18:31:02.963283   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0807 18:31:02.979860   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0807 18:31:03.000776   44266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0807 18:31:03.000833   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.012949   44266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0807 18:31:03.013019   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.025364   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.037815   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.050150   44266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0807 18:31:03.062786   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.074694   44266 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.094223   44266 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0807 18:31:03.106816   44266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0807 18:31:03.117233   44266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0807 18:31:03.117281   44266 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0807 18:31:03.130652   44266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0807 18:31:03.140978   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:31:03.261390   44266 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0807 18:31:03.415655   44266 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0807 18:31:03.415731   44266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0807 18:31:03.420847   44266 start.go:563] Will wait 60s for crictl version

	I0807 18:31:03.420894   44266 ssh_runner.go:195] Run: which crictl

	I0807 18:31:03.424888   44266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0807 18:31:03.466634   44266 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0807 18:31:03.466722   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:31:03.495718   44266 ssh_runner.go:195] Run: crio --version

	I0807 18:31:03.666880   44266 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.29.1 ...

	I0807 18:31:03.742658   44266 out.go:177]   - env NO_PROXY=192.168.39.196

	I0807 18:31:03.816001   44266 out.go:177]   - env NO_PROXY=192.168.39.196,192.168.39.251

	I0807 18:31:03.888374   44266 main.go:141] libmachine: (ha-198246-m03) Calling .GetIP

	I0807 18:31:03.891307   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:03.891715   44266 main.go:141] libmachine: (ha-198246-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:24:52", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:30:48 +0000 UTC Type:0 Mac:52:54:00:9d:24:52 Iaid: IPaddr:192.168.39.227 Prefix:24 Hostname:ha-198246-m03 Clientid:01:52:54:00:9d:24:52}

	I0807 18:31:03.891745   44266 main.go:141] libmachine: (ha-198246-m03) DBG | domain ha-198246-m03 has defined IP address 192.168.39.227 and MAC address 52:54:00:9d:24:52 in network mk-ha-198246

	I0807 18:31:03.891998   44266 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0807 18:31:03.896652   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:31:03.912117   44266 mustload.go:65] Loading cluster: ha-198246

	I0807 18:31:03.912501   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:31:03.912897   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:31:03.912950   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:31:03.928344   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43499

	I0807 18:31:03.928736   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:31:03.929306   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:31:03.929334   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:31:03.929692   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:31:03.929888   44266 main.go:141] libmachine: (ha-198246) Calling .GetState

	I0807 18:31:03.931789   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:31:03.932081   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:31:03.932119   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:31:03.947851   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33021

	I0807 18:31:03.948291   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:31:03.948876   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:31:03.948893   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:31:03.949204   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:31:03.949455   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:31:03.949625   44266 certs.go:68] Setting up /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246 for IP: 192.168.39.227

	I0807 18:31:03.949636   44266 certs.go:194] generating shared ca certs ...

	I0807 18:31:03.949650   44266 certs.go:226] acquiring lock for ca certs: {Name:mkee954258064273498764506faba6feea3b6003 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:31:03.949763   44266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key

	I0807 18:31:03.949804   44266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key

	I0807 18:31:03.949809   44266 certs.go:256] generating profile certs ...

	I0807 18:31:03.949874   44266 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key

	I0807 18:31:03.949895   44266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5

	I0807 18:31:03.949910   44266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.196 192.168.39.251 192.168.39.227 192.168.39.254]

	I0807 18:31:04.235062   44266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5 ...

	I0807 18:31:04.235104   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5: {Name:mkc9ab09dfcc0a08e4cded1def253097d11345ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:31:04.235325   44266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5 ...

	I0807 18:31:04.235345   44266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5: {Name:mk706ab9d0d4064858493bbf1c933d49d1f0fd75 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0807 18:31:04.235444   44266 certs.go:381] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt.1af9f5f5 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt

	I0807 18:31:04.284244   44266 certs.go:385] copying /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key.1af9f5f5 -> /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key

	I0807 18:31:04.284561   44266 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key

	I0807 18:31:04.284585   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0807 18:31:04.284607   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0807 18:31:04.284635   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0807 18:31:04.284654   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0807 18:31:04.284671   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0807 18:31:04.284704   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0807 18:31:04.284726   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0807 18:31:04.284747   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0807 18:31:04.284824   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem (1338 bytes)

	W0807 18:31:04.284871   44266 certs.go:480] ignoring /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052_empty.pem, impossibly tiny 0 bytes

	I0807 18:31:04.284888   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca-key.pem (1679 bytes)

	I0807 18:31:04.284977   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/ca.pem (1082 bytes)

	I0807 18:31:04.285053   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/cert.pem (1123 bytes)

	I0807 18:31:04.285089   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/key.pem (1679 bytes)

	I0807 18:31:04.285156   44266 certs.go:484] found cert: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem (1708 bytes)

	I0807 18:31:04.285203   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem -> /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.285227   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem -> /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.285244   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:04.285288   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:31:04.288899   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:04.289445   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:31:04.289477   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:04.289641   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:31:04.289875   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:31:04.290047   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:31:04.290209   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:31:04.368646   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0807 18:31:04.375791   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0807 18:31:04.387726   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0807 18:31:04.392669   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0807 18:31:04.404818   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0807 18:31:04.409538   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0807 18:31:04.423952   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0807 18:31:04.429946   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0807 18:31:04.442196   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0807 18:31:04.447075   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0807 18:31:04.467205   44266 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0807 18:31:04.472136   44266 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0807 18:31:04.484789   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0807 18:31:04.513657   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0807 18:31:04.541568   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0807 18:31:04.570650   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0807 18:31:04.599209   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0807 18:31:04.624315   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0807 18:31:04.649418   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0807 18:31:04.674771   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0807 18:31:04.701297   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/certs/28052.pem --> /usr/share/ca-certificates/28052.pem (1338 bytes)

	I0807 18:31:04.728656   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/files/etc/ssl/certs/280522.pem --> /usr/share/ca-certificates/280522.pem (1708 bytes)

	I0807 18:31:04.756136   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0807 18:31:04.783116   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0807 18:31:04.800682   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0807 18:31:04.818998   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0807 18:31:04.836194   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0807 18:31:04.854131   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0807 18:31:04.871939   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0807 18:31:04.888443   44266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0807 18:31:04.905275   44266 ssh_runner.go:195] Run: openssl version

	I0807 18:31:04.911814   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/28052.pem && ln -fs /usr/share/ca-certificates/28052.pem /etc/ssl/certs/28052.pem"

	I0807 18:31:04.922949   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.927578   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug  7 18:17 /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.927640   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/28052.pem

	I0807 18:31:04.934032   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/28052.pem /etc/ssl/certs/51391683.0"

	I0807 18:31:04.945014   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/280522.pem && ln -fs /usr/share/ca-certificates/280522.pem /etc/ssl/certs/280522.pem"

	I0807 18:31:04.957480   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.962404   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug  7 18:17 /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.962459   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/280522.pem

	I0807 18:31:04.968351   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/280522.pem /etc/ssl/certs/3ec20f2e.0"

	I0807 18:31:04.980460   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0807 18:31:04.992337   44266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:04.997356   44266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug  7 17:37 /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:04.997422   44266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0807 18:31:05.003783   44266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0807 18:31:05.015178   44266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0807 18:31:05.019430   44266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0807 18:31:05.019490   44266 kubeadm.go:934] updating node {m03 192.168.39.227 8443 v1.30.3 crio true true} ...

	I0807 18:31:05.019580   44266 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-198246-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.227

	[Install]

	 config:

	{KubernetesVersion:v1.30.3 ClusterName:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0807 18:31:05.019607   44266 kube-vip.go:115] generating kube-vip config ...

	I0807 18:31:05.019640   44266 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0807 18:31:05.036848   44266 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0807 18:31:05.036914   44266 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0807 18:31:05.036972   44266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3

	I0807 18:31:05.047848   44266 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.3: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.3': No such file or directory

	Initiating transfer...

	I0807 18:31:05.047893   44266 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.3

	I0807 18:31:05.058827   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubectl.sha256

	I0807 18:31:05.058853   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl -> /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:31:05.058935   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl

	I0807 18:31:05.058827   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubelet.sha256

	I0807 18:31:05.058826   44266 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.3/bin/linux/amd64/kubeadm.sha256

	I0807 18:31:05.059037   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:31:05.059054   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm -> /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:31:05.059162   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm

	I0807 18:31:05.063740   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubectl': No such file or directory

	I0807 18:31:05.063770   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubectl --> /var/lib/minikube/binaries/v1.30.3/kubectl (51454104 bytes)

	I0807 18:31:05.093775   44266 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet -> /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:31:05.093820   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubeadm': No such file or directory

	I0807 18:31:05.093855   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubeadm --> /var/lib/minikube/binaries/v1.30.3/kubeadm (50249880 bytes)

	I0807 18:31:05.093875   44266 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet

	I0807 18:31:05.147621   44266 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.3/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.3/kubelet': No such file or directory

	I0807 18:31:05.147679   44266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19389-20864/.minikube/cache/linux/amd64/v1.30.3/kubelet --> /var/lib/minikube/binaries/v1.30.3/kubelet (100125080 bytes)

	I0807 18:31:06.022179   44266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0807 18:31:06.032561   44266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0807 18:31:06.051718   44266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0807 18:31:06.069963   44266 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0807 18:31:06.088103   44266 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0807 18:31:06.092277   44266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0807 18:31:06.105287   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:31:06.220917   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:31:06.238937   44266 host.go:66] Checking if "ha-198246" exists ...

	I0807 18:31:06.239328   44266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0807 18:31:06.239375   44266 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0807 18:31:06.258371   44266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37405

	I0807 18:31:06.258888   44266 main.go:141] libmachine: () Calling .GetVersion

	I0807 18:31:06.259464   44266 main.go:141] libmachine: Using API Version  1

	I0807 18:31:06.259488   44266 main.go:141] libmachine: () Calling .SetConfigRaw

	I0807 18:31:06.259882   44266 main.go:141] libmachine: () Calling .GetMachineName

	I0807 18:31:06.260092   44266 main.go:141] libmachine: (ha-198246) Calling .DriverName

	I0807 18:31:06.260264   44266 start.go:317] joinCluster: &{Name:ha-198246 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 Cluster

Name:ha-198246 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.196 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.251 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.227 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false

inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO

ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0807 18:31:06.260379   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0807 18:31:06.260399   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHHostname

	I0807 18:31:06.263930   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:06.264431   44266 main.go:141] libmachine: (ha-198246) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:88:98", ip: ""} in network mk-ha-198246: {Iface:virbr1 ExpiryTime:2024-08-07 19:27:36 +0000 UTC Type:0 Mac:52:54:00:b0:88:98 Iaid: IPaddr:192.168.39.196 Prefix:24 Hostname:ha-198246 Clientid:01:52:54:00:b0:88:98}

	I0807 18:31:06.264458   44266 main.go:141] libmachine: (ha-198246) DBG | domain ha-198246 has defined IP address 192.168.39.196 and MAC address 52:54:00:b0:88:98 in network mk-ha-198246

	I0807 18:31:06.264644   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHPort

	I0807 18:31:06.264810   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHKeyPath

	I0807 18:31:06.264929   44266 main.go:141] libmachine: (ha-198246) Calling .GetSSHUsername

	I0807 18:31:06.265035   44266 sshutil.go:53] new ssh client: &{IP:192.168.39.196 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19389-20864/.minikube/machines/ha-198246/id_rsa Username:docker}

	I0807 18:31:06.435193   44266 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.227 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:31:06.435239   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token od1f23.v6j6x0epna3a85qa --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m03 --control-plane --apiserver-advertise-address=192.168.39.227 --apiserver-bind-port=8443"

	I0807 18:31:30.206281   44266 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm join control-plane.minikube.internal:8443 --token od1f23.v6j6x0epna3a85qa --discovery-token-ca-cert-hash sha256:253c980a4c9122831b91d44000373c8d68b6d1a783eb0196691a7459bf1d3ac7 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-198246-m03 --control-plane --apiserver-advertise-address=192.168.39.227 --apiserver-bind-port=8443": (23.77100816s)

	I0807 18:31:30.206317   44266 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0807 18:31:30.813324   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-198246-m03 minikube.k8s.io/updated_at=2024_08_07T18_31_30_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e minikube.k8s.io/name=ha-198246 minikube.k8s.io/primary=false

	I0807 18:31:30.964365   44266 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-198246-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0807 18:31:31.090417   44266 start.go:319] duration metric: took 24.830149142s to joinCluster

	I0807 18:31:31.090498   44266 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.227 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0807 18:31:31.090781   44266 config.go:182] Loaded profile config "ha-198246": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3

	I0807 18:31:31.093184   44266 out.go:177] * Verifying Kubernetes components...

	I0807 18:31:31.094437   44266 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0807 18:31:31.342260   44266 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0807 18:31:31.362745   44266 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19389-20864/kubeconfig

	I0807 18:31:31.363071   44266 kapi.go:59] client config for ha-198246: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.crt", KeyFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/profiles/ha-198246/client.key", CAFile:"/home/jenkins/minikube-integration/19389-20864/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02a80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0807 18:31:31.363166   44266 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.196:8443

	I0807 18:31:31.363437   44266 node_ready.go:35] waiting up to 6m0s for node "ha-198246-m03" to be "Ready" ...

	I0807 18:31:31.363528   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:31.363541   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:31.363551   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:31.363556   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:31.367408   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:31.864633   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:31.864676   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:31.864702   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:31.864711   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:31.868168   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:32.363859   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:32.363895   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:32.363903   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:32.363908   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:32.367827   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:32.863813   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:32.863834   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:32.863841   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:32.863846   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:32.867002   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:33.363594   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:33.363616   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:33.363625   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:33.363631   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:33.368287   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:33.369938   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:33.864014   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:33.864035   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:33.864043   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:33.864050   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:33.868446   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:34.364544   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:34.364563   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:34.364568   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:34.364571   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:34.368487   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:34.863667   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:34.863695   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:34.863705   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:34.863711   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:34.867251   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:35.364368   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:35.364391   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:35.364397   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:35.364405   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:35.368606   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:35.370093   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:35.864081   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:35.864108   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:35.864120   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:35.864126   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:35.867805   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:36.363814   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:36.363838   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:36.363848   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:36.363854   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:36.367626   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:36.863972   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:36.863992   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:36.864000   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:36.864004   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:36.867776   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:37.363945   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:37.363966   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:37.363974   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:37.363977   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:37.367672   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:37.864665   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:37.864704   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:37.864712   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:37.864715   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:37.868330   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:37.869986   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:38.363639   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:38.363660   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:38.363668   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:38.363672   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:38.367008   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:38.863892   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:38.863919   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:38.863931   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:38.863935   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:38.872605   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:31:39.364337   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:39.364368   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:39.364375   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:39.364379   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:39.367983   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:39.863967   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:39.863990   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:39.863999   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:39.864003   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:39.867134   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:40.363638   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:40.363664   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:40.363675   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:40.363680   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:40.367384   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:40.368391   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:40.863639   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:40.863658   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:40.863665   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:40.863669   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:40.866980   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:41.364633   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:41.364655   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:41.364665   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:41.364671   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:41.368280   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:41.864268   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:41.864288   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:41.864297   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:41.864301   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:41.868013   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:42.364521   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:42.364546   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:42.364557   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:42.364564   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:42.367904   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:42.368754   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:42.864040   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:42.864061   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:42.864069   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:42.864073   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:42.867582   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:43.363930   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:43.363950   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:43.363958   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:43.363961   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:43.368329   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:43.864004   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:43.864030   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:43.864042   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:43.864054   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:43.868118   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:44.364372   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:44.364399   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:44.364411   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:44.364416   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:44.367990   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:44.863922   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:44.863945   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:44.863957   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:44.863965   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:44.868231   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:44.869027   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:45.364338   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:45.364359   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:45.364367   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:45.364372   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:45.368558   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:45.863928   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:45.863949   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:45.863957   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:45.863962   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:45.867520   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:46.363984   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:46.364009   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:46.364017   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:46.364022   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:46.367693   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:46.864611   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:46.864635   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:46.864643   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:46.864647   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:46.868195   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:46.869168   44266 node_ready.go:53] node "ha-198246-m03" has status "Ready":"False"

	I0807 18:31:47.363985   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:47.364006   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:47.364014   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:47.364018   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:47.367513   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:47.863715   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:47.863735   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:47.863743   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:47.863748   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:47.866941   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.364283   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:48.364304   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.364311   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.364315   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.368301   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.864297   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:48.864317   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.864326   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.864332   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.867691   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.868357   44266 node_ready.go:49] node "ha-198246-m03" has status "Ready":"True"

	I0807 18:31:48.868374   44266 node_ready.go:38] duration metric: took 17.504916336s for node "ha-198246-m03" to be "Ready" ...

	I0807 18:31:48.868382   44266 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:31:48.868439   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:48.868447   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.868454   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.868458   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.875973   44266 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0807 18:31:48.882318   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.882408   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rbnrx

	I0807 18:31:48.882420   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.882431   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.882444   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.885507   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.886130   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:48.886147   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.886156   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.886162   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.888994   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.889510   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.889528   44266 pod_ready.go:81] duration metric: took 7.186047ms for pod "coredns-7db6d8ff4d-rbnrx" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.889537   44266 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.889582   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-w6w6g

	I0807 18:31:48.889589   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.889596   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.889601   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.893021   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:48.894159   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:48.894181   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.894188   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.894192   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.896425   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.896893   44266 pod_ready.go:92] pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.896909   44266 pod_ready.go:81] duration metric: took 7.366231ms for pod "coredns-7db6d8ff4d-w6w6g" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.896917   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.896961   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246

	I0807 18:31:48.896967   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.896975   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.896982   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.899237   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.899953   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:48.899970   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.899978   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.899983   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.902186   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.902691   44266 pod_ready.go:92] pod "etcd-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.902715   44266 pod_ready.go:81] duration metric: took 5.790956ms for pod "etcd-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.902726   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.902784   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m02

	I0807 18:31:48.902795   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.902803   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.902814   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.905329   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.905806   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:48.905821   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:48.905828   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:48.905832   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:48.908047   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:48.908655   44266 pod_ready.go:92] pod "etcd-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:48.908670   44266 pod_ready.go:81] duration metric: took 5.936535ms for pod "etcd-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:48.908678   44266 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.064661   44266 request.go:629] Waited for 155.923893ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m03

	I0807 18:31:49.064753   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/etcd-ha-198246-m03

	I0807 18:31:49.064759   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.064764   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.064772   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.068282   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:49.265339   44266 request.go:629] Waited for 196.371663ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:49.265425   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:49.265438   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.265449   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.265456   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.268957   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:49.269555   44266 pod_ready.go:92] pod "etcd-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:49.269571   44266 pod_ready.go:81] duration metric: took 360.885615ms for pod "etcd-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.269587   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.464819   44266 request.go:629] Waited for 195.162513ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:31:49.464903   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246

	I0807 18:31:49.464909   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.464916   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.464921   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.469362   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:49.664800   44266 request.go:629] Waited for 194.369823ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:49.664876   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:49.664881   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.664887   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.664909   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.668254   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:49.668909   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:49.668928   44266 pod_ready.go:81] duration metric: took 399.332717ms for pod "kube-apiserver-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.668937   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:49.864884   44266 request.go:629] Waited for 195.895244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:31:49.864939   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m02

	I0807 18:31:49.864944   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:49.864964   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:49.864968   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:49.868343   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.065388   44266 request.go:629] Waited for 196.362909ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:50.065438   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:50.065443   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.065450   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.065455   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.069435   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.070338   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:50.070357   44266 pod_ready.go:81] duration metric: took 401.414954ms for pod "kube-apiserver-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.070367   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.264445   44266 request.go:629] Waited for 194.01249ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m03

	I0807 18:31:50.264517   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-198246-m03

	I0807 18:31:50.264525   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.264534   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.264540   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.268180   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.465319   44266 request.go:629] Waited for 196.408254ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:50.465387   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:50.465391   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.465398   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.465403   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.468707   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.469431   44266 pod_ready.go:92] pod "kube-apiserver-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:50.469449   44266 pod_ready.go:81] duration metric: took 399.076161ms for pod "kube-apiserver-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.469459   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.664732   44266 request.go:629] Waited for 195.186866ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:31:50.664805   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246

	I0807 18:31:50.664816   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.664827   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.664835   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.668528   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:50.864795   44266 request.go:629] Waited for 195.34558ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:50.864864   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:50.864871   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:50.864880   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:50.864888   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:50.867688   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:50.868601   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:50.868620   44266 pod_ready.go:81] duration metric: took 399.154742ms for pod "kube-controller-manager-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:50.868630   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.064678   44266 request.go:629] Waited for 195.987732ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:31:51.064754   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m02

	I0807 18:31:51.064761   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.064772   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.064783   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.068355   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.265387   44266 request.go:629] Waited for 196.386347ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:51.265453   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:51.265460   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.265471   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.265480   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.269137   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.269661   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:51.269679   44266 pod_ready.go:81] duration metric: took 401.043609ms for pod "kube-controller-manager-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.269689   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.465093   44266 request.go:629] Waited for 195.339663ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m03

	I0807 18:31:51.465157   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-198246-m03

	I0807 18:31:51.465165   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.465174   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.465179   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.468791   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.664927   44266 request.go:629] Waited for 195.372605ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:51.664995   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:51.665006   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.665017   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.665027   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.668549   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:51.669363   44266 pod_ready.go:92] pod "kube-controller-manager-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:51.669381   44266 pod_ready.go:81] duration metric: took 399.686225ms for pod "kube-controller-manager-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.669390   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:51.865256   44266 request.go:629] Waited for 195.79115ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:31:51.865313   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4l79v

	I0807 18:31:51.865320   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:51.865329   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:51.865334   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:51.873470   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:31:52.064458   44266 request.go:629] Waited for 190.295419ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:52.064521   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:52.064526   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.064533   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.064538   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.067938   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.068805   44266 pod_ready.go:92] pod "kube-proxy-4l79v" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:52.068837   44266 pod_ready.go:81] duration metric: took 399.436427ms for pod "kube-proxy-4l79v" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.068851   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-7mttr" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.264784   44266 request.go:629] Waited for 195.867102ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7mttr

	I0807 18:31:52.264838   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7mttr

	I0807 18:31:52.264843   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.264849   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.264852   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.269765   44266 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0807 18:31:52.464903   44266 request.go:629] Waited for 194.439324ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:52.464972   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:52.464983   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.464993   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.465002   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.468248   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.468752   44266 pod_ready.go:92] pod "kube-proxy-7mttr" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:52.468774   44266 pod_ready.go:81] duration metric: took 399.914652ms for pod "kube-proxy-7mttr" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.468783   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.664867   44266 request.go:629] Waited for 196.022855ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:31:52.664951   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-proxy-m5ng2

	I0807 18:31:52.664959   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.664973   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.664988   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.668228   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.865340   44266 request.go:629] Waited for 196.363915ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:52.865394   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:52.865399   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:52.865406   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:52.865411   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:52.868878   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:52.869535   44266 pod_ready.go:92] pod "kube-proxy-m5ng2" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:52.869556   44266 pod_ready.go:81] duration metric: took 400.766778ms for pod "kube-proxy-m5ng2" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:52.869565   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.064548   44266 request.go:629] Waited for 194.920878ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:31:53.064617   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246

	I0807 18:31:53.064625   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.064633   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.064640   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.068146   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.265207   44266 request.go:629] Waited for 196.43783ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:53.265255   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246

	I0807 18:31:53.265260   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.265267   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.265272   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.268523   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.269186   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:53.269204   44266 pod_ready.go:81] duration metric: took 399.633139ms for pod "kube-scheduler-ha-198246" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.269217   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.465360   44266 request.go:629] Waited for 196.088508ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:31:53.465413   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m02

	I0807 18:31:53.465418   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.465433   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.465450   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.468768   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.664761   44266 request.go:629] Waited for 195.371572ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:53.664812   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m02

	I0807 18:31:53.664817   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.664824   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.664827   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.668421   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:53.669073   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:53.669096   44266 pod_ready.go:81] duration metric: took 399.871721ms for pod "kube-scheduler-ha-198246-m02" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.669110   44266 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:53.865211   44266 request.go:629] Waited for 196.027374ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m03

	I0807 18:31:53.865290   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-198246-m03

	I0807 18:31:53.865298   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:53.865305   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:53.865314   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:53.868661   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:54.064951   44266 request.go:629] Waited for 195.756654ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:54.065010   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes/ha-198246-m03

	I0807 18:31:54.065018   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.065027   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.065032   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.068111   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:54.068802   44266 pod_ready.go:92] pod "kube-scheduler-ha-198246-m03" in "kube-system" namespace has status "Ready":"True"

	I0807 18:31:54.068820   44266 pod_ready.go:81] duration metric: took 399.702974ms for pod "kube-scheduler-ha-198246-m03" in "kube-system" namespace to be "Ready" ...

	I0807 18:31:54.068830   44266 pod_ready.go:38] duration metric: took 5.200435833s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0807 18:31:54.068843   44266 api_server.go:52] waiting for apiserver process to appear ...

	I0807 18:31:54.068887   44266 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0807 18:31:54.084598   44266 api_server.go:72] duration metric: took 22.994065627s to wait for apiserver process to appear ...

	I0807 18:31:54.084621   44266 api_server.go:88] waiting for apiserver healthz status ...

	I0807 18:31:54.084641   44266 api_server.go:253] Checking apiserver healthz at https://192.168.39.196:8443/healthz ...

	I0807 18:31:54.090716   44266 api_server.go:279] https://192.168.39.196:8443/healthz returned 200:

	ok

	I0807 18:31:54.090787   44266 round_trippers.go:463] GET https://192.168.39.196:8443/version

	I0807 18:31:54.090798   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.090908   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.090933   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.091732   44266 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0807 18:31:54.091793   44266 api_server.go:141] control plane version: v1.30.3

	I0807 18:31:54.091810   44266 api_server.go:131] duration metric: took 7.181714ms to wait for apiserver health ...

	I0807 18:31:54.091828   44266 system_pods.go:43] waiting for kube-system pods to appear ...

	I0807 18:31:54.264554   44266 request.go:629] Waited for 172.642251ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.264604   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.264611   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.264621   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.264626   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.272067   44266 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0807 18:31:54.279487   44266 system_pods.go:59] 24 kube-system pods found

	I0807 18:31:54.279517   44266 system_pods.go:61] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:31:54.279526   44266 system_pods.go:61] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:31:54.279532   44266 system_pods.go:61] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:31:54.279537   44266 system_pods.go:61] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:31:54.279542   44266 system_pods.go:61] "etcd-ha-198246-m03" [8df491af-6c48-41d6-873f-c1c39afac2f8] Running

	I0807 18:31:54.279547   44266 system_pods.go:61] "kindnet-7854s" [f87d6292-b9b6-4f63-912c-9dfda0471e2e] Running

	I0807 18:31:54.279552   44266 system_pods.go:61] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:31:54.279556   44266 system_pods.go:61] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:31:54.279562   44266 system_pods.go:61] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:31:54.279567   44266 system_pods.go:61] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:31:54.279573   44266 system_pods.go:61] "kube-apiserver-ha-198246-m03" [c589756a-dda8-44a8-82bb-60532e74eb8b] Running

	I0807 18:31:54.279581   44266 system_pods.go:61] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:31:54.279587   44266 system_pods.go:61] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:31:54.279592   44266 system_pods.go:61] "kube-controller-manager-ha-198246-m03" [5e0d97af-b071-4467-8c3a-dc71f904e84c] Running

	I0807 18:31:54.279597   44266 system_pods.go:61] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:31:54.279602   44266 system_pods.go:61] "kube-proxy-7mttr" [7cb96f6e-47a5-4d6c-a80e-77df1eafc970] Running

	I0807 18:31:54.279608   44266 system_pods.go:61] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:31:54.279616   44266 system_pods.go:61] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:31:54.279621   44266 system_pods.go:61] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:31:54.279626   44266 system_pods.go:61] "kube-scheduler-ha-198246-m03" [5fe100c3-b0a4-4499-a7e2-330c88ee8162] Running

	I0807 18:31:54.279633   44266 system_pods.go:61] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:31:54.279638   44266 system_pods.go:61] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:31:54.279643   44266 system_pods.go:61] "kube-vip-ha-198246-m03" [ba0ab294-fb6f-4161-82f7-288a2a0d4f13] Running

	I0807 18:31:54.279649   44266 system_pods.go:61] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:31:54.279657   44266 system_pods.go:74] duration metric: took 187.820696ms to wait for pod list to return data ...

	I0807 18:31:54.279670   44266 default_sa.go:34] waiting for default service account to be created ...

	I0807 18:31:54.465078   44266 request.go:629] Waited for 185.333525ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:31:54.465131   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/default/serviceaccounts

	I0807 18:31:54.465136   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.465143   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.465169   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.467798   44266 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0807 18:31:54.467923   44266 default_sa.go:45] found service account: "default"

	I0807 18:31:54.467940   44266 default_sa.go:55] duration metric: took 188.262232ms for default service account to be created ...

	I0807 18:31:54.467950   44266 system_pods.go:116] waiting for k8s-apps to be running ...

	I0807 18:31:54.664308   44266 request.go:629] Waited for 196.296927ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.664402   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/namespaces/kube-system/pods

	I0807 18:31:54.664413   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.664425   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.664436   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.673358   44266 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0807 18:31:54.681646   44266 system_pods.go:86] 24 kube-system pods found

	I0807 18:31:54.681689   44266 system_pods.go:89] "coredns-7db6d8ff4d-rbnrx" [96fa387b-f93b-40df-9ed6-78834f3d02df] Running

	I0807 18:31:54.681698   44266 system_pods.go:89] "coredns-7db6d8ff4d-w6w6g" [143456ef-ffd1-4d42-b9d0-6b778094eca5] Running

	I0807 18:31:54.681710   44266 system_pods.go:89] "etcd-ha-198246" [861c9809-7151-4564-acae-2ad35ada4196] Running

	I0807 18:31:54.681722   44266 system_pods.go:89] "etcd-ha-198246-m02" [af692dc4-ba35-4226-999d-28fa1a44235c] Running

	I0807 18:31:54.681729   44266 system_pods.go:89] "etcd-ha-198246-m03" [8df491af-6c48-41d6-873f-c1c39afac2f8] Running

	I0807 18:31:54.681736   44266 system_pods.go:89] "kindnet-7854s" [f87d6292-b9b6-4f63-912c-9dfda0471e2e] Running

	I0807 18:31:54.681743   44266 system_pods.go:89] "kindnet-8x6fj" [24dceff9-a78c-47c7-9d36-01fbd62ee362] Running

	I0807 18:31:54.681760   44266 system_pods.go:89] "kindnet-sgl8v" [574aa453-48ef-44ff-b10a-13142fc8cf7f] Running

	I0807 18:31:54.681767   44266 system_pods.go:89] "kube-apiserver-ha-198246" [52e51327-3341-452e-b7bd-95a80adde42f] Running

	I0807 18:31:54.681773   44266 system_pods.go:89] "kube-apiserver-ha-198246-m02" [a983198b-7df1-45bb-bd75-61b345d7397c] Running

	I0807 18:31:54.681781   44266 system_pods.go:89] "kube-apiserver-ha-198246-m03" [c589756a-dda8-44a8-82bb-60532e74eb8b] Running

	I0807 18:31:54.681794   44266 system_pods.go:89] "kube-controller-manager-ha-198246" [73522726-984c-4c1a-9eb6-c0c2eb896b45] Running

	I0807 18:31:54.681805   44266 system_pods.go:89] "kube-controller-manager-ha-198246-m02" [84840391-d86d-45e5-a4f7-6daabbe16557] Running

	I0807 18:31:54.681820   44266 system_pods.go:89] "kube-controller-manager-ha-198246-m03" [5e0d97af-b071-4467-8c3a-dc71f904e84c] Running

	I0807 18:31:54.681830   44266 system_pods.go:89] "kube-proxy-4l79v" [649e12b4-4e77-48a9-af9c-691694c4ec99] Running

	I0807 18:31:54.681838   44266 system_pods.go:89] "kube-proxy-7mttr" [7cb96f6e-47a5-4d6c-a80e-77df1eafc970] Running

	I0807 18:31:54.681848   44266 system_pods.go:89] "kube-proxy-m5ng2" [ed3a0c5c-ff85-48e4-9165-329e89fdb64a] Running

	I0807 18:31:54.682159   44266 system_pods.go:89] "kube-scheduler-ha-198246" [dd45e791-8b98-4d64-8131-c2736463faae] Running

	I0807 18:31:54.682175   44266 system_pods.go:89] "kube-scheduler-ha-198246-m02" [f9571af0-65a0-46eb-98ce-d982fa4a2cce] Running

	I0807 18:31:54.682180   44266 system_pods.go:89] "kube-scheduler-ha-198246-m03" [5fe100c3-b0a4-4499-a7e2-330c88ee8162] Running

	I0807 18:31:54.682185   44266 system_pods.go:89] "kube-vip-ha-198246" [a230b27d-cbec-4a1a-a7e7-7192f3de3915] Running

	I0807 18:31:54.682188   44266 system_pods.go:89] "kube-vip-ha-198246-m02" [9ef1c5a2-7829-4937-972d-ce53f60064f8] Running

	I0807 18:31:54.682192   44266 system_pods.go:89] "kube-vip-ha-198246-m03" [ba0ab294-fb6f-4161-82f7-288a2a0d4f13] Running

	I0807 18:31:54.682196   44266 system_pods.go:89] "storage-provisioner" [88457253-9aa8-4bd7-974f-1b47b341d40c] Running

	I0807 18:31:54.682205   44266 system_pods.go:126] duration metric: took 214.246128ms to wait for k8s-apps to be running ...

	I0807 18:31:54.682217   44266 system_svc.go:44] waiting for kubelet service to be running ....

	I0807 18:31:54.682265   44266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0807 18:31:54.698973   44266 system_svc.go:56] duration metric: took 16.748968ms WaitForService to wait for kubelet

	I0807 18:31:54.699002   44266 kubeadm.go:582] duration metric: took 23.60847153s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0807 18:31:54.699020   44266 node_conditions.go:102] verifying NodePressure condition ...

	I0807 18:31:54.864327   44266 request.go:629] Waited for 165.224496ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.196:8443/api/v1/nodes

	I0807 18:31:54.864388   44266 round_trippers.go:463] GET https://192.168.39.196:8443/api/v1/nodes

	I0807 18:31:54.864395   44266 round_trippers.go:469] Request Headers:

	I0807 18:31:54.864407   44266 round_trippers.go:473]     Accept: application/json, */*

	I0807 18:31:54.864413   44266 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0807 18:31:54.867905   44266 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0807 18:31:54.868930   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:31:54.868950   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:31:54.868961   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:31:54.868964   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:31:54.868968   44266 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0807 18:31:54.868971   44266 node_conditions.go:123] node cpu capacity is 2

	I0807 18:31:54.868974   44266 node_conditions.go:105] duration metric: took 169.949978ms to run NodePressure ...

	I0807 18:31:54.868985   44266 start.go:241] waiting for startup goroutines ...

	I0807 18:31:54.869001   44266 start.go:255] writing updated cluster config ...

	I0807 18:31:54.869277   44266 ssh_runner.go:195] Run: rm -f paused

	I0807 18:31:54.921624   44266 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)

	I0807 18:31:54.924829   44266 out.go:177] * Done! kubectl is now configured to use "ha-198246" cluster and "default" namespace by default

	==> CRI-O <==

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.916507652Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=6ccaf0e2-a893-4574-8b98-4180dd96eaa7 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.916606753Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=6ccaf0e2-a893-4574-8b98-4180dd96eaa7 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.918357467Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,PodSandboxId:4d0990efdcee83b764f38e56ae479be7f443d164067cefa10057f1576168f7c2,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1723055519101351291,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-chh26,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 42848aea-5e18-4f5c-b59d-f615d5128a74,},Annotations:map[string]string{io.kubernetes.container.hash: a6ef02f1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,PodSandboxId:a5394b2f1434ba21f4f4773555d63d3d4f295aff760fc79e94c5c175b4c8af4f,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319342376725,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-w6w6g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 143456ef-ffd1-4d42-b9d0-6b778094eca5,},Annotations:map[string]string{io.kubernetes.container.hash: 6be15b7,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"U

DP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,PodSandboxId:b57adade6ea152287caefc73242a7e723cff76836de4a80242c03abbb035bb13,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1723055319067011712,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rbnrx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

96fa387b-f93b-40df-9ed6-78834f3d02df,},Annotations:map[string]string{io.kubernetes.container.hash: 727b5a83,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,PodSandboxId:885cc92388628d238f8733c8a4e19dbe966de1d74cae5f0b0260d47f543204eb,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING

,CreatedAt:1723055318987833300,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 88457253-9aa8-4bd7-974f-1b47b341d40c,},Annotations:map[string]string{io.kubernetes.container.hash: c688b40c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,PodSandboxId:bd5d340b4a58434695e62b4ffc8947cc9fe10963c7224febd850e872801a5ed1,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:917d7814b9b5b870a04ef7bbee5414485a7ba8385be9c26e1df27463f6fb6557,State:CON

TAINER_RUNNING,CreatedAt:1723055306768350208,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-sgl8v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 574aa453-48ef-44ff-b10a-13142fc8cf7f,},Annotations:map[string]string{io.kubernetes.container.hash: f4a4ed57,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,PodSandboxId:4aec116af531d8547d5001b805d7728adf6a1402d2f9fb4b9776f15011e8490d,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,State:CONTAINER_RUNNING,CreatedAt:1723055302

363392306,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4l79v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 649e12b4-4e77-48a9-af9c-691694c4ec99,},Annotations:map[string]string{io.kubernetes.container.hash: 6ac1dec9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,PodSandboxId:c3113eff4cbeab6d11557ebe28457c4fed8b799968cd7a8112552a9f26c0c7a1,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:172305528372

0347825,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0f267a1609da84deb6a231872d87975b,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,PodSandboxId:1fcd84f97f1d17549fda334f2d795061561cad20b325aed47c328b7537d9e461,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,State:CONTAINER_RUNNING,CreatedAt:1723055280599506170,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b2b91906fc54e8232161e687fc4a9af5,},Annotations:map[string]string{io.kubernetes.container.hash: 4422576b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,PodSandboxId:0e8285057cc0561c225b97a8688e2163325f9b61a96754f277a1b02818a5ef56,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1723055280563764082,Labels:map[string]string{io.kubernetes.container.name: e

tcd,io.kubernetes.pod.name: etcd-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c60b0b92792ae1d5ba11a7a2e649f612,},Annotations:map[string]string{io.kubernetes.container.hash: 51cc6761,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,PodSandboxId:7c56ff7ba09a0f2f1e24d97436a3c0bc5704d6f7f5f3d60c08c9f3cb424a6107,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,State:CONTAINER_RUNNING,CreatedAt:1723055280588797776,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kub

e-scheduler-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56b90546fb511b52cb0b98695e572bae,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,PodSandboxId:30588dee2a435159b1676038c3a1e71d8e794c98f645bd6032392139ac087781,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,State:CONTAINER_RUNNING,CreatedAt:1723055280520038813,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-c

ontroller-manager-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b12d62604f0b70faa552e6c44d8cd532,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=6ccaf0e2-a893-4574-8b98-4180dd96eaa7 name=/runtime.v1.RuntimeService/ListContainers

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.922224791Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,Verbose:false,}" file="otel-collector/interceptors.go:62" id=1a5ea813-776b-4bc2-afeb-3d7358cd03b5 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.922375322Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:80335e9819afda5a240bdeaa75a8e44cfe48c8dbafa5f599d32606e0a6b453dc,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055519175572897,StartedAt:1723055519208613635,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox:1.28,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-chh26,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 42848aea-5e18-4f5c-b59d-f615d5128a74,},Annotations:map[string]string{io.kubernetes.container.hash: a6ef02f1,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termin

ationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/42848aea-5e18-4f5c-b59d-f615d5128a74/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/42848aea-5e18-4f5c-b59d-f615d5128a74/containers/busybox/565e84e5,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/run/secrets/kubernetes.io/serviceaccount,HostPath:/var/lib/kubelet/pods/42848aea-5e18-4f5c-b59d-f615d5128a74/volumes/kubernetes.io~projected/kube-api-access-mdsts,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/default_busybox-fc5497c4f-chh26_42848aea-5e18-4f5c-b59d-f615d5128a74/busybox/0.log,Resources:&ContainerR

esources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:2,MemoryLimitInBytes:0,OomScoreAdj:1000,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=1a5ea813-776b-4bc2-afeb-3d7358cd03b5 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.922969436Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,Verbose:false,}" file="otel-collector/interceptors.go:62" id=2e3d5314-4015-4b9e-b46e-cfa4d03d7b4d name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.923089958Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055319394161848,StartedAt:1723055319419666821,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/coredns/coredns:v1.11.1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-w6w6g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 143456ef-ffd1-4d42-b9d0-6b778094eca5,},Annotations:map[string]string{io.kubernetes.container.hash: 6be15b7,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo

rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/coredns,HostPath:/var/lib/kubelet/pods/143456ef-ffd1-4d42-b9d0-6b778094eca5/volumes/kubernetes.io~configmap/config-volume,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/143456ef-ffd1-4d42-b9d0-6b778094eca5/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/143456ef-ffd1-4d42-b9d0-6b778094eca5/containers/coredns/8bfec987,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGAT

ION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/run/secrets/kubernetes.io/serviceaccount,HostPath:/var/lib/kubelet/pods/143456ef-ffd1-4d42-b9d0-6b778094eca5/volumes/kubernetes.io~projected/kube-api-access-j55sb,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_coredns-7db6d8ff4d-w6w6g_143456ef-ffd1-4d42-b9d0-6b778094eca5/coredns/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:102,MemoryLimitInBytes:178257920,OomScoreAdj:967,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:178257920,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=2e3d5314-4015-4b9e-b46e-cfa4d03d7b4d name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.923717167Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,Verbose:false,}" file="otel-collector/interceptors.go:62" id=5e7f7aad-01f7-4283-92db-377f3238557d name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.923852445Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055319131700926,StartedAt:1723055319166704711,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/coredns/coredns:v1.11.1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rbnrx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 96fa387b-f93b-40df-9ed6-78834f3d02df,},Annotations:map[string]string{io.kubernetes.container.hash: 727b5a83,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerP

ort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/coredns,HostPath:/var/lib/kubelet/pods/96fa387b-f93b-40df-9ed6-78834f3d02df/volumes/kubernetes.io~configmap/config-volume,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/96fa387b-f93b-40df-9ed6-78834f3d02df/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/96fa387b-f93b-40df-9ed6-78834f3d02df/containers/coredns/a2123e16,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGA

TION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/run/secrets/kubernetes.io/serviceaccount,HostPath:/var/lib/kubelet/pods/96fa387b-f93b-40df-9ed6-78834f3d02df/volumes/kubernetes.io~projected/kube-api-access-gcsfw,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_coredns-7db6d8ff4d-rbnrx_96fa387b-f93b-40df-9ed6-78834f3d02df/coredns/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:102,MemoryLimitInBytes:178257920,OomScoreAdj:967,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:178257920,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=5e7f7aad-01f7-4283-92db-377f3238557d name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.924361817Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,Verbose:false,}" file="otel-collector/interceptors.go:62" id=5ae3af99-38b3-4ed8-9b4a-52991d77d6bf name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.924535215Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:93fcff9b17b4b2366750c04f15288dda856a885fa1e95d4510a83b2b14b855a9,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055319061825377,StartedAt:1723055319101021240,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:gcr.io/k8s-minikube/storage-provisioner:v5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 88457253-9aa8-4bd7-974f-1b47b341d40c,},Annotations:map[string]string{io.kubernetes.container.hash: c688b40c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-

log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/tmp,HostPath:/tmp,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/88457253-9aa8-4bd7-974f-1b47b341d40c/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/88457253-9aa8-4bd7-974f-1b47b341d40c/containers/storage-provisioner/36e13ac9,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/run/secrets/kubernetes.io/serviceaccount,HostPath:/var/lib/kubelet/pods/88457253-9aa8-4bd7-974f-1b47b341d40c/volumes/kubernetes.io~projected/kube-api-access-ts7zg,Readonly:true,SelinuxRelabel:false,Propag

ation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_storage-provisioner_88457253-9aa8-4bd7-974f-1b47b341d40c/storage-provisioner/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:2,MemoryLimitInBytes:0,OomScoreAdj:1000,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=5ae3af99-38b3-4ed8-9b4a-52991d77d6bf name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.924998967Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,Verbose:false,}" file="otel-collector/interceptors.go:62" id=d0873502-6730-4f9a-b535-2e085ccd0f3d name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.925223566Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055306994672118,StartedAt:1723055307021875248,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:docker.io/kindest/kindnetd:v20240730-75a5af0c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:917d7814b9b5b870a04ef7bbee5414485a7ba8385be9c26e1df27463f6fb6557,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-sgl8v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 574aa453-48ef-44ff-b10a-13142fc8cf7f,},Annotations:map[string]string{io.kubernetes.container.hash: f4a4ed57,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.c

ontainer.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/run/xtables.lock,HostPath:/run/xtables.lock,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/lib/modules,HostPath:/lib/modules,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/574aa453-48ef-44ff-b10a-13142fc8cf7f/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/574aa453-48ef-44ff-b10a-13142fc8cf7f/containers/kindnet-cni/56b06f91,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/cni/net.d,HostPath:/etc/cn

i/net.d,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/run/secrets/kubernetes.io/serviceaccount,HostPath:/var/lib/kubelet/pods/574aa453-48ef-44ff-b10a-13142fc8cf7f/volumes/kubernetes.io~projected/kube-api-access-llmrx,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_kindnet-sgl8v_574aa453-48ef-44ff-b10a-13142fc8cf7f/kindnet-cni/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:10000,CpuShares:102,MemoryLimitInBytes:52428800,OomScoreAdj:-997,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:52428800,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=d0873502-6730-4f9a-b535-2e085ccd0f3d n

ame=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.925824537Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,Verbose:false,}" file="otel-collector/interceptors.go:62" id=301d8d89-ed2c-489b-b881-2faf52267ba1 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.927840711Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055302400834776,StartedAt:1723055302440508558,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/kube-proxy:v1.30.3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4l79v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 649e12b4-4e77-48a9-af9c-691694c4ec99,},Annotations:map[string]string{io.kubernetes.container.hash: 6ac1dec9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.t

erminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/run/xtables.lock,HostPath:/run/xtables.lock,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/lib/modules,HostPath:/lib/modules,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/649e12b4-4e77-48a9-af9c-691694c4ec99/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/649e12b4-4e77-48a9-af9c-691694c4ec99/containers/kube-proxy/e55c1361,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/lib/kube-proxy,HostPath:/var/lib/kube

let/pods/649e12b4-4e77-48a9-af9c-691694c4ec99/volumes/kubernetes.io~configmap/kube-proxy,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/run/secrets/kubernetes.io/serviceaccount,HostPath:/var/lib/kubelet/pods/649e12b4-4e77-48a9-af9c-691694c4ec99/volumes/kubernetes.io~projected/kube-api-access-t78jp,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_kube-proxy-4l79v_649e12b4-4e77-48a9-af9c-691694c4ec99/kube-proxy/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:2,MemoryLimitInBytes:0,OomScoreAdj:-997,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector

/interceptors.go:74" id=301d8d89-ed2c-489b-b881-2faf52267ba1 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.928537653Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,Verbose:false,}" file="otel-collector/interceptors.go:62" id=8cbf19b6-7408-4928-aa5c-90534706717a name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.928729904Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:305290711d5443ffae9e64678e692b52bbffed39cc06b059026f167d97c5e98d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055283766281126,StartedAt:1723055283787898463,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip:v0.8.0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0f267a1609da84deb6a231872d87975b,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminati

onMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/0f267a1609da84deb6a231872d87975b/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/0f267a1609da84deb6a231872d87975b/containers/kube-vip/e3da8bde,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/kubernetes/admin.conf,HostPath:/etc/kubernetes/super-admin.conf,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_kube-vip-ha-198246_0f267a1609da84deb6a231872d87975b/kube-vip/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:2,MemoryLimitInBytes:0,OomScoreAdj

:1000,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=8cbf19b6-7408-4928-aa5c-90534706717a name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.929337771Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,Verbose:false,}" file="otel-collector/interceptors.go:62" id=9e9baea0-1c1b-4e52-9539-1a6f2fa2a837 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.929515922Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055280762879447,StartedAt:1723055280885877522,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/kube-apiserver:v1.30.3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b2b91906fc54e8232161e687fc4a9af5,},Annotations:map[string]string{io.kubernetes.container.hash: 4422576b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern

etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/b2b91906fc54e8232161e687fc4a9af5/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/b2b91906fc54e8232161e687fc4a9af5/containers/kube-apiserver/ce43c781,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/ssl/certs,HostPath:/etc/ssl/certs,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/usr/share/ca-certificates,HostPath:/usr/share/ca-certificates,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/lib/

minikube/certs,HostPath:/var/lib/minikube/certs,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_kube-apiserver-ha-198246_b2b91906fc54e8232161e687fc4a9af5/kube-apiserver/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:256,MemoryLimitInBytes:0,OomScoreAdj:-997,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=9e9baea0-1c1b-4e52-9539-1a6f2fa2a837 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.930009643Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,Verbose:false,}" file="otel-collector/interceptors.go:62" id=fde295d1-86f9-4300-a95c-34726ca522b7 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.930123955Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055280719113861,StartedAt:1723055280840567204,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/etcd:3.5.12-0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c60b0b92792ae1d5ba11a7a2e649f612,},Annotations:map[string]string{io.kubernetes.container.hash: 51cc6761,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy

: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/c60b0b92792ae1d5ba11a7a2e649f612/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/c60b0b92792ae1d5ba11a7a2e649f612/containers/etcd/a1ca489d,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/lib/minikube/etcd,HostPath:/var/lib/minikube/etcd,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/lib/minikube/certs/etcd,HostPath:/var/lib/minikube/certs/etcd,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_etcd-ha-198246_c60b0b

92792ae1d5ba11a7a2e649f612/etcd/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:102,MemoryLimitInBytes:0,OomScoreAdj:-997,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=fde295d1-86f9-4300-a95c-34726ca522b7 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.930939576Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,Verbose:false,}" file="otel-collector/interceptors.go:62" id=d7024c1e-88ab-4a81-b036-4684d66228b5 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.931063160Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055280692071621,StartedAt:1723055280853791837,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/kube-scheduler:v1.30.3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56b90546fb511b52cb0b98695e572bae,},Annotations:map[string]string{io.kubernetes.container.hash: 7337c8d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern

etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/56b90546fb511b52cb0b98695e572bae/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/56b90546fb511b52cb0b98695e572bae/containers/kube-scheduler/3d042067,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/kubernetes/scheduler.conf,HostPath:/etc/kubernetes/scheduler.conf,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_kube-scheduler-ha-198246_56b90546fb511b52cb0b98695e572bae/kube-scheduler/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,C

puShares:102,MemoryLimitInBytes:0,OomScoreAdj:-997,CpusetCpus:,CpusetMems:,HugepageLimits:[]*HugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=d7024c1e-88ab-4a81-b036-4684d66228b5 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.932138698Z" level=debug msg="Request: &ContainerStatusRequest{ContainerId:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,Verbose:false,}" file="otel-collector/interceptors.go:62" id=7cf47caf-5fe8-4381-b3e7-88a90f67c940 name=/runtime.v1.RuntimeService/ContainerStatus

	Aug 07 18:37:06 ha-198246 crio[680]: time="2024-08-07 18:37:06.932525483Z" level=debug msg="Response: &ContainerStatusResponse{Status:&ContainerStatus{Id:6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},State:CONTAINER_RUNNING,CreatedAt:1723055280608390721,StartedAt:1723055280725655787,FinishedAt:0,ExitCode:0,Image:&ImageSpec{Image:registry.k8s.io/kube-controller-manager:v1.30.3,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e,Reason:,Message:,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-198246,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b12d62604f0b70faa552e6c44d8cd532,},Annotations:map[string]string{io.kubernetes.container.hash: bcb4918f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage

Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},Mounts:[]*Mount{&Mount{ContainerPath:/etc/hosts,HostPath:/var/lib/kubelet/pods/b12d62604f0b70faa552e6c44d8cd532/etc-hosts,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/dev/termination-log,HostPath:/var/lib/kubelet/pods/b12d62604f0b70faa552e6c44d8cd532/containers/kube-controller-manager/942d5da7,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/ssl/certs,HostPath:/etc/ssl/certs,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/etc/kubernetes/controller-manager.conf,HostPath:/etc/kubernetes/controller-manager.conf,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*

IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/usr/share/ca-certificates,HostPath:/usr/share/ca-certificates,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/var/lib/minikube/certs,HostPath:/var/lib/minikube/certs,Readonly:true,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},&Mount{ContainerPath:/usr/libexec/kubernetes/kubelet-plugins/volume/exec,HostPath:/usr/libexec/kubernetes/kubelet-plugins/volume/exec,Readonly:false,SelinuxRelabel:false,Propagation:PROPAGATION_PRIVATE,UidMappings:[]*IDMapping{},GidMappings:[]*IDMapping{},},},LogPath:/var/log/pods/kube-system_kube-controller-manager-ha-198246_b12d62604f0b70faa552e6c44d8cd532/kube-controller-manager/0.log,Resources:&ContainerResources{Linux:&LinuxContainerResources{CpuPeriod:100000,CpuQuota:0,CpuShares:204,MemoryLimitInBytes:0,OomScoreAdj:-997,CpusetCpus:,CpusetMems:,HugepageLimits:[]*H

ugepageLimit{&HugepageLimit{PageSize:2MB,Limit:0,},},Unified:map[string]string{memory.oom.group: 1,memory.swap.max: 0,},MemorySwapLimitInBytes:0,},Windows:nil,},},Info:map[string]string{},}" file="otel-collector/interceptors.go:74" id=7cf47caf-5fe8-4381-b3e7-88a90f67c940 name=/runtime.v1.RuntimeService/ContainerStatus

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	80335e9819afd       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   5 minutes ago       Running             busybox                   0                   4d0990efdcee8       busybox-fc5497c4f-chh26

	806c3ba54cd9b       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      8 minutes ago       Running             coredns                   0                   a5394b2f1434b       coredns-7db6d8ff4d-w6w6g

	3f9784c457acb       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      8 minutes ago       Running             coredns                   0                   b57adade6ea15       coredns-7db6d8ff4d-rbnrx

	93fcff9b17b4b       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      8 minutes ago       Running             storage-provisioner       0                   885cc92388628       storage-provisioner

	5433090bdddca       docker.io/kindest/kindnetd@sha256:4067b91686869e19bac601aec305ba55d2e74cdcb91347869bfb4fd3a26cd3c3    8 minutes ago       Running             kindnet-cni               0                   bd5d340b4a584       kindnet-sgl8v

	c6c6220e1a7fb       55bb025d2cfa592b9381d01e122e72a1ed4b29ca32f86b7d289d99da794784d1                                      8 minutes ago       Running             kube-proxy                0                   4aec116af531d       kube-proxy-4l79v

	305290711d544       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     9 minutes ago       Running             kube-vip                  0                   c3113eff4cbea       kube-vip-ha-198246

	4902df4367b62       1f6d574d502f3b61c851b1bbd4ef2a964ce4c70071dd8da556f2d490d36b095d                                      9 minutes ago       Running             kube-apiserver            0                   1fcd84f97f1d1       kube-apiserver-ha-198246

	2ff4075c05c48       3edc18e7b76722eb2eb37a0858c09caacbd422d6e0cae4c2e5ce67bc9a9795e2                                      9 minutes ago       Running             kube-scheduler            0                   7c56ff7ba09a0       kube-scheduler-ha-198246

	981dfd0662596       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      9 minutes ago       Running             etcd                      0                   0e8285057cc05       etcd-ha-198246

	6c84edcc5a98f       76932a3b37d7eb138c8f47c9a2b4218f0466dd273badf856f2ce2f0277e15b5e                                      9 minutes ago       Running             kube-controller-manager   0                   30588dee2a435       kube-controller-manager-ha-198246

	==> coredns [3f9784c457acb6889b0277f9dfacd492961d6a50eb7dce9d4d142ab6269cbad7] <==

	[INFO] 10.244.1.2:60491 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000238403s

	[INFO] 10.244.1.2:56734 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000110021s

	[INFO] 10.244.0.4:60444 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000100154s

	[INFO] 10.244.0.4:54868 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00007045s

	[INFO] 10.244.0.4:55542 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001278843s

	[INFO] 10.244.0.4:41062 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000090569s

	[INFO] 10.244.0.4:45221 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000159605s

	[INFO] 10.244.0.4:52919 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00008416s

	[INFO] 10.244.2.2:57336 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001947478s

	[INFO] 10.244.2.2:58778 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000148421s

	[INFO] 10.244.2.2:40534 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000094901s

	[INFO] 10.244.2.2:34562 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001435891s

	[INFO] 10.244.2.2:40255 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000066647s

	[INFO] 10.244.2.2:33303 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000074642s

	[INFO] 10.244.2.2:54865 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000065816s

	[INFO] 10.244.1.2:56362 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135028s

	[INFO] 10.244.1.2:50486 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000103508s

	[INFO] 10.244.0.4:60915 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000079398s

	[INFO] 10.244.2.2:36331 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000189607s

	[INFO] 10.244.1.2:44020 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000226665s

	[INFO] 10.244.1.2:47459 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000129465s

	[INFO] 10.244.0.4:59992 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000059798s

	[INFO] 10.244.0.4:55811 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000139124s

	[INFO] 10.244.2.2:42718 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132316s

	[INFO] 10.244.2.2:34338 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000147334s

	==> coredns [806c3ba54cd9bb60d2b7a3f2bd270c1b24086847e2f6c457649efb77221d48ab] <==

	[INFO] 10.244.0.4:54342 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.000106253s

	[INFO] 10.244.2.2:37220 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.00009521s

	[INFO] 10.244.2.2:40447 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.001945707s

	[INFO] 10.244.2.2:46546 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.003736918s

	[INFO] 10.244.1.2:40239 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000121833s

	[INFO] 10.244.1.2:39185 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003274854s

	[INFO] 10.244.1.2:32995 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000301562s

	[INFO] 10.244.1.2:57764 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00324711s

	[INFO] 10.244.0.4:43175 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001969935s

	[INFO] 10.244.0.4:47947 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000090373s

	[INFO] 10.244.2.2:59435 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000185691s

	[INFO] 10.244.1.2:41342 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000215074s

	[INFO] 10.244.1.2:58323 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000133762s

	[INFO] 10.244.0.4:48395 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000131554s

	[INFO] 10.244.0.4:33157 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000121525s

	[INFO] 10.244.0.4:53506 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000084053s

	[INFO] 10.244.2.2:47826 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000205944s

	[INFO] 10.244.2.2:43418 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000113361s

	[INFO] 10.244.2.2:53197 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000103281s

	[INFO] 10.244.1.2:51874 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.0001263s

	[INFO] 10.244.1.2:40094 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000205313s

	[INFO] 10.244.0.4:55591 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.0001033s

	[INFO] 10.244.0.4:41281 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000083191s

	[INFO] 10.244.2.2:52214 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000093799s

	[INFO] 10.244.2.2:55578 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000146065s

	==> describe nodes <==

	Name:               ha-198246

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_07T18_28_07_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:28:04 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:37:06 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:03 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:03 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:03 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 07 Aug 2024 18:32:12 +0000   Wed, 07 Aug 2024 18:28:38 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.196

	  Hostname:    ha-198246

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 e31604902e0745d1a1407795d2ccbfc0

	  System UUID:                e3160490-2e07-45d1-a140-7795d2ccbfc0

	  Boot ID:                    9b0f1850-84af-432c-85c0-f24cda670347

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-chh26              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m12s

	  kube-system                 coredns-7db6d8ff4d-rbnrx             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     8m47s

	  kube-system                 coredns-7db6d8ff4d-w6w6g             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     8m47s

	  kube-system                 etcd-ha-198246                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         9m3s

	  kube-system                 kindnet-sgl8v                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      8m47s

	  kube-system                 kube-apiserver-ha-198246             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m1s

	  kube-system                 kube-controller-manager-ha-198246    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m1s

	  kube-system                 kube-proxy-4l79v                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m47s

	  kube-system                 kube-scheduler-ha-198246             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m1s

	  kube-system                 kube-vip-ha-198246                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m3s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m46s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 8m44s  kube-proxy       

	  Normal  Starting                 9m1s   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  9m1s   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  9m1s   kubelet          Node ha-198246 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    9m1s   kubelet          Node ha-198246 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     9m1s   kubelet          Node ha-198246 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           8m47s  node-controller  Node ha-198246 event: Registered Node ha-198246 in Controller

	  Normal  NodeReady                8m29s  kubelet          Node ha-198246 status is now: NodeReady

	  Normal  RegisteredNode           6m42s  node-controller  Node ha-198246 event: Registered Node ha-198246 in Controller

	  Normal  RegisteredNode           5m23s  node-controller  Node ha-198246 event: Registered Node ha-198246 in Controller

	Name:               ha-198246-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_07T18_30_10_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:30:07 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246-m02

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:33:31 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Wed, 07 Aug 2024 18:32:09 +0000   Wed, 07 Aug 2024 18:34:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.251

	  Hostname:    ha-198246-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 b8eadf45fa3a45c1ace8b37287f97c9d

	  System UUID:                b8eadf45-fa3a-45c1-ace8-b37287f97c9d

	  Boot ID:                    7900c294-c092-44a8-b18b-e0879a5b10ab

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-8g62d                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m12s

	  kube-system                 etcd-ha-198246-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m58s

	  kube-system                 kindnet-8x6fj                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      7m

	  kube-system                 kube-apiserver-ha-198246-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m58s

	  kube-system                 kube-controller-manager-ha-198246-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m54s

	  kube-system                 kube-proxy-m5ng2                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m

	  kube-system                 kube-scheduler-ha-198246-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m53s

	  kube-system                 kube-vip-ha-198246-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m55s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age              From             Message

	  ----    ------                   ----             ----             -------

	  Normal  Starting                 6m55s            kube-proxy       

	  Normal  NodeHasSufficientMemory  7m (x8 over 7m)  kubelet          Node ha-198246-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m (x8 over 7m)  kubelet          Node ha-198246-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     7m (x7 over 7m)  kubelet          Node ha-198246-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  7m               kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           6m57s            node-controller  Node ha-198246-m02 event: Registered Node ha-198246-m02 in Controller

	  Normal  RegisteredNode           6m42s            node-controller  Node ha-198246-m02 event: Registered Node ha-198246-m02 in Controller

	  Normal  RegisteredNode           5m23s            node-controller  Node ha-198246-m02 event: Registered Node ha-198246-m02 in Controller

	  Normal  NodeNotReady             2m53s            node-controller  Node ha-198246-m02 status is now: NodeNotReady

	Name:               ha-198246-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_07T18_31_30_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:31:26 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246-m03

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:37:03 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:26 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:26 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:26 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 07 Aug 2024 18:32:28 +0000   Wed, 07 Aug 2024 18:31:48 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.227

	  Hostname:    ha-198246-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 60409ac81f5346078f5f2d7599678540

	  System UUID:                60409ac8-1f53-4607-8f5f-2d7599678540

	  Boot ID:                    30ed0e62-43cd-4d25-85c3-6ffd341eb52a

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-k2t25                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m12s

	  kube-system                 etcd-ha-198246-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m39s

	  kube-system                 kindnet-7854s                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m41s

	  kube-system                 kube-apiserver-ha-198246-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m39s

	  kube-system                 kube-controller-manager-ha-198246-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m36s

	  kube-system                 kube-proxy-7mttr                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m41s

	  kube-system                 kube-scheduler-ha-198246-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m32s

	  kube-system                 kube-vip-ha-198246-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m36s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m35s                  kube-proxy       

	  Normal  NodeHasSufficientPID     5m41s (x7 over 5m41s)  kubelet          Node ha-198246-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5m41s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  5m40s (x8 over 5m41s)  kubelet          Node ha-198246-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m40s (x8 over 5m41s)  kubelet          Node ha-198246-m03 status is now: NodeHasNoDiskPressure

	  Normal  RegisteredNode           5m37s                  node-controller  Node ha-198246-m03 event: Registered Node ha-198246-m03 in Controller

	  Normal  RegisteredNode           5m37s                  node-controller  Node ha-198246-m03 event: Registered Node ha-198246-m03 in Controller

	  Normal  RegisteredNode           5m23s                  node-controller  Node ha-198246-m03 event: Registered Node ha-198246-m03 in Controller

	Name:               ha-198246-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-198246-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0ee3e7d60a6f6702c6c553e4aadfb0f66d72da6e

	                    minikube.k8s.io/name=ha-198246

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_08_07T18_32_32_0700

	                    minikube.k8s.io/version=v1.33.1

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 07 Aug 2024 18:32:32 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-198246-m04

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 07 Aug 2024 18:36:57 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:32:32 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:32:32 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:32:32 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 07 Aug 2024 18:33:21 +0000   Wed, 07 Aug 2024 18:33:21 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.150

	  Hostname:    ha-198246-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 e050b6016e8b45679acbdd2b5c7bde62

	  System UUID:                e050b601-6e8b-4567-9acb-dd2b5c7bde62

	  Boot ID:                    3b3e9caf-949c-417a-90da-edc98697cdac

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.3

	  Kube-Proxy Version:         v1.30.3

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-5vj44       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m35s

	  kube-system                 kube-proxy-5ggpl    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m31s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m25s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  4m35s (x2 over 4m35s)  kubelet          Node ha-198246-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m35s (x2 over 4m35s)  kubelet          Node ha-198246-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m35s (x2 over 4m35s)  kubelet          Node ha-198246-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m35s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m33s                  node-controller  Node ha-198246-m04 event: Registered Node ha-198246-m04 in Controller

	  Normal  RegisteredNode           4m32s                  node-controller  Node ha-198246-m04 event: Registered Node ha-198246-m04 in Controller

	  Normal  RegisteredNode           4m32s                  node-controller  Node ha-198246-m04 event: Registered Node ha-198246-m04 in Controller

	  Normal  NodeReady                3m46s                  kubelet          Node ha-198246-m04 status is now: NodeReady

	==> dmesg <==

	[Aug 7 18:27] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050670] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.040191] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.791892] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.561405] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.603000] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000015] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[ +12.529902] systemd-fstab-generator[597]: Ignoring "noauto" option for root device

	[  +0.057949] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.071605] systemd-fstab-generator[609]: Ignoring "noauto" option for root device

	[  +0.183672] systemd-fstab-generator[623]: Ignoring "noauto" option for root device

	[  +0.110780] systemd-fstab-generator[635]: Ignoring "noauto" option for root device

	[  +0.300871] systemd-fstab-generator[665]: Ignoring "noauto" option for root device

	[  +4.248154] systemd-fstab-generator[764]: Ignoring "noauto" option for root device

	[  +4.501138] systemd-fstab-generator[945]: Ignoring "noauto" option for root device

	[  +0.062750] kauditd_printk_skb: 158 callbacks suppressed

	[Aug 7 18:28] systemd-fstab-generator[1363]: Ignoring "noauto" option for root device

	[  +0.095778] kauditd_printk_skb: 79 callbacks suppressed

	[ +15.277376] kauditd_printk_skb: 21 callbacks suppressed

	[  +5.193932] kauditd_printk_skb: 29 callbacks suppressed

	[Aug 7 18:30] kauditd_printk_skb: 24 callbacks suppressed

	==> etcd [981dfd06625965585912df3c135439314180d555b7d7f22c591a94154b8d02a5] <==

	{"level":"warn","ts":"2024-08-07T18:37:07.140905Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.175974Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.210879Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.220863Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.228557Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.240811Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.247136Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.254918Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.261886Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.265798Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.270066Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.278786Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.285305Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.291403Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.295725Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.299108Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.308593Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.31484Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.321185Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.325061Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.328272Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.335201Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.340784Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.347114Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-08-07T18:37:07.354867Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"a14f9258d3b66c75","from":"a14f9258d3b66c75","remote-peer-id":"ae73097cbb5e3b7d","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 18:37:07 up 9 min,  0 users,  load average: 0.87, 0.43, 0.22

	Linux ha-198246 5.10.207 #1 SMP Mon Jul 29 15:19:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [5433090bdddca4fefcfdb1e493e17a16a53c52556c5c400971bc85490efbe554] <==

	I0807 18:36:28.091744       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	I0807 18:36:38.095310       1 main.go:295] Handling node with IPs: map[192.168.39.196:{}]

	I0807 18:36:38.095358       1 main.go:299] handling current node

	I0807 18:36:38.095378       1 main.go:295] Handling node with IPs: map[192.168.39.251:{}]

	I0807 18:36:38.095383       1 main.go:322] Node ha-198246-m02 has CIDR [10.244.1.0/24] 

	I0807 18:36:38.095613       1 main.go:295] Handling node with IPs: map[192.168.39.227:{}]

	I0807 18:36:38.095642       1 main.go:322] Node ha-198246-m03 has CIDR [10.244.2.0/24] 

	I0807 18:36:38.095699       1 main.go:295] Handling node with IPs: map[192.168.39.150:{}]

	I0807 18:36:38.095704       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	I0807 18:36:48.099667       1 main.go:295] Handling node with IPs: map[192.168.39.196:{}]

	I0807 18:36:48.099716       1 main.go:299] handling current node

	I0807 18:36:48.099730       1 main.go:295] Handling node with IPs: map[192.168.39.251:{}]

	I0807 18:36:48.099735       1 main.go:322] Node ha-198246-m02 has CIDR [10.244.1.0/24] 

	I0807 18:36:48.099887       1 main.go:295] Handling node with IPs: map[192.168.39.227:{}]

	I0807 18:36:48.099909       1 main.go:322] Node ha-198246-m03 has CIDR [10.244.2.0/24] 

	I0807 18:36:48.099960       1 main.go:295] Handling node with IPs: map[192.168.39.150:{}]

	I0807 18:36:48.099966       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	I0807 18:36:58.093506       1 main.go:295] Handling node with IPs: map[192.168.39.150:{}]

	I0807 18:36:58.093745       1 main.go:322] Node ha-198246-m04 has CIDR [10.244.3.0/24] 

	I0807 18:36:58.093935       1 main.go:295] Handling node with IPs: map[192.168.39.196:{}]

	I0807 18:36:58.093963       1 main.go:299] handling current node

	I0807 18:36:58.094004       1 main.go:295] Handling node with IPs: map[192.168.39.251:{}]

	I0807 18:36:58.094021       1 main.go:322] Node ha-198246-m02 has CIDR [10.244.1.0/24] 

	I0807 18:36:58.094139       1 main.go:295] Handling node with IPs: map[192.168.39.227:{}]

	I0807 18:36:58.094166       1 main.go:322] Node ha-198246-m03 has CIDR [10.244.2.0/24] 

	==> kube-apiserver [4902df4367b62015a5a5b09ee0190709490a8b746eca969190e50981691ce473] <==

	I0807 18:28:05.757651       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0807 18:28:05.765720       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.196]

	I0807 18:28:05.766882       1 controller.go:615] quota admission added evaluator for: endpoints

	I0807 18:28:05.772395       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0807 18:28:05.830060       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0807 18:28:06.776266       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0807 18:28:06.809546       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0807 18:28:06.821673       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0807 18:28:20.248559       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0807 18:28:20.348011       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	E0807 18:32:00.535866       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57744: use of closed network connection

	E0807 18:32:00.744066       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57766: use of closed network connection

	E0807 18:32:00.952672       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57792: use of closed network connection

	E0807 18:32:01.172355       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57812: use of closed network connection

	E0807 18:32:01.352150       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57828: use of closed network connection

	E0807 18:32:01.532194       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57846: use of closed network connection

	E0807 18:32:01.714325       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57860: use of closed network connection

	E0807 18:32:01.900647       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57872: use of closed network connection

	E0807 18:32:02.087553       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57896: use of closed network connection

	E0807 18:32:02.383817       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57920: use of closed network connection

	E0807 18:32:02.568053       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57936: use of closed network connection

	E0807 18:32:02.768857       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57942: use of closed network connection

	E0807 18:32:02.971250       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57960: use of closed network connection

	E0807 18:32:03.156171       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:57992: use of closed network connection

	E0807 18:32:03.335581       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58008: use of closed network connection

	==> kube-controller-manager [6c84edcc5a98f1ba6f54c818e3063b8d5804d1a9de0705cd8ac38826104fef36] <==

	I0807 18:31:30.326416       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-198246-m03"

	I0807 18:31:55.863780       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="90.509454ms"

	I0807 18:31:55.909903       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.038129ms"

	I0807 18:31:56.006853       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="96.823451ms"

	I0807 18:31:56.148782       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="141.712519ms"

	I0807 18:31:56.149891       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="322.281µs"

	I0807 18:31:56.191596       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="41.550452ms"

	I0807 18:31:56.191748       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="81.564µs"

	I0807 18:31:56.760379       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.592µs"

	I0807 18:31:56.902720       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="44.37µs"

	I0807 18:31:57.234083       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="85.456µs"

	I0807 18:31:59.698073       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="12.032139ms"

	I0807 18:31:59.698278       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.373µs"

	I0807 18:31:59.804042       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="40.215774ms"

	I0807 18:31:59.804158       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="66.476µs"

	I0807 18:32:00.080762       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="12.328982ms"

	I0807 18:32:00.082206       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="43.736µs"

	E0807 18:32:32.063101       1 certificate_controller.go:146] Sync csr-btqqk failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-btqqk": the object has been modified; please apply your changes to the latest version and try again

	I0807 18:32:32.310340       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-198246-m04\" does not exist"

	I0807 18:32:32.379172       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-198246-m04" podCIDRs=["10.244.3.0/24"]

	I0807 18:32:35.352861       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-198246-m04"

	I0807 18:33:21.056413       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-198246-m04"

	I0807 18:34:14.817275       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-198246-m04"

	I0807 18:34:14.871985       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="10.917944ms"

	I0807 18:34:14.873327       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="44.625µs"

	==> kube-proxy [c6c6220e1a7fbef5b46d57389b28bee4893fdbc5539c50d458ea957d20f1c8f8] <==

	I0807 18:28:22.580618       1 server_linux.go:69] "Using iptables proxy"

	I0807 18:28:22.601637       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.196"]

	I0807 18:28:22.654297       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0807 18:28:22.654381       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0807 18:28:22.654403       1 server_linux.go:165] "Using iptables Proxier"

	I0807 18:28:22.658197       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0807 18:28:22.658748       1 server.go:872] "Version info" version="v1.30.3"

	I0807 18:28:22.658783       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0807 18:28:22.661148       1 config.go:192] "Starting service config controller"

	I0807 18:28:22.661385       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0807 18:28:22.661502       1 config.go:101] "Starting endpoint slice config controller"

	I0807 18:28:22.661508       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0807 18:28:22.662750       1 config.go:319] "Starting node config controller"

	I0807 18:28:22.662780       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0807 18:28:22.761662       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0807 18:28:22.761768       1 shared_informer.go:320] Caches are synced for service config

	I0807 18:28:22.763105       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2ff4075c05c488ae3a7c359a71002929eccbca12733ebea95430cac76bd7ce56] <==

	E0807 18:28:05.163012       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0807 18:28:05.164577       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0807 18:28:05.164616       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0807 18:28:05.283884       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0807 18:28:05.283932       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0807 18:28:05.320413       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0807 18:28:05.320504       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0807 18:28:05.373610       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0807 18:28:05.373694       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	I0807 18:28:06.678552       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0807 18:32:32.502898       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-z8cdn\": pod kindnet-z8cdn is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-z8cdn" node="ha-198246-m04"

	E0807 18:32:32.503513       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod bc6ed049-d9fb-4132-b192-8015240cb919(kube-system/kindnet-z8cdn) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-z8cdn"

	E0807 18:32:32.503593       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-z8cdn\": pod kindnet-z8cdn is already assigned to node \"ha-198246-m04\"" pod="kube-system/kindnet-z8cdn"

	I0807 18:32:32.503644       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-z8cdn" node="ha-198246-m04"

	E0807 18:32:32.551938       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-cv65q\": pod kube-proxy-cv65q is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-cv65q" node="ha-198246-m04"

	E0807 18:32:32.553290       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-cv65q\": pod kube-proxy-cv65q is already assigned to node \"ha-198246-m04\"" pod="kube-system/kube-proxy-cv65q"

	E0807 18:32:32.556989       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-vndzm\": pod kindnet-vndzm is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-vndzm" node="ha-198246-m04"

	E0807 18:32:32.557081       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-vndzm\": pod kindnet-vndzm is already assigned to node \"ha-198246-m04\"" pod="kube-system/kindnet-vndzm"

	E0807 18:32:36.244172       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-5ggpl\": pod kube-proxy-5ggpl is already assigned to node \"ha-198246-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-5ggpl" node="ha-198246-m04"

	E0807 18:32:36.244315       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 2ed71e43-edd6-4262-a1ed-a3232e717574(kube-system/kube-proxy-5ggpl) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-5ggpl"

	E0807 18:32:36.244399       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-5ggpl\": pod kube-proxy-5ggpl is already assigned to node \"ha-198246-m04\"" pod="kube-system/kube-proxy-5ggpl"

	I0807 18:32:36.245064       1 schedule_one.go:1059] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-5ggpl" node="ha-198246-m04"

	E0807 18:32:36.281841       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-tdszb\": pod kube-proxy-tdszb is being deleted, cannot be assigned to a host" plugin="DefaultBinder" pod="kube-system/kube-proxy-tdszb" node="ha-198246-m04"

	E0807 18:32:36.281939       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-tdszb\": pod kube-proxy-tdszb is being deleted, cannot be assigned to a host" pod="kube-system/kube-proxy-tdszb"

	E0807 18:32:36.330630       1 schedule_one.go:1095] "Error updating pod" err="pods \"kube-proxy-tdszb\" not found" pod="kube-system/kube-proxy-tdszb"

	==> kubelet <==

	Aug 07 18:33:06 ha-198246 kubelet[1372]: E0807 18:33:06.768553    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:33:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:33:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:33:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:33:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:34:06 ha-198246 kubelet[1372]: E0807 18:34:06.758391    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:34:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:34:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:34:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:34:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:35:06 ha-198246 kubelet[1372]: E0807 18:35:06.757102    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:35:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:35:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:35:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:35:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:36:06 ha-198246 kubelet[1372]: E0807 18:36:06.757687    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:36:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:36:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:36:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:36:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 07 18:37:06 ha-198246 kubelet[1372]: E0807 18:37:06.772563    1372 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 07 18:37:06 ha-198246 kubelet[1372]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 07 18:37:06 ha-198246 kubelet[1372]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 07 18:37:06 ha-198246 kubelet[1372]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 07 18:37:06 ha-198246 kubelet[1372]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-198246 -n ha-198246

helpers_test.go:261: (dbg) Run:  kubectl --context ha-198246 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (61.28s)