=== RUN   TestAddons/Setup

addons_test.go:107: (dbg) Run:  out/minikube-linux-amd64 start -p addons-967811 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns

addons_test.go:107: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-967811 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns: signal: killed (39m59.957339687s)

-- stdout --

	* [addons-967811] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19734

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19734-3842/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19734-3842/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-967811" primary control-plane node in "addons-967811" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.7

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0

	  - Using image docker.io/registry:2.8.3

	  - Using image docker.io/busybox:stable

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image docker.io/marcnuri/yakd:0.0.5

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	* Verifying ingress addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-967811 service yakd-dashboard -n yakd-dashboard

	* Verifying registry addon...

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	* Verifying csi-hostpath-driver addon...

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-967811 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: ingress-dns, storage-provisioner, cloud-spanner, nvidia-device-plugin, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

-- /stdout --

** stderr ** 

	I0930 10:20:40.079545   11632 out.go:345] Setting OutFile to fd 1 ...

	I0930 10:20:40.079796   11632 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 10:20:40.079806   11632 out.go:358] Setting ErrFile to fd 2...

	I0930 10:20:40.079810   11632 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 10:20:40.080045   11632 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19734-3842/.minikube/bin

	I0930 10:20:40.080749   11632 out.go:352] Setting JSON to false

	I0930 10:20:40.081603   11632 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":187,"bootTime":1727691453,"procs":177,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0930 10:20:40.081721   11632 start.go:139] virtualization: kvm guest

	I0930 10:20:40.083856   11632 out.go:177] * [addons-967811] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	I0930 10:20:40.085416   11632 out.go:177]   - MINIKUBE_LOCATION=19734

	I0930 10:20:40.085425   11632 notify.go:220] Checking for updates...

	I0930 10:20:40.088075   11632 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0930 10:20:40.089731   11632 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 10:20:40.091103   11632 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 10:20:40.092587   11632 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0930 10:20:40.093980   11632 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0930 10:20:40.095523   11632 driver.go:394] Setting default libvirt URI to qemu:///system

	I0930 10:20:40.128709   11632 out.go:177] * Using the kvm2 driver based on user configuration

	I0930 10:20:40.129881   11632 start.go:297] selected driver: kvm2

	I0930 10:20:40.129895   11632 start.go:901] validating driver "kvm2" against <nil>

	I0930 10:20:40.129906   11632 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0930 10:20:40.130610   11632 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0930 10:20:40.130697   11632 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19734-3842/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0930 10:20:40.146270   11632 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0

	I0930 10:20:40.146318   11632 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0930 10:20:40.146618   11632 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 10:20:40.146653   11632 cni.go:84] Creating CNI manager for ""

	I0930 10:20:40.146703   11632 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0930 10:20:40.146716   11632 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0930 10:20:40.146781   11632 start.go:340] cluster config:

	{Name:addons-967811 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-967811 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 10:20:40.146911   11632 iso.go:125] acquiring lock: {Name:mk95ca253939a7801a8ba4db8c15a1a3ab4169e5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0930 10:20:40.149523   11632 out.go:177] * Starting "addons-967811" primary control-plane node in "addons-967811" cluster

	I0930 10:20:40.150804   11632 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 10:20:40.150837   11632 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4

	I0930 10:20:40.150845   11632 cache.go:56] Caching tarball of preloaded images

	I0930 10:20:40.150920   11632 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 10:20:40.150930   11632 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 10:20:40.151276   11632 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/config.json ...

	I0930 10:20:40.151300   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/config.json: {Name:mk9a5358e739b09678b40da22a30d5cbdefd7eed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:20:40.151443   11632 start.go:360] acquireMachinesLock for addons-967811: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 10:20:40.151490   11632 start.go:364] duration metric: took 34.78µs to acquireMachinesLock for "addons-967811"

	I0930 10:20:40.151506   11632 start.go:93] Provisioning new machine with config: &{Name:addons-967811 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.31.1 ClusterName:addons-967811 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 10:20:40.151567   11632 start.go:125] createHost starting for "" (driver="kvm2")

	I0930 10:20:40.153311   11632 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0930 10:20:40.153456   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:20:40.153498   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:20:40.168267   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32777

	I0930 10:20:40.168696   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:20:40.169221   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:20:40.169257   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:20:40.169595   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:20:40.169776   11632 main.go:141] libmachine: (addons-967811) Calling .GetMachineName

	I0930 10:20:40.169908   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:20:40.170095   11632 start.go:159] libmachine.API.Create for "addons-967811" (driver="kvm2")

	I0930 10:20:40.170123   11632 client.go:168] LocalClient.Create starting

	I0930 10:20:40.170189   11632 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 10:20:40.409110   11632 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 10:20:40.592683   11632 main.go:141] libmachine: Running pre-create checks...

	I0930 10:20:40.592709   11632 main.go:141] libmachine: (addons-967811) Calling .PreCreateCheck

	I0930 10:20:40.593236   11632 main.go:141] libmachine: (addons-967811) Calling .GetConfigRaw

	I0930 10:20:40.593692   11632 main.go:141] libmachine: Creating machine...

	I0930 10:20:40.593707   11632 main.go:141] libmachine: (addons-967811) Calling .Create

	I0930 10:20:40.593828   11632 main.go:141] libmachine: (addons-967811) Creating KVM machine...

	I0930 10:20:40.595132   11632 main.go:141] libmachine: (addons-967811) DBG | found existing default KVM network

	I0930 10:20:40.595868   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:40.595710   11654 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000123a60}

	I0930 10:20:40.595893   11632 main.go:141] libmachine: (addons-967811) DBG | created network xml: 

	I0930 10:20:40.595906   11632 main.go:141] libmachine: (addons-967811) DBG | <network>

	I0930 10:20:40.595915   11632 main.go:141] libmachine: (addons-967811) DBG |   <name>mk-addons-967811</name>

	I0930 10:20:40.595925   11632 main.go:141] libmachine: (addons-967811) DBG |   <dns enable='no'/>

	I0930 10:20:40.595932   11632 main.go:141] libmachine: (addons-967811) DBG |   

	I0930 10:20:40.595943   11632 main.go:141] libmachine: (addons-967811) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0930 10:20:40.595952   11632 main.go:141] libmachine: (addons-967811) DBG |     <dhcp>

	I0930 10:20:40.595961   11632 main.go:141] libmachine: (addons-967811) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0930 10:20:40.595970   11632 main.go:141] libmachine: (addons-967811) DBG |     </dhcp>

	I0930 10:20:40.595977   11632 main.go:141] libmachine: (addons-967811) DBG |   </ip>

	I0930 10:20:40.595988   11632 main.go:141] libmachine: (addons-967811) DBG |   

	I0930 10:20:40.595996   11632 main.go:141] libmachine: (addons-967811) DBG | </network>

	I0930 10:20:40.596003   11632 main.go:141] libmachine: (addons-967811) DBG | 

	I0930 10:20:40.601752   11632 main.go:141] libmachine: (addons-967811) DBG | trying to create private KVM network mk-addons-967811 192.168.39.0/24...

	I0930 10:20:40.670542   11632 main.go:141] libmachine: (addons-967811) DBG | private KVM network mk-addons-967811 192.168.39.0/24 created

	I0930 10:20:40.670575   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:40.670483   11654 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 10:20:40.670587   11632 main.go:141] libmachine: (addons-967811) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811 ...

	I0930 10:20:40.670604   11632 main.go:141] libmachine: (addons-967811) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 10:20:40.670620   11632 main.go:141] libmachine: (addons-967811) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 10:20:40.925931   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:40.925806   11654 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa...

	I0930 10:20:41.015559   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:41.015412   11654 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/addons-967811.rawdisk...

	I0930 10:20:41.015582   11632 main.go:141] libmachine: (addons-967811) DBG | Writing magic tar header

	I0930 10:20:41.015591   11632 main.go:141] libmachine: (addons-967811) DBG | Writing SSH key tar header

	I0930 10:20:41.015598   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:41.015532   11654 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811 ...

	I0930 10:20:41.015610   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811

	I0930 10:20:41.015623   11632 main.go:141] libmachine: (addons-967811) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811 (perms=drwx------)

	I0930 10:20:41.015662   11632 main.go:141] libmachine: (addons-967811) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 10:20:41.015673   11632 main.go:141] libmachine: (addons-967811) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 10:20:41.015699   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 10:20:41.015721   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 10:20:41.015732   11632 main.go:141] libmachine: (addons-967811) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 10:20:41.015747   11632 main.go:141] libmachine: (addons-967811) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 10:20:41.015758   11632 main.go:141] libmachine: (addons-967811) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 10:20:41.015773   11632 main.go:141] libmachine: (addons-967811) Creating domain...

	I0930 10:20:41.015783   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 10:20:41.015788   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 10:20:41.015838   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home/jenkins

	I0930 10:20:41.015870   11632 main.go:141] libmachine: (addons-967811) DBG | Checking permissions on dir: /home

	I0930 10:20:41.015892   11632 main.go:141] libmachine: (addons-967811) DBG | Skipping /home - not owner

	I0930 10:20:41.016895   11632 main.go:141] libmachine: (addons-967811) define libvirt domain using xml: 

	I0930 10:20:41.016926   11632 main.go:141] libmachine: (addons-967811) <domain type='kvm'>

	I0930 10:20:41.016947   11632 main.go:141] libmachine: (addons-967811)   <name>addons-967811</name>

	I0930 10:20:41.016963   11632 main.go:141] libmachine: (addons-967811)   <memory unit='MiB'>4000</memory>

	I0930 10:20:41.016972   11632 main.go:141] libmachine: (addons-967811)   <vcpu>2</vcpu>

	I0930 10:20:41.016977   11632 main.go:141] libmachine: (addons-967811)   <features>

	I0930 10:20:41.016983   11632 main.go:141] libmachine: (addons-967811)     <acpi/>

	I0930 10:20:41.016988   11632 main.go:141] libmachine: (addons-967811)     <apic/>

	I0930 10:20:41.016995   11632 main.go:141] libmachine: (addons-967811)     <pae/>

	I0930 10:20:41.017000   11632 main.go:141] libmachine: (addons-967811)     

	I0930 10:20:41.017007   11632 main.go:141] libmachine: (addons-967811)   </features>

	I0930 10:20:41.017019   11632 main.go:141] libmachine: (addons-967811)   <cpu mode='host-passthrough'>

	I0930 10:20:41.017032   11632 main.go:141] libmachine: (addons-967811)   

	I0930 10:20:41.017046   11632 main.go:141] libmachine: (addons-967811)   </cpu>

	I0930 10:20:41.017067   11632 main.go:141] libmachine: (addons-967811)   <os>

	I0930 10:20:41.017081   11632 main.go:141] libmachine: (addons-967811)     <type>hvm</type>

	I0930 10:20:41.017093   11632 main.go:141] libmachine: (addons-967811)     <boot dev='cdrom'/>

	I0930 10:20:41.017103   11632 main.go:141] libmachine: (addons-967811)     <boot dev='hd'/>

	I0930 10:20:41.017116   11632 main.go:141] libmachine: (addons-967811)     <bootmenu enable='no'/>

	I0930 10:20:41.017125   11632 main.go:141] libmachine: (addons-967811)   </os>

	I0930 10:20:41.017134   11632 main.go:141] libmachine: (addons-967811)   <devices>

	I0930 10:20:41.017145   11632 main.go:141] libmachine: (addons-967811)     <disk type='file' device='cdrom'>

	I0930 10:20:41.017163   11632 main.go:141] libmachine: (addons-967811)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/boot2docker.iso'/>

	I0930 10:20:41.017178   11632 main.go:141] libmachine: (addons-967811)       <target dev='hdc' bus='scsi'/>

	I0930 10:20:41.017188   11632 main.go:141] libmachine: (addons-967811)       <readonly/>

	I0930 10:20:41.017198   11632 main.go:141] libmachine: (addons-967811)     </disk>

	I0930 10:20:41.017209   11632 main.go:141] libmachine: (addons-967811)     <disk type='file' device='disk'>

	I0930 10:20:41.017222   11632 main.go:141] libmachine: (addons-967811)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 10:20:41.017236   11632 main.go:141] libmachine: (addons-967811)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/addons-967811.rawdisk'/>

	I0930 10:20:41.017252   11632 main.go:141] libmachine: (addons-967811)       <target dev='hda' bus='virtio'/>

	I0930 10:20:41.017268   11632 main.go:141] libmachine: (addons-967811)     </disk>

	I0930 10:20:41.017278   11632 main.go:141] libmachine: (addons-967811)     <interface type='network'>

	I0930 10:20:41.017289   11632 main.go:141] libmachine: (addons-967811)       <source network='mk-addons-967811'/>

	I0930 10:20:41.017303   11632 main.go:141] libmachine: (addons-967811)       <model type='virtio'/>

	I0930 10:20:41.017315   11632 main.go:141] libmachine: (addons-967811)     </interface>

	I0930 10:20:41.017327   11632 main.go:141] libmachine: (addons-967811)     <interface type='network'>

	I0930 10:20:41.017339   11632 main.go:141] libmachine: (addons-967811)       <source network='default'/>

	I0930 10:20:41.017353   11632 main.go:141] libmachine: (addons-967811)       <model type='virtio'/>

	I0930 10:20:41.017369   11632 main.go:141] libmachine: (addons-967811)     </interface>

	I0930 10:20:41.017382   11632 main.go:141] libmachine: (addons-967811)     <serial type='pty'>

	I0930 10:20:41.017392   11632 main.go:141] libmachine: (addons-967811)       <target port='0'/>

	I0930 10:20:41.017405   11632 main.go:141] libmachine: (addons-967811)     </serial>

	I0930 10:20:41.017418   11632 main.go:141] libmachine: (addons-967811)     <console type='pty'>

	I0930 10:20:41.017432   11632 main.go:141] libmachine: (addons-967811)       <target type='serial' port='0'/>

	I0930 10:20:41.017449   11632 main.go:141] libmachine: (addons-967811)     </console>

	I0930 10:20:41.017463   11632 main.go:141] libmachine: (addons-967811)     <rng model='virtio'>

	I0930 10:20:41.017477   11632 main.go:141] libmachine: (addons-967811)       <backend model='random'>/dev/random</backend>

	I0930 10:20:41.017489   11632 main.go:141] libmachine: (addons-967811)     </rng>

	I0930 10:20:41.017501   11632 main.go:141] libmachine: (addons-967811)     

	I0930 10:20:41.017525   11632 main.go:141] libmachine: (addons-967811)     

	I0930 10:20:41.017540   11632 main.go:141] libmachine: (addons-967811)   </devices>

	I0930 10:20:41.017547   11632 main.go:141] libmachine: (addons-967811) </domain>

	I0930 10:20:41.017556   11632 main.go:141] libmachine: (addons-967811) 

	I0930 10:20:41.024148   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:20:5c:f7 in network default

	I0930 10:20:41.024786   11632 main.go:141] libmachine: (addons-967811) Ensuring networks are active...

	I0930 10:20:41.024814   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:41.025647   11632 main.go:141] libmachine: (addons-967811) Ensuring network default is active

	I0930 10:20:41.026007   11632 main.go:141] libmachine: (addons-967811) Ensuring network mk-addons-967811 is active

	I0930 10:20:41.026614   11632 main.go:141] libmachine: (addons-967811) Getting domain xml...

	I0930 10:20:41.027304   11632 main.go:141] libmachine: (addons-967811) Creating domain...

	I0930 10:20:42.439766   11632 main.go:141] libmachine: (addons-967811) Waiting to get IP...

	I0930 10:20:42.440533   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:42.440913   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:42.440962   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:42.440909   11654 retry.go:31] will retry after 294.78404ms: waiting for machine to come up

	I0930 10:20:42.737732   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:42.738221   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:42.738256   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:42.738186   11654 retry.go:31] will retry after 320.437189ms: waiting for machine to come up

	I0930 10:20:43.060831   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:43.061356   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:43.061392   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:43.061308   11654 retry.go:31] will retry after 340.678326ms: waiting for machine to come up

	I0930 10:20:43.403927   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:43.404334   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:43.404359   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:43.404277   11654 retry.go:31] will retry after 556.110406ms: waiting for machine to come up

	I0930 10:20:43.961937   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:43.962360   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:43.962387   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:43.962314   11654 retry.go:31] will retry after 530.221466ms: waiting for machine to come up

	I0930 10:20:44.494047   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:44.494511   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:44.494539   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:44.494460   11654 retry.go:31] will retry after 795.399219ms: waiting for machine to come up

	I0930 10:20:45.291946   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:45.292370   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:45.292394   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:45.292319   11654 retry.go:31] will retry after 1.087630156s: waiting for machine to come up

	I0930 10:20:46.381493   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:46.381910   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:46.381945   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:46.381844   11654 retry.go:31] will retry after 902.510743ms: waiting for machine to come up

	I0930 10:20:47.285917   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:47.286402   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:47.286430   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:47.286353   11654 retry.go:31] will retry after 1.46739997s: waiting for machine to come up

	I0930 10:20:48.755934   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:48.756259   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:48.756316   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:48.756247   11654 retry.go:31] will retry after 1.879822988s: waiting for machine to come up

	I0930 10:20:50.637407   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:50.637831   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:50.637856   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:50.637784   11654 retry.go:31] will retry after 2.514951556s: waiting for machine to come up

	I0930 10:20:53.155581   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:53.156050   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:53.156075   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:53.156003   11654 retry.go:31] will retry after 3.153270284s: waiting for machine to come up

	I0930 10:20:56.310735   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:20:56.311132   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:20:56.311156   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:20:56.311098   11654 retry.go:31] will retry after 3.721986913s: waiting for machine to come up

	I0930 10:21:00.036922   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:00.037245   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find current IP address of domain addons-967811 in network mk-addons-967811

	I0930 10:21:00.037262   11632 main.go:141] libmachine: (addons-967811) DBG | I0930 10:21:00.037235   11654 retry.go:31] will retry after 4.098436748s: waiting for machine to come up

	I0930 10:21:04.136905   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:04.137303   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has current primary IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:04.137332   11632 main.go:141] libmachine: (addons-967811) Found IP for machine: 192.168.39.187

	I0930 10:21:04.137347   11632 main.go:141] libmachine: (addons-967811) Reserving static IP address...

	I0930 10:21:04.137725   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find host DHCP lease matching {name: "addons-967811", mac: "52:54:00:88:3e:c1", ip: "192.168.39.187"} in network mk-addons-967811

	I0930 10:21:04.211300   11632 main.go:141] libmachine: (addons-967811) DBG | Getting to WaitForSSH function...

	I0930 10:21:04.211327   11632 main.go:141] libmachine: (addons-967811) Reserved static IP address: 192.168.39.187

	I0930 10:21:04.211341   11632 main.go:141] libmachine: (addons-967811) Waiting for SSH to be available...

	I0930 10:21:04.213679   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:04.213967   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811

	I0930 10:21:04.213994   11632 main.go:141] libmachine: (addons-967811) DBG | unable to find defined IP address of network mk-addons-967811 interface with MAC address 52:54:00:88:3e:c1

	I0930 10:21:04.214155   11632 main.go:141] libmachine: (addons-967811) DBG | Using SSH client type: external

	I0930 10:21:04.214184   11632 main.go:141] libmachine: (addons-967811) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa (-rw-------)

	I0930 10:21:04.214215   11632 main.go:141] libmachine: (addons-967811) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 10:21:04.214230   11632 main.go:141] libmachine: (addons-967811) DBG | About to run SSH command:

	I0930 10:21:04.214243   11632 main.go:141] libmachine: (addons-967811) DBG | exit 0

	I0930 10:21:04.225877   11632 main.go:141] libmachine: (addons-967811) DBG | SSH cmd err, output: exit status 255: 

	I0930 10:21:04.225904   11632 main.go:141] libmachine: (addons-967811) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0930 10:21:04.225911   11632 main.go:141] libmachine: (addons-967811) DBG | command : exit 0

	I0930 10:21:04.225915   11632 main.go:141] libmachine: (addons-967811) DBG | err     : exit status 255

	I0930 10:21:04.225962   11632 main.go:141] libmachine: (addons-967811) DBG | output  : 

	I0930 10:21:07.227608   11632 main.go:141] libmachine: (addons-967811) DBG | Getting to WaitForSSH function...

	I0930 10:21:07.230047   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.230479   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.230504   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.230598   11632 main.go:141] libmachine: (addons-967811) DBG | Using SSH client type: external

	I0930 10:21:07.230625   11632 main.go:141] libmachine: (addons-967811) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa (-rw-------)

	I0930 10:21:07.230664   11632 main.go:141] libmachine: (addons-967811) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.187 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 10:21:07.230678   11632 main.go:141] libmachine: (addons-967811) DBG | About to run SSH command:

	I0930 10:21:07.230688   11632 main.go:141] libmachine: (addons-967811) DBG | exit 0

	I0930 10:21:07.357696   11632 main.go:141] libmachine: (addons-967811) DBG | SSH cmd err, output: <nil>: 

	I0930 10:21:07.357962   11632 main.go:141] libmachine: (addons-967811) KVM machine creation complete!

	I0930 10:21:07.358265   11632 main.go:141] libmachine: (addons-967811) Calling .GetConfigRaw

	I0930 10:21:07.417262   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:07.417597   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:07.417827   11632 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 10:21:07.417846   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:07.419212   11632 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 10:21:07.419226   11632 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 10:21:07.419233   11632 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 10:21:07.419246   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:07.421451   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.421842   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.421867   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.421963   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:07.422137   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.422321   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.422443   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:07.422594   11632 main.go:141] libmachine: Using SSH client type: native

	I0930 10:21:07.422814   11632 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0930 10:21:07.422830   11632 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 10:21:07.537189   11632 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 10:21:07.537218   11632 main.go:141] libmachine: Detecting the provisioner...

	I0930 10:21:07.537227   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:07.540254   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.540658   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.540679   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.540856   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:07.541070   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.541227   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.541525   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:07.541694   11632 main.go:141] libmachine: Using SSH client type: native

	I0930 10:21:07.541857   11632 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0930 10:21:07.541868   11632 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 10:21:07.654732   11632 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 10:21:07.654784   11632 main.go:141] libmachine: found compatible host: buildroot

	I0930 10:21:07.654795   11632 main.go:141] libmachine: Provisioning with buildroot...

	I0930 10:21:07.654807   11632 main.go:141] libmachine: (addons-967811) Calling .GetMachineName

	I0930 10:21:07.655076   11632 buildroot.go:166] provisioning hostname "addons-967811"

	I0930 10:21:07.655109   11632 main.go:141] libmachine: (addons-967811) Calling .GetMachineName

	I0930 10:21:07.655323   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:07.658038   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.658503   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.658527   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.658829   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:07.659029   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.659186   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.659336   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:07.659518   11632 main.go:141] libmachine: Using SSH client type: native

	I0930 10:21:07.659691   11632 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0930 10:21:07.659702   11632 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-967811 && echo "addons-967811" | sudo tee /etc/hostname

	I0930 10:21:07.788328   11632 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-967811

	I0930 10:21:07.788362   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:07.791060   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.791341   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.791368   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.791522   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:07.791711   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.791884   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:07.792004   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:07.792160   11632 main.go:141] libmachine: Using SSH client type: native

	I0930 10:21:07.792362   11632 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0930 10:21:07.792386   11632 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-967811' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-967811/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-967811' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 10:21:07.914571   11632 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 10:21:07.914595   11632 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 10:21:07.914634   11632 buildroot.go:174] setting up certificates

	I0930 10:21:07.914645   11632 provision.go:84] configureAuth start

	I0930 10:21:07.914656   11632 main.go:141] libmachine: (addons-967811) Calling .GetMachineName

	I0930 10:21:07.914928   11632 main.go:141] libmachine: (addons-967811) Calling .GetIP

	I0930 10:21:07.917456   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.917859   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.917889   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.918074   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:07.920073   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.920355   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:07.920373   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:07.920525   11632 provision.go:143] copyHostCerts

	I0930 10:21:07.920608   11632 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 10:21:07.920737   11632 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 10:21:07.920810   11632 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 10:21:07.920873   11632 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.addons-967811 san=[127.0.0.1 192.168.39.187 addons-967811 localhost minikube]

	I0930 10:21:08.381898   11632 provision.go:177] copyRemoteCerts

	I0930 10:21:08.381956   11632 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 10:21:08.381979   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:08.384594   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.384865   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:08.384890   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.385046   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:08.385250   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:08.385409   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:08.385527   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:08.472644   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 10:21:08.501395   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0930 10:21:08.526816   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0930 10:21:08.551880   11632 provision.go:87] duration metric: took 637.220629ms to configureAuth

	I0930 10:21:08.551907   11632 buildroot.go:189] setting minikube options for container-runtime

	I0930 10:21:08.552081   11632 config.go:182] Loaded profile config "addons-967811": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 10:21:08.552164   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:08.554843   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.555261   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:08.555293   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.555476   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:08.555676   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:08.555851   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:08.555969   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:08.556094   11632 main.go:141] libmachine: Using SSH client type: native

	I0930 10:21:08.556293   11632 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0930 10:21:08.556310   11632 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 10:21:08.794660   11632 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 10:21:08.794693   11632 main.go:141] libmachine: Checking connection to Docker...

	I0930 10:21:08.794711   11632 main.go:141] libmachine: (addons-967811) Calling .GetURL

	I0930 10:21:08.795973   11632 main.go:141] libmachine: (addons-967811) DBG | Using libvirt version 6000000

	I0930 10:21:08.797813   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.798078   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:08.798097   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.798295   11632 main.go:141] libmachine: Docker is up and running!

	I0930 10:21:08.798307   11632 main.go:141] libmachine: Reticulating splines...

	I0930 10:21:08.798314   11632 client.go:171] duration metric: took 28.628181974s to LocalClient.Create

	I0930 10:21:08.798334   11632 start.go:167] duration metric: took 28.628241015s to libmachine.API.Create "addons-967811"

	I0930 10:21:08.798344   11632 start.go:293] postStartSetup for "addons-967811" (driver="kvm2")

	I0930 10:21:08.798353   11632 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 10:21:08.798371   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:08.798604   11632 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 10:21:08.798624   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:08.800730   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.801003   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:08.801029   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.801123   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:08.801289   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:08.801431   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:08.801553   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:08.888436   11632 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 10:21:08.892990   11632 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 10:21:08.893018   11632 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 10:21:08.893104   11632 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 10:21:08.893129   11632 start.go:296] duration metric: took 94.780234ms for postStartSetup

	I0930 10:21:08.893160   11632 main.go:141] libmachine: (addons-967811) Calling .GetConfigRaw

	I0930 10:21:08.893750   11632 main.go:141] libmachine: (addons-967811) Calling .GetIP

	I0930 10:21:08.896395   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.896732   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:08.896764   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.896980   11632 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/config.json ...

	I0930 10:21:08.897226   11632 start.go:128] duration metric: took 28.745647105s to createHost

	I0930 10:21:08.897260   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:08.899269   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.899531   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:08.899558   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:08.899725   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:08.899909   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:08.900049   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:08.900178   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:08.900312   11632 main.go:141] libmachine: Using SSH client type: native

	I0930 10:21:08.900494   11632 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0930 10:21:08.900509   11632 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 10:21:09.018595   11632 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727691668.998338562

	I0930 10:21:09.018624   11632 fix.go:216] guest clock: 1727691668.998338562

	I0930 10:21:09.018646   11632 fix.go:229] Guest: 2024-09-30 10:21:08.998338562 +0000 UTC Remote: 2024-09-30 10:21:08.89724295 +0000 UTC m=+28.852948906 (delta=101.095612ms)

	I0930 10:21:09.018675   11632 fix.go:200] guest clock delta is within tolerance: 101.095612ms

	I0930 10:21:09.018681   11632 start.go:83] releasing machines lock for "addons-967811", held for 28.867181712s

	I0930 10:21:09.018700   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:09.018907   11632 main.go:141] libmachine: (addons-967811) Calling .GetIP

	I0930 10:21:09.021306   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:09.021561   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:09.021586   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:09.021810   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:09.022272   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:09.022430   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:09.022526   11632 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 10:21:09.022572   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:09.022614   11632 ssh_runner.go:195] Run: cat /version.json

	I0930 10:21:09.022644   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:09.025215   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:09.025418   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:09.025538   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:09.025568   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:09.025647   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:09.025921   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:09.025951   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:09.025956   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:09.026062   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:09.026143   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:09.026207   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:09.026262   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:09.026304   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:09.026430   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:09.106997   11632 ssh_runner.go:195] Run: systemctl --version

	I0930 10:21:09.140330   11632 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 10:21:09.299874   11632 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 10:21:09.306072   11632 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 10:21:09.306133   11632 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 10:21:09.322956   11632 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 10:21:09.322983   11632 start.go:495] detecting cgroup driver to use...

	I0930 10:21:09.323040   11632 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 10:21:09.339841   11632 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 10:21:09.354899   11632 docker.go:217] disabling cri-docker service (if available) ...

	I0930 10:21:09.354955   11632 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 10:21:09.370161   11632 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 10:21:09.384725   11632 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 10:21:09.500751   11632 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 10:21:09.663360   11632 docker.go:233] disabling docker service ...

	I0930 10:21:09.663419   11632 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 10:21:09.678384   11632 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 10:21:09.691938   11632 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 10:21:09.811109   11632 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 10:21:09.931948   11632 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 10:21:09.946254   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 10:21:09.966290   11632 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 10:21:09.966359   11632 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:09.977323   11632 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 10:21:09.977392   11632 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:09.988743   11632 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:09.999882   11632 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:10.011528   11632 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 10:21:10.023297   11632 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:10.034967   11632 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:10.053328   11632 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 10:21:10.064992   11632 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 10:21:10.075433   11632 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 10:21:10.075487   11632 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 10:21:10.089435   11632 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 10:21:10.099832   11632 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 10:21:10.225686   11632 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 10:21:10.317027   11632 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 10:21:10.317122   11632 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 10:21:10.322129   11632 start.go:563] Will wait 60s for crictl version

	I0930 10:21:10.322219   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:21:10.326023   11632 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 10:21:10.370638   11632 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 10:21:10.370766   11632 ssh_runner.go:195] Run: crio --version

	I0930 10:21:10.399311   11632 ssh_runner.go:195] Run: crio --version

	I0930 10:21:10.430559   11632 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 10:21:10.432220   11632 main.go:141] libmachine: (addons-967811) Calling .GetIP

	I0930 10:21:10.434877   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:10.435197   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:10.435222   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:10.435415   11632 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 10:21:10.439750   11632 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 10:21:10.452887   11632 kubeadm.go:883] updating cluster {Name:addons-967811 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.

1 ClusterName:addons-967811 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.187 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT

ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0930 10:21:10.453006   11632 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 10:21:10.453064   11632 ssh_runner.go:195] Run: sudo crictl images --output json

	I0930 10:21:10.486910   11632 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.31.1". assuming images are not preloaded.

	I0930 10:21:10.486992   11632 ssh_runner.go:195] Run: which lz4

	I0930 10:21:10.491411   11632 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0930 10:21:10.495746   11632 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0930 10:21:10.495782   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (388599353 bytes)

	I0930 10:21:11.819457   11632 crio.go:462] duration metric: took 1.328096969s to copy over tarball

	I0930 10:21:11.819526   11632 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0930 10:21:14.006728   11632 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.187171474s)

	I0930 10:21:14.006757   11632 crio.go:469] duration metric: took 2.187267959s to extract the tarball

	I0930 10:21:14.006764   11632 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0930 10:21:14.043737   11632 ssh_runner.go:195] Run: sudo crictl images --output json

	I0930 10:21:14.085580   11632 crio.go:514] all images are preloaded for cri-o runtime.

	I0930 10:21:14.085603   11632 cache_images.go:84] Images are preloaded, skipping loading

	I0930 10:21:14.085611   11632 kubeadm.go:934] updating node { 192.168.39.187 8443 v1.31.1 crio true true} ...

	I0930 10:21:14.085748   11632 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-967811 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.187

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:addons-967811 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 10:21:14.085830   11632 ssh_runner.go:195] Run: crio config

	I0930 10:21:14.133123   11632 cni.go:84] Creating CNI manager for ""

	I0930 10:21:14.133147   11632 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0930 10:21:14.133156   11632 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0930 10:21:14.133178   11632 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.187 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-967811 NodeName:addons-967811 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.187"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.187 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k

ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0930 10:21:14.133297   11632 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.187

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-967811"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.187

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.187"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0930 10:21:14.133355   11632 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 10:21:14.144263   11632 binaries.go:44] Found k8s binaries, skipping transfer

	I0930 10:21:14.144348   11632 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0930 10:21:14.154978   11632 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0930 10:21:14.173551   11632 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 10:21:14.192378   11632 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2157 bytes)

	I0930 10:21:14.211226   11632 ssh_runner.go:195] Run: grep 192.168.39.187	control-plane.minikube.internal$ /etc/hosts

	I0930 10:21:14.215473   11632 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.187	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 10:21:14.229041   11632 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 10:21:14.352167   11632 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 10:21:14.369826   11632 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811 for IP: 192.168.39.187

	I0930 10:21:14.369859   11632 certs.go:194] generating shared ca certs ...

	I0930 10:21:14.369877   11632 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.370046   11632 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 10:21:14.528308   11632 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt ...

	I0930 10:21:14.528344   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt: {Name:mk44a50e652a1245861ea4950acea8a23a35cf9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.528532   11632 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key ...

	I0930 10:21:14.528546   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key: {Name:mkb83db502c4782e88e88fa168a3231d3f126793 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.528626   11632 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 10:21:14.668875   11632 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt ...

	I0930 10:21:14.668910   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt: {Name:mk517b4f33399160d5c1d89d4b2dd5e1dc8041ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.669121   11632 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key ...

	I0930 10:21:14.669134   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key: {Name:mk3943d6a7f23f4a5debbf19ad74f01de28c1346 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.669217   11632 certs.go:256] generating profile certs ...

	I0930 10:21:14.669273   11632 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/client.key

	I0930 10:21:14.669294   11632 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/client.crt with IP's: []

	I0930 10:21:14.822142   11632 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/client.crt ...

	I0930 10:21:14.822185   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/client.crt: {Name:mk91bbf9c42708db8da5dd9bc6a362ed64d4807b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.822366   11632 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/client.key ...

	I0930 10:21:14.822378   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/client.key: {Name:mkc97f6d3362cd6804089821d284a5041e96a067 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.822452   11632 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.key.b82f8186

	I0930 10:21:14.822472   11632 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.crt.b82f8186 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.187]

	I0930 10:21:14.977608   11632 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.crt.b82f8186 ...

	I0930 10:21:14.977652   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.crt.b82f8186: {Name:mk0755b930293a7f9c05b07e593d13091f121c48 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.977816   11632 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.key.b82f8186 ...

	I0930 10:21:14.977828   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.key.b82f8186: {Name:mk8d055b9dc277a7b97e6c5eb9c8d9c4fa1efe89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:14.977901   11632 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.crt.b82f8186 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.crt

	I0930 10:21:14.977977   11632 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.key.b82f8186 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.key

	I0930 10:21:14.978023   11632 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.key

	I0930 10:21:14.978040   11632 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.crt with IP's: []

	I0930 10:21:15.139150   11632 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.crt ...

	I0930 10:21:15.139181   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.crt: {Name:mk4286d3c87444bc173add484b26fc04cb8b0936 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:15.139370   11632 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.key ...

	I0930 10:21:15.139384   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.key: {Name:mk5e6c6da8057389dbef42522389f4480a6ed9fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:15.139581   11632 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 10:21:15.139614   11632 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 10:21:15.139636   11632 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 10:21:15.139657   11632 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 10:21:15.140195   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 10:21:15.172133   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 10:21:15.202562   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 10:21:15.227270   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 10:21:15.252985   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0930 10:21:15.277386   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0930 10:21:15.306346   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 10:21:15.333540   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/addons-967811/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 10:21:15.361774   11632 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 10:21:15.386218   11632 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0930 10:21:15.404103   11632 ssh_runner.go:195] Run: openssl version

	I0930 10:21:15.410100   11632 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 10:21:15.421302   11632 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 10:21:15.426287   11632 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 10:21:15.426337   11632 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 10:21:15.432073   11632 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 10:21:15.442590   11632 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 10:21:15.446919   11632 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 10:21:15.446969   11632 kubeadm.go:392] StartCluster: {Name:addons-967811 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 C

lusterName:addons-967811 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.187 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 10:21:15.447031   11632 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0930 10:21:15.447070   11632 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0930 10:21:15.485300   11632 cri.go:89] found id: ""

	I0930 10:21:15.485377   11632 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0930 10:21:15.496351   11632 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0930 10:21:15.506071   11632 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0930 10:21:15.516034   11632 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0930 10:21:15.516057   11632 kubeadm.go:157] found existing configuration files:

	I0930 10:21:15.516232   11632 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0930 10:21:15.525593   11632 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0930 10:21:15.525667   11632 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0930 10:21:15.534907   11632 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0930 10:21:15.543770   11632 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0930 10:21:15.543834   11632 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0930 10:21:15.553311   11632 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0930 10:21:15.562361   11632 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0930 10:21:15.562414   11632 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0930 10:21:15.572061   11632 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0930 10:21:15.581544   11632 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0930 10:21:15.581626   11632 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0930 10:21:15.591197   11632 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0930 10:21:15.645418   11632 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1

	I0930 10:21:15.645674   11632 kubeadm.go:310] [preflight] Running pre-flight checks

	I0930 10:21:15.751192   11632 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0930 10:21:15.751364   11632 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0930 10:21:15.751491   11632 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0930 10:21:15.759784   11632 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0930 10:21:15.863371   11632 out.go:235]   - Generating certificates and keys ...

	I0930 10:21:15.863479   11632 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0930 10:21:15.863558   11632 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0930 10:21:15.936146   11632 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0930 10:21:16.160512   11632 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0930 10:21:16.573253   11632 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0930 10:21:16.767766   11632 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0930 10:21:16.993103   11632 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0930 10:21:16.993272   11632 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-967811 localhost] and IPs [192.168.39.187 127.0.0.1 ::1]

	I0930 10:21:17.062607   11632 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0930 10:21:17.062751   11632 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-967811 localhost] and IPs [192.168.39.187 127.0.0.1 ::1]

	I0930 10:21:17.459582   11632 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0930 10:21:17.881753   11632 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0930 10:21:17.936205   11632 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0930 10:21:17.936272   11632 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0930 10:21:18.004050   11632 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0930 10:21:18.278929   11632 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0930 10:21:18.391300   11632 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0930 10:21:18.558563   11632 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0930 10:21:18.817209   11632 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0930 10:21:18.817535   11632 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0930 10:21:18.819997   11632 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0930 10:21:18.822191   11632 out.go:235]   - Booting up control plane ...

	I0930 10:21:18.822290   11632 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0930 10:21:18.822362   11632 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0930 10:21:18.822428   11632 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0930 10:21:18.841720   11632 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0930 10:21:18.850974   11632 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0930 10:21:18.851054   11632 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0930 10:21:18.976759   11632 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0930 10:21:18.976897   11632 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0930 10:21:19.477514   11632 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.226187ms

	I0930 10:21:19.477595   11632 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0930 10:21:24.978484   11632 kubeadm.go:310] [api-check] The API server is healthy after 5.501792475s

	I0930 10:21:24.992122   11632 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0930 10:21:25.020371   11632 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0930 10:21:25.065233   11632 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0930 10:21:25.065486   11632 kubeadm.go:310] [mark-control-plane] Marking the node addons-967811 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0930 10:21:25.081462   11632 kubeadm.go:310] [bootstrap-token] Using token: 4m4rek.ifpjf7slu0jo5rr4

	I0930 10:21:25.083347   11632 out.go:235]   - Configuring RBAC rules ...

	I0930 10:21:25.083507   11632 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0930 10:21:25.100364   11632 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0930 10:21:25.114795   11632 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0930 10:21:25.120636   11632 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0930 10:21:25.125352   11632 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0930 10:21:25.129577   11632 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0930 10:21:25.383838   11632 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0930 10:21:25.823797   11632 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0930 10:21:26.384083   11632 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0930 10:21:26.384122   11632 kubeadm.go:310] 

	I0930 10:21:26.384209   11632 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0930 10:21:26.384221   11632 kubeadm.go:310] 

	I0930 10:21:26.384315   11632 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0930 10:21:26.384336   11632 kubeadm.go:310] 

	I0930 10:21:26.384378   11632 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0930 10:21:26.384481   11632 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0930 10:21:26.384543   11632 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0930 10:21:26.384550   11632 kubeadm.go:310] 

	I0930 10:21:26.384603   11632 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0930 10:21:26.384609   11632 kubeadm.go:310] 

	I0930 10:21:26.384661   11632 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0930 10:21:26.384670   11632 kubeadm.go:310] 

	I0930 10:21:26.384731   11632 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0930 10:21:26.384834   11632 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0930 10:21:26.384930   11632 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0930 10:21:26.384939   11632 kubeadm.go:310] 

	I0930 10:21:26.385018   11632 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0930 10:21:26.385088   11632 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0930 10:21:26.385094   11632 kubeadm.go:310] 

	I0930 10:21:26.385179   11632 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 4m4rek.ifpjf7slu0jo5rr4 \

	I0930 10:21:26.385308   11632 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 \

	I0930 10:21:26.385338   11632 kubeadm.go:310] 	--control-plane 

	I0930 10:21:26.385348   11632 kubeadm.go:310] 

	I0930 10:21:26.385446   11632 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0930 10:21:26.385456   11632 kubeadm.go:310] 

	I0930 10:21:26.385560   11632 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 4m4rek.ifpjf7slu0jo5rr4 \

	I0930 10:21:26.385718   11632 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 

	I0930 10:21:26.386433   11632 kubeadm.go:310] W0930 10:21:15.628417     817 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0930 10:21:26.386721   11632 kubeadm.go:310] W0930 10:21:15.629400     817 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0930 10:21:26.386833   11632 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0930 10:21:26.386859   11632 cni.go:84] Creating CNI manager for ""

	I0930 10:21:26.386873   11632 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0930 10:21:26.388598   11632 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0930 10:21:26.390042   11632 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0930 10:21:26.401722   11632 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0930 10:21:26.420256   11632 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0930 10:21:26.420333   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:26.420380   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-967811 minikube.k8s.io/updated_at=2024_09_30T10_21_26_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=addons-967811 minikube.k8s.io/primary=true

	I0930 10:21:26.456418   11632 ops.go:34] apiserver oom_adj: -16

	I0930 10:21:26.580363   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:27.080531   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:27.581410   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:28.081280   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:28.581279   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:29.080539   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:29.581414   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:30.081353   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:30.580629   11632 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 10:21:30.679507   11632 kubeadm.go:1113] duration metric: took 4.259237067s to wait for elevateKubeSystemPrivileges

	I0930 10:21:30.679543   11632 kubeadm.go:394] duration metric: took 15.232577791s to StartCluster

	I0930 10:21:30.679559   11632 settings.go:142] acquiring lock: {Name:mkdbb7ee3f4e112a79c58917f833dfd72cc7c3b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:30.679668   11632 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 10:21:30.680624   11632 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/kubeconfig: {Name:mkbcc26962ad9a46a600e5f0a5facf24bf9d408d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 10:21:30.680932   11632 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.39.187 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 10:21:30.681307   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0930 10:21:30.681108   11632 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0930 10:21:30.681652   11632 config.go:182] Loaded profile config "addons-967811": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 10:21:30.681706   11632 addons.go:69] Setting yakd=true in profile "addons-967811"

	I0930 10:21:30.681720   11632 addons.go:69] Setting cloud-spanner=true in profile "addons-967811"

	I0930 10:21:30.681733   11632 addons.go:234] Setting addon cloud-spanner=true in "addons-967811"

	I0930 10:21:30.681741   11632 addons.go:69] Setting metrics-server=true in profile "addons-967811"

	I0930 10:21:30.681755   11632 addons.go:234] Setting addon metrics-server=true in "addons-967811"

	I0930 10:21:30.681752   11632 addons.go:69] Setting ingress=true in profile "addons-967811"

	I0930 10:21:30.681770   11632 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-967811"

	I0930 10:21:30.681774   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.681775   11632 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-967811"

	I0930 10:21:30.681771   11632 addons.go:69] Setting storage-provisioner=true in profile "addons-967811"

	I0930 10:21:30.681779   11632 addons.go:69] Setting default-storageclass=true in profile "addons-967811"

	I0930 10:21:30.681770   11632 addons.go:69] Setting ingress-dns=true in profile "addons-967811"

	I0930 10:21:30.681799   11632 addons.go:234] Setting addon storage-provisioner=true in "addons-967811"

	I0930 10:21:30.681799   11632 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-967811"

	I0930 10:21:30.681799   11632 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-967811"

	I0930 10:21:30.681805   11632 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-967811"

	I0930 10:21:30.681810   11632 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-967811"

	I0930 10:21:30.681781   11632 addons.go:234] Setting addon ingress=true in "addons-967811"

	I0930 10:21:30.681819   11632 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-967811"

	I0930 10:21:30.681752   11632 addons.go:69] Setting gcp-auth=true in profile "addons-967811"

	I0930 10:21:30.681827   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.681839   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.681850   11632 addons.go:69] Setting registry=true in profile "addons-967811"

	I0930 10:21:30.681865   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.681887   11632 addons.go:234] Setting addon registry=true in "addons-967811"

	I0930 10:21:30.681909   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.682259   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682275   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682281   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682287   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682293   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.681841   11632 mustload.go:65] Loading cluster: addons-967811

	I0930 10:21:30.682307   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682312   11632 addons.go:69] Setting volumesnapshots=true in profile "addons-967811"

	I0930 10:21:30.682325   11632 addons.go:234] Setting addon volumesnapshots=true in "addons-967811"

	I0930 10:21:30.682421   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682443   11632 config.go:182] Loaded profile config "addons-967811": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 10:21:30.682492   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.681733   11632 addons.go:234] Setting addon yakd=true in "addons-967811"

	I0930 10:21:30.682592   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.682769   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682792   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682834   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.681812   11632 addons.go:234] Setting addon ingress-dns=true in "addons-967811"

	I0930 10:21:30.682325   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682856   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682867   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.681823   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.682930   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682947   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682980   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.682991   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.681791   11632 addons.go:69] Setting volcano=true in profile "addons-967811"

	I0930 10:21:30.683103   11632 addons.go:234] Setting addon volcano=true in "addons-967811"

	I0930 10:21:30.683115   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.683132   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.683135   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.683183   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.681764   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.683463   11632 out.go:177] * Verifying Kubernetes components...

	I0930 10:21:30.681712   11632 addons.go:69] Setting inspektor-gadget=true in profile "addons-967811"

	I0930 10:21:30.683678   11632 addons.go:234] Setting addon inspektor-gadget=true in "addons-967811"

	I0930 10:21:30.683711   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.682301   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.682851   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.684072   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.684086   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.684114   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.685138   11632 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 10:21:30.704014   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46821

	I0930 10:21:30.718328   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.718360   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.718381   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.718402   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.718722   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33615

	I0930 10:21:30.718779   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.718819   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.720569   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39949

	I0930 10:21:30.721062   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.721173   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.721257   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.721630   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.721664   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.721813   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.721833   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.721966   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.721985   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.722357   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.722414   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.722474   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.722519   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.722645   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.723022   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.725167   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.725602   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.725656   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.731958   11632 addons.go:234] Setting addon default-storageclass=true in "addons-967811"

	I0930 10:21:30.732003   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.732414   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.732463   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.733767   11632 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-967811"

	I0930 10:21:30.733805   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:30.734161   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.734208   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.745078   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45697

	I0930 10:21:30.745718   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.746690   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.746709   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.747036   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.747561   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.747598   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.756278   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40503

	I0930 10:21:30.756441   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43157

	I0930 10:21:30.756867   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.757353   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.757371   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.757447   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.757748   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.758285   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.758324   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.758600   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36779

	I0930 10:21:30.759136   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.759168   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.759892   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.760461   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.760496   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.760727   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.760810   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34683

	I0930 10:21:30.762134   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.762302   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.762313   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.762811   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.762827   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.762957   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.763246   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.763662   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.763699   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.763886   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34701

	I0930 10:21:30.764254   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.764286   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.776529   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.776659   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38229

	I0930 10:21:30.776797   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44259

	I0930 10:21:30.776871   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32815

	I0930 10:21:30.776947   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38765

	I0930 10:21:30.777958   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.778054   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41541

	I0930 10:21:30.778146   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.778318   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.778329   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.779961   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.780036   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.780042   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.780053   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.780114   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.780143   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.780161   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.780281   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.780512   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.780528   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.780535   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.780574   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.781107   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44509

	I0930 10:21:30.781161   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.781193   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.781239   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34757

	I0930 10:21:30.781329   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.781654   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.781711   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.781920   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.781958   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.782097   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.782115   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.782552   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.783085   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.783129   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.783288   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.783308   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.783681   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.783720   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43411

	I0930 10:21:30.784389   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.784422   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.784869   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.784947   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.785008   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.785482   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.786070   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.786086   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.786497   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.787003   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.787020   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.787114   11632 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0930 10:21:30.787960   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.788537   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.788548   11632 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0930 10:21:30.788563   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0930 10:21:30.788568   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.788580   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.788880   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.788894   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.789308   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.791854   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42891

	I0930 10:21:30.791925   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43543

	I0930 10:21:30.791985   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.792344   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.792362   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.792713   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.792883   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.793050   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.793192   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.801012   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38165

	I0930 10:21:30.801768   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.802409   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.802429   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.802796   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.802975   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.804724   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.805742   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46249

	I0930 10:21:30.806134   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.806571   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.806595   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.806962   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.807167   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.807171   11632 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0930 10:21:30.807867   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39757

	I0930 10:21:30.808285   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.808744   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.808763   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.809144   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.809196   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.809397   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.811326   11632 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	I0930 10:21:30.811332   11632 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	I0930 10:21:30.811366   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.811398   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44123

	I0930 10:21:30.811762   11632 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0930 10:21:30.811779   11632 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0930 10:21:30.811795   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.811987   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.812655   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.812673   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.813004   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.813115   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44269

	I0930 10:21:30.813196   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.813492   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43907

	I0930 10:21:30.814631   11632 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0930 10:21:30.814729   11632 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0930 10:21:30.814742   11632 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0930 10:21:30.814761   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.814872   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.814948   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41191

	I0930 10:21:30.815715   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:30.815732   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:30.815903   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:30.815929   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:30.815935   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:30.815943   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:30.815948   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:30.816892   11632 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0930 10:21:30.816910   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0930 10:21:30.816926   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.816984   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.817001   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.817016   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.817036   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:30.817053   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:30.817059   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	W0930 10:21:30.817123   11632 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	I0930 10:21:30.817901   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.817936   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.818182   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.818210   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.818235   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.818283   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.818485   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.818540   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.818627   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.818687   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.818979   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.819585   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.819967   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.819990   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.820057   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.820179   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.820278   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.820385   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.822203   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.822249   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.822752   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.822783   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.822986   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.823074   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.823173   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.823232   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.823444   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.823457   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.823518   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.823679   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.823690   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.823805   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.823815   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.823869   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.824027   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.824066   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.824101   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.824719   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.824736   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.824790   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.824900   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.824909   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.824955   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.825664   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.825707   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.826374   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.826409   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.826966   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:30.826998   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:30.827201   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.827217   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.827268   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.829030   11632 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.7

	I0930 10:21:30.829032   11632 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I0930 10:21:30.829033   11632 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0

	I0930 10:21:30.830921   11632 out.go:177]   - Using image docker.io/registry:2.8.3

	I0930 10:21:30.830928   11632 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0930 10:21:30.830946   11632 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0930 10:21:30.830966   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.831098   11632 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0930 10:21:30.831110   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0930 10:21:30.831127   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.832698   11632 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0930 10:21:30.832712   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0930 10:21:30.832729   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.835298   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.835400   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.835940   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.835960   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.836038   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.836063   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.836205   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.836262   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.836487   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.836490   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.836652   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.836777   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.837071   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.837127   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.837231   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.837613   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.837653   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.837826   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.838012   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.838142   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.838256   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.843310   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41171

	I0930 10:21:30.843841   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.844452   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.844476   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.844826   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.844979   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.846744   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.848323   11632 out.go:177]   - Using image docker.io/busybox:stable

	I0930 10:21:30.849875   11632 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0930 10:21:30.851017   11632 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0930 10:21:30.851035   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0930 10:21:30.851057   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.851224   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34221

	I0930 10:21:30.851242   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45639

	I0930 10:21:30.851249   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33351

	I0930 10:21:30.851328   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45205

	I0930 10:21:30.851738   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.851739   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.852192   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.852214   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.852341   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.852358   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.852415   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.852483   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.852556   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.852725   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.852937   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.853073   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.853087   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.853335   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.853427   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.853778   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.853928   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.853945   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.854296   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.854729   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.855254   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.856677   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.856702   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.856703   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.857105   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0930 10:21:30.857211   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.857238   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.857338   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.857462   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.857601   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.857763   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.857850   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.858369   11632 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0930 10:21:30.858376   11632 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0930 10:21:30.858414   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0930 10:21:30.858386   11632 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0930 10:21:30.858433   11632 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0930 10:21:30.858440   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.859099   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35127

	I0930 10:21:30.859903   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:30.859919   11632 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0930 10:21:30.859932   11632 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0930 10:21:30.859941   11632 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0930 10:21:30.859949   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0930 10:21:30.859949   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.859962   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.860530   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:30.860552   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:30.860923   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:30.861058   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0930 10:21:30.861205   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:30.861890   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.862428   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.862449   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.862662   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.862821   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.862934   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.863037   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.863570   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0930 10:21:30.863683   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.863769   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:30.864183   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.864306   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.864344   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.864491   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.864499   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.864664   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.864815   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.865055   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.864889   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.865108   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.865177   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.865279   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.865388   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.865442   11632 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24

	I0930 10:21:30.866106   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0930 10:21:30.867317   11632 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0930 10:21:30.867331   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0930 10:21:30.867341   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.867380   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0930 10:21:30.868346   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0930 10:21:30.869325   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0930 10:21:30.869953   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.870314   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.870334   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.870512   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.870641   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.870732   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.870813   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:30.871375   11632 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0930 10:21:30.872492   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0930 10:21:30.872505   11632 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0930 10:21:30.872519   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:30.875225   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.875608   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:30.875631   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:30.875808   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:30.875939   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:30.876026   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:30.876100   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:31.259673   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0930 10:21:31.264683   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0930 10:21:31.285537   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0930 10:21:31.285566   11632 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0930 10:21:31.321198   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0930 10:21:31.321213   11632 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 10:21:31.329977   11632 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0930 10:21:31.330000   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0930 10:21:31.340143   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0930 10:21:31.359582   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0930 10:21:31.409721   11632 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0930 10:21:31.409752   11632 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0930 10:21:31.411966   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0930 10:21:31.435395   11632 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0930 10:21:31.435425   11632 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0930 10:21:31.439032   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0930 10:21:31.478936   11632 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0930 10:21:31.478961   11632 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0930 10:21:31.482483   11632 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0930 10:21:31.482505   11632 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0930 10:21:31.500069   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0930 10:21:31.500103   11632 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0930 10:21:31.500399   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0930 10:21:31.562818   11632 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0930 10:21:31.562841   11632 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0930 10:21:31.667554   11632 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0930 10:21:31.667583   11632 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0930 10:21:31.674953   11632 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0930 10:21:31.674982   11632 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0930 10:21:31.677272   11632 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0930 10:21:31.677293   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0930 10:21:31.747357   11632 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0930 10:21:31.747380   11632 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0930 10:21:31.757343   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0930 10:21:31.757368   11632 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0930 10:21:31.767546   11632 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0930 10:21:31.767575   11632 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0930 10:21:31.906025   11632 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0930 10:21:31.906048   11632 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0930 10:21:31.912238   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0930 10:21:31.944476   11632 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0930 10:21:31.944501   11632 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0930 10:21:31.947507   11632 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0930 10:21:31.947529   11632 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0930 10:21:31.970566   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0930 10:21:31.970597   11632 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0930 10:21:32.003435   11632 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0930 10:21:32.003459   11632 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0930 10:21:32.019067   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0930 10:21:32.130295   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0930 10:21:32.130338   11632 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0930 10:21:32.130434   11632 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0930 10:21:32.130454   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0930 10:21:32.223238   11632 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0930 10:21:32.223274   11632 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0930 10:21:32.242642   11632 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0930 10:21:32.242681   11632 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0930 10:21:32.265488   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0930 10:21:32.281569   11632 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0930 10:21:32.281596   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0930 10:21:32.522197   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0930 10:21:32.563930   11632 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0930 10:21:32.563958   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0930 10:21:32.571532   11632 addons.go:431] installing /etc/kubernetes/addons/ig-configmap.yaml

	I0930 10:21:32.571560   11632 ssh_runner.go:362] scp inspektor-gadget/ig-configmap.yaml --> /etc/kubernetes/addons/ig-configmap.yaml (754 bytes)

	I0930 10:21:32.725021   11632 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0930 10:21:32.725053   11632 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0930 10:21:32.825135   11632 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0930 10:21:32.825167   11632 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0930 10:21:33.078932   11632 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0930 10:21:33.078960   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (8196 bytes)

	I0930 10:21:33.103828   11632 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0930 10:21:33.103850   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0930 10:21:33.394908   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-configmap.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0930 10:21:33.417841   11632 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0930 10:21:33.417871   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0930 10:21:33.764197   11632 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0930 10:21:33.764223   11632 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0930 10:21:34.128289   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0930 10:21:37.896357   11632 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0930 10:21:37.896399   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:37.899659   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:37.900076   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:37.900103   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:37.900365   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:37.900574   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:37.900787   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:37.900935   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:38.284491   11632 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0930 10:21:38.403839   11632 addons.go:234] Setting addon gcp-auth=true in "addons-967811"

	I0930 10:21:38.403902   11632 host.go:66] Checking if "addons-967811" exists ...

	I0930 10:21:38.404246   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:38.404294   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:38.420788   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34911

	I0930 10:21:38.421257   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:38.421772   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:38.421796   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:38.422187   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:38.422771   11632 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 10:21:38.422821   11632 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 10:21:38.439847   11632 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39033

	I0930 10:21:38.440361   11632 main.go:141] libmachine: () Calling .GetVersion

	I0930 10:21:38.440853   11632 main.go:141] libmachine: Using API Version  1

	I0930 10:21:38.440874   11632 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 10:21:38.441257   11632 main.go:141] libmachine: () Calling .GetMachineName

	I0930 10:21:38.441425   11632 main.go:141] libmachine: (addons-967811) Calling .GetState

	I0930 10:21:38.443336   11632 main.go:141] libmachine: (addons-967811) Calling .DriverName

	I0930 10:21:38.443562   11632 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0930 10:21:38.443581   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHHostname

	I0930 10:21:38.446232   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:38.446672   11632 main.go:141] libmachine: (addons-967811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:3e:c1", ip: ""} in network mk-addons-967811: {Iface:virbr1 ExpiryTime:2024-09-30 11:20:55 +0000 UTC Type:0 Mac:52:54:00:88:3e:c1 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-967811 Clientid:01:52:54:00:88:3e:c1}

	I0930 10:21:38.446702   11632 main.go:141] libmachine: (addons-967811) DBG | domain addons-967811 has defined IP address 192.168.39.187 and MAC address 52:54:00:88:3e:c1 in network mk-addons-967811

	I0930 10:21:38.446911   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHPort

	I0930 10:21:38.447127   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHKeyPath

	I0930 10:21:38.447294   11632 main.go:141] libmachine: (addons-967811) Calling .GetSSHUsername

	I0930 10:21:38.447498   11632 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/addons-967811/id_rsa Username:docker}

	I0930 10:21:40.128768   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.869058625s)

	I0930 10:21:40.128827   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.128840   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.128863   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.864150771s)

	I0930 10:21:40.128901   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.128919   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.128936   11632 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (8.807637652s)

	I0930 10:21:40.128993   11632 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (8.807757831s)

	I0930 10:21:40.129013   11632 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0930 10:21:40.129043   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (8.788875083s)

	I0930 10:21:40.129094   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129109   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129175   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.129178   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.769565288s)

	I0930 10:21:40.129201   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129209   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129226   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.129238   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.129246   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129254   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129254   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (8.690195965s)

	I0930 10:21:40.129275   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129227   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.717238382s)

	I0930 10:21:40.129284   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.129284   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129309   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129317   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129342   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.129350   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.129350   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.628932606s)

	I0930 10:21:40.129357   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129364   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129367   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129376   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129426   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.129439   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.217175961s)

	I0930 10:21:40.129447   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.129454   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129455   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.129461   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129464   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129471   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129570   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.110471459s)

	I0930 10:21:40.129590   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129602   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129692   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.864169906s)

	I0930 10:21:40.129705   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.129713   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.129854   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.607616075s)

	W0930 10:21:40.129882   11632 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0930 10:21:40.129899   11632 retry.go:31] will retry after 268.671254ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0930 10:21:40.129949   11632 node_ready.go:35] waiting up to 6m0s for node "addons-967811" to be "Ready" ...

	I0930 10:21:40.129991   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-configmap.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.735049909s)

	I0930 10:21:40.130006   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.130013   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.130078   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.130093   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.130102   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.130115   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.130127   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.130145   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.130152   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.130162   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.130168   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.130115   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.130186   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.130189   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.130197   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.130200   11632 addons.go:475] Verifying addon ingress=true in "addons-967811"

	I0930 10:21:40.130207   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.130215   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.130222   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.130230   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.130233   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.130236   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.133143   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.133174   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.133180   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.133399   11632 out.go:177] * Verifying ingress addon...

	I0930 10:21:40.133711   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.133741   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.133747   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.133993   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.134023   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.134030   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.134038   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.134044   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.134079   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.134089   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.134105   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.134113   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.134120   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.134126   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.134106   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.134190   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.134198   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.134205   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.134683   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.134687   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.134697   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.134705   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.134711   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.134716   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.134723   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.134758   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.134778   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.134784   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.134792   11632 addons.go:475] Verifying addon registry=true in "addons-967811"

	I0930 10:21:40.135162   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.135191   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.135198   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.135214   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.135220   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.135265   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.135288   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.135293   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.135402   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.135421   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.135427   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.135434   11632 addons.go:475] Verifying addon metrics-server=true in "addons-967811"

	I0930 10:21:40.135638   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.135657   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.135668   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.135678   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.135682   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.135688   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.136511   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.136536   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.136549   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.136764   11632 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-967811 service yakd-dashboard -n yakd-dashboard

	I0930 10:21:40.136977   11632 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0930 10:21:40.137153   11632 out.go:177] * Verifying registry addon...

	I0930 10:21:40.139931   11632 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0930 10:21:40.164800   11632 node_ready.go:49] node "addons-967811" has status "Ready":"True"

	I0930 10:21:40.164828   11632 node_ready.go:38] duration metric: took 34.856617ms for node "addons-967811" to be "Ready" ...

	I0930 10:21:40.164839   11632 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 10:21:40.207158   11632 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0930 10:21:40.207186   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:40.219406   11632 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0930 10:21:40.219430   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:40.250835   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.250856   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.251152   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.251234   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.251250   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	W0930 10:21:40.251354   11632 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I0930 10:21:40.263114   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:40.263135   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:40.263429   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:40.263464   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:40.263476   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:40.311098   11632 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace to be "Ready" ...

	I0930 10:21:40.398784   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0930 10:21:40.636693   11632 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-967811" context rescaled to 1 replicas

	I0930 10:21:40.657380   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:40.661662   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:41.207743   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:41.210593   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:41.335805   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.207460837s)

	I0930 10:21:41.335861   11632 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.892278829s)

	I0930 10:21:41.335867   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:41.336005   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:41.336247   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:41.336325   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:41.336344   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:41.336359   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:41.336368   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:41.336570   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:41.336587   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:41.336598   11632 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-967811"

	I0930 10:21:41.336611   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:41.337469   11632 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0930 10:21:41.338196   11632 out.go:177] * Verifying csi-hostpath-driver addon...

	I0930 10:21:41.339810   11632 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0930 10:21:41.340467   11632 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0930 10:21:41.340966   11632 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0930 10:21:41.340986   11632 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0930 10:21:41.386596   11632 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0930 10:21:41.386615   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:41.555627   11632 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0930 10:21:41.555654   11632 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0930 10:21:41.631732   11632 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0930 10:21:41.631754   11632 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0930 10:21:41.641943   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:41.643829   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:41.780379   11632 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0930 10:21:41.846455   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:42.142460   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:42.144506   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:42.316949   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:42.345333   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:42.641219   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:42.647206   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:42.846747   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:42.889525   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.490703648s)

	I0930 10:21:42.889574   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:42.889587   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:42.889854   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:42.889902   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:42.889911   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:42.889926   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:42.889934   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:42.890167   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:42.890184   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:42.890196   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:43.145419   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:43.146593   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:43.355235   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:43.481504   11632 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.701059685s)

	I0930 10:21:43.481573   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:43.481589   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:43.481963   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:43.481983   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:43.481998   11632 main.go:141] libmachine: Making call to close driver server

	I0930 10:21:43.482014   11632 main.go:141] libmachine: (addons-967811) Calling .Close

	I0930 10:21:43.483510   11632 main.go:141] libmachine: (addons-967811) DBG | Closing plugin on server side

	I0930 10:21:43.483534   11632 main.go:141] libmachine: Successfully made call to close driver server

	I0930 10:21:43.483549   11632 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 10:21:43.484556   11632 addons.go:475] Verifying addon gcp-auth=true in "addons-967811"

	I0930 10:21:43.486217   11632 out.go:177] * Verifying gcp-auth addon...

	I0930 10:21:43.488304   11632 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0930 10:21:43.507786   11632 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0930 10:21:43.507817   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:43.652005   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:43.652195   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:43.847570   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:43.992362   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:44.141542   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:44.143981   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:44.317418   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:44.347619   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:44.492354   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:44.641779   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:44.643246   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:44.847349   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:44.991887   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:45.156849   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:45.158405   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:45.347284   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:45.492271   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:45.641080   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:45.642894   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:45.845841   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:45.994455   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:46.142172   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:46.144615   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:46.318761   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:46.346919   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:46.494624   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:46.641752   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:46.643667   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:46.844970   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:46.992316   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:47.141049   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:47.142892   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:47.345198   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:47.492053   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:47.641452   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:47.642982   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:47.845122   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:47.991850   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:48.141773   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:48.143411   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:48.320682   11632 pod_ready.go:98] pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:48 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.39.187 HostIPs:[{IP:192.168.39

.187}] PodIP:10.244.0.2 PodIPs:[{IP:10.244.0.2}] StartTime:2024-09-30 10:21:31 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-09-30 10:21:34 +0000 UTC,FinishedAt:2024-09-30 10:21:45 +0000 UTC,ContainerID:cri-o://32140834ee9abbe748a2ba14d095fc617926cb3e05bac64f4efc92f628cee6e2,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.3 ImageID:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6 ContainerID:cri-o://32140834ee9abbe748a2ba14d095fc617926cb3e05bac64f4efc92f628cee6e2 Started:0xc002696100 AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0021896b0} {Name:kube-api-access-qhlvd MountPath:/var/run/secrets/kubernetes.io/serviceaccount ReadOnly:true RecursiveReadOnly:0xc0021896c0}] User:ni

l AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}

	I0930 10:21:48.320712   11632 pod_ready.go:82] duration metric: took 8.009577627s for pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace to be "Ready" ...

	E0930 10:21:48.320724   11632 pod_ready.go:67] WaitExtra: waitPodCondition: pod "coredns-7c65d6cfc9-2rvrx" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:48 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-30 10:21:31 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.3

9.187 HostIPs:[{IP:192.168.39.187}] PodIP:10.244.0.2 PodIPs:[{IP:10.244.0.2}] StartTime:2024-09-30 10:21:31 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-09-30 10:21:34 +0000 UTC,FinishedAt:2024-09-30 10:21:45 +0000 UTC,ContainerID:cri-o://32140834ee9abbe748a2ba14d095fc617926cb3e05bac64f4efc92f628cee6e2,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.3 ImageID:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6 ContainerID:cri-o://32140834ee9abbe748a2ba14d095fc617926cb3e05bac64f4efc92f628cee6e2 Started:0xc002696100 AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0021896b0} {Name:kube-api-access-qhlvd MountPath:/var/run/secrets/kubernetes.io/serviceaccount ReadOnly:true RecursiveRe

adOnly:0xc0021896c0}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}

	I0930 10:21:48.320732   11632 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace to be "Ready" ...

	I0930 10:21:48.347892   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:48.492810   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:48.641443   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:48.643522   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:48.845903   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:48.992221   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:49.141231   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:49.143868   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:49.345098   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:49.494703   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:49.641264   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:49.644156   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:49.845499   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:49.992236   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:50.141801   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:50.143927   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:50.327844   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:50.346682   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:50.492538   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:50.641024   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:50.643069   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:50.844865   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:50.992784   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:51.141608   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:51.143160   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:51.345548   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:51.492213   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:51.641924   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:51.644288   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:51.848748   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:51.991951   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:52.141657   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:52.144275   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:52.347415   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:52.493109   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:52.641838   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:52.643198   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:52.829165   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:52.851022   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:52.992551   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:53.142410   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:53.143777   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:53.345431   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:53.492343   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:53.641553   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:53.643337   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:53.845221   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:53.991859   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:54.141849   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:54.143391   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:54.346249   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:54.492140   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:54.642102   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:54.644311   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:54.847635   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:54.992100   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:55.141088   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:55.142742   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:55.327479   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:55.345878   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:55.492549   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:55.642049   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:55.644627   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:55.845783   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:55.991814   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:56.141295   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:56.142886   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:56.345811   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:56.492640   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:56.640958   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:56.643192   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:56.848884   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:56.991999   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:57.141952   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:57.143119   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:57.346136   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:57.496180   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:57.642729   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:57.643571   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:57.826785   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:57.845326   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:57.994848   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:58.141665   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:58.143068   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:58.346167   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:58.492826   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:58.641766   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:58.643468   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:58.845709   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:58.992237   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:59.142704   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:59.143827   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:59.346079   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:59.492247   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:21:59.641837   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:21:59.643706   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:21:59.828986   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:21:59.845969   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:21:59.992373   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:00.142177   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:00.143687   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:00.369230   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:00.493767   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:00.644379   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:00.650679   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:00.847805   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:00.992303   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:01.140975   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:01.142751   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:01.345360   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:01.505588   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:01.641317   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:01.642910   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:01.845080   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:01.991373   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:02.142166   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:02.144059   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:02.327472   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:02.345448   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:02.492946   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:02.643331   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:02.652396   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:02.846286   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:02.992557   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:03.141575   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:03.143580   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:03.352331   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:03.493027   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:03.642782   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:03.643444   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:03.846034   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:03.992646   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:04.141240   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:04.143518   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:04.328820   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:04.344995   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:04.493553   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:04.641861   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:04.643826   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:04.846082   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:04.992561   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:05.141685   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:05.143906   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:05.346082   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:05.494978   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:05.642266   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:05.643228   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:05.848081   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:05.991860   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:06.141276   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:06.143842   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:06.347064   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:06.492967   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:06.641770   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:06.643699   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:07.177584   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:07.178008   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:07.179011   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:07.179231   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:07.180974   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:07.346375   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:07.493312   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:07.641301   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:07.643229   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:07.846469   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:07.992323   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:08.140732   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:08.143100   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:08.344963   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:08.493470   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:08.642279   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:08.647345   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:08.847135   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:08.993895   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:09.141832   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:09.143778   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:09.326895   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:09.344524   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:09.491613   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:09.641674   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:09.643901   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:09.845039   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:09.992696   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:10.141446   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:10.143259   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:10.344881   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:10.492856   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:10.642432   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:10.644469   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:10.845441   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:10.991825   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:11.141468   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:11.143540   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:11.345463   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:11.492943   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:11.641520   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:11.643019   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:11.854593   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:11.856866   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:11.993400   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:12.142322   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:12.144356   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:12.346072   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:12.492313   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:12.641678   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:12.643396   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:12.846808   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:12.991960   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:13.141554   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:13.143305   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:13.346416   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:13.492599   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:13.641825   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:13.643457   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:13.845102   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:13.992616   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:14.142094   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:14.143701   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:14.326812   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:14.344766   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:14.495142   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:14.645087   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0930 10:22:14.646749   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:14.846006   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:14.992910   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:15.143179   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:15.144516   11632 kapi.go:107] duration metric: took 35.004582422s to wait for kubernetes.io/minikube-addons=registry ...

	I0930 10:22:15.346290   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:15.492707   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:15.641702   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:15.845665   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:15.992432   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:16.141887   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:16.558065   11632 pod_ready.go:103] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:16.558146   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:16.559857   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:16.655637   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:16.826577   11632 pod_ready.go:93] pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace has status "Ready":"True"

	I0930 10:22:16.826605   11632 pod_ready.go:82] duration metric: took 28.505865349s for pod "coredns-7c65d6cfc9-p8fdk" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.826615   11632 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.833786   11632 pod_ready.go:93] pod "etcd-addons-967811" in "kube-system" namespace has status "Ready":"True"

	I0930 10:22:16.833806   11632 pod_ready.go:82] duration metric: took 7.184691ms for pod "etcd-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.833814   11632 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.839487   11632 pod_ready.go:93] pod "kube-apiserver-addons-967811" in "kube-system" namespace has status "Ready":"True"

	I0930 10:22:16.839504   11632 pod_ready.go:82] duration metric: took 5.68438ms for pod "kube-apiserver-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.839512   11632 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.849730   11632 pod_ready.go:93] pod "kube-controller-manager-addons-967811" in "kube-system" namespace has status "Ready":"True"

	I0930 10:22:16.849755   11632 pod_ready.go:82] duration metric: took 10.23514ms for pod "kube-controller-manager-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.849771   11632 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-xdx5j" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.850352   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:16.854496   11632 pod_ready.go:93] pod "kube-proxy-xdx5j" in "kube-system" namespace has status "Ready":"True"

	I0930 10:22:16.854525   11632 pod_ready.go:82] duration metric: took 4.74547ms for pod "kube-proxy-xdx5j" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.854537   11632 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:16.994074   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:17.140995   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:17.224401   11632 pod_ready.go:93] pod "kube-scheduler-addons-967811" in "kube-system" namespace has status "Ready":"True"

	I0930 10:22:17.224426   11632 pod_ready.go:82] duration metric: took 369.881307ms for pod "kube-scheduler-addons-967811" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:17.224435   11632 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace to be "Ready" ...

	I0930 10:22:17.346204   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:17.493016   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:17.641675   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:17.844913   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:17.992461   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:18.141205   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:18.345557   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:18.493099   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:18.642338   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:18.844949   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:18.992674   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:19.142674   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:19.230834   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:19.346168   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:19.492056   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:19.642840   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:20.110230   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:20.111851   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:20.141153   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:20.345513   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:20.491959   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:20.642147   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:20.846310   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:20.992846   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:21.141914   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:21.231771   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:21.350059   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:21.494362   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:21.642894   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:21.844814   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:21.991778   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:22.141948   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:22.349557   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:22.492642   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:22.642422   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:22.845376   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:22.993752   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:23.141817   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:23.347443   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:23.492353   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:23.640833   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:23.732426   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:23.845830   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:23.991991   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:24.142622   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:24.346317   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:24.492487   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:24.642564   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:24.846839   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:24.991905   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:25.144301   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:25.346401   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:25.492824   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:25.641970   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:25.733334   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:25.845823   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:25.992427   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:26.144708   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:26.346031   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:26.493666   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:26.684237   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:26.846321   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:26.992437   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:27.141725   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:27.349319   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:27.492828   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:27.641393   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:27.737210   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:27.845466   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:27.992321   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:28.140834   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:28.345386   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:28.493530   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:28.641950   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:28.846796   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:28.994780   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:29.142264   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:29.345923   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:29.492933   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:29.642268   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:29.745784   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:29.850535   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:29.993179   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:30.143797   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:30.345718   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:30.492897   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:30.642211   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:30.847240   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:30.993015   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:31.142706   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:31.345578   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:31.497605   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:31.648803   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:31.846866   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:31.992429   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:32.141158   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:32.231185   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:32.353558   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:32.492902   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:32.641985   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:32.846047   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:32.993019   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:33.141391   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:33.346277   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:33.492235   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:33.647571   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:33.845095   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:34.386211   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:34.386385   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:34.386483   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:34.390516   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:34.492046   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:34.645479   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:34.845915   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:34.993467   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:35.145529   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:35.345461   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:35.492430   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:35.642579   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:35.848781   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:35.995360   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:36.141572   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:36.345409   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:36.491515   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:36.641196   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:36.732471   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:36.845497   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:36.991889   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:37.141961   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:37.346184   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:37.491655   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:37.641691   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:37.845316   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:37.991857   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:38.144723   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:38.357725   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:38.492972   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:38.641893   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:38.846140   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:38.992322   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:39.140869   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:39.233178   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:39.346407   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0930 10:22:39.493877   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:39.644600   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:39.846359   11632 kapi.go:107] duration metric: took 58.505887407s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0930 10:22:39.992209   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:40.141208   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:40.493287   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:40.641008   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:40.992310   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:41.141031   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:41.491745   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:41.641907   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:41.731736   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:41.991673   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:42.141477   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:42.493215   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:42.641081   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:42.992857   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:43.143014   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:43.494056   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:43.641591   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:43.731890   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:43.992305   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:44.141461   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:44.492986   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:44.644449   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:44.992492   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:45.142210   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:45.493575   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:45.643807   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:45.737416   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:45.993576   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:46.141909   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:46.494920   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:46.644473   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:47.002435   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:47.142295   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:47.495831   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:47.708701   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:47.992574   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:48.142531   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:48.230566   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:48.492223   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:48.640467   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:48.991809   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:49.141424   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:49.492769   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:49.641129   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:49.992797   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:50.141756   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:50.258167   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:50.492423   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:50.641742   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:51.093207   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:51.142064   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:51.492365   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:51.641126   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:51.992061   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:52.141557   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:52.492312   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:52.646299   11632 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0930 10:22:52.733243   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:52.994472   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:53.151485   11632 kapi.go:107] duration metric: took 1m13.014507672s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0930 10:22:53.493563   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:53.994979   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:54.826714   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:54.828961   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:54.992989   11632 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0930 10:22:55.494029   11632 kapi.go:107] duration metric: took 1m12.0057203s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0930 10:22:55.495910   11632 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-967811 cluster.

	I0930 10:22:55.497416   11632 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0930 10:22:55.498876   11632 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0930 10:22:55.500497   11632 out.go:177] * Enabled addons: ingress-dns, storage-provisioner, cloud-spanner, nvidia-device-plugin, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

	I0930 10:22:55.501739   11632 addons.go:510] duration metric: took 1m24.820638523s for enable addons: enabled=[ingress-dns storage-provisioner cloud-spanner nvidia-device-plugin metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]

	I0930 10:22:57.347769   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:22:59.734209   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:02.231567   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:04.731346   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:06.732005   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:09.232217   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:11.731266   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:13.733418   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:16.231116   11632 pod_ready.go:103] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"False"

	I0930 10:23:16.735332   11632 pod_ready.go:93] pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace has status "Ready":"True"

	I0930 10:23:16.735366   11632 pod_ready.go:82] duration metric: took 59.510923959s for pod "metrics-server-84c5f94fbc-r6p7j" in "kube-system" namespace to be "Ready" ...

	I0930 10:23:16.735381   11632 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-kwm74" in "kube-system" namespace to be "Ready" ...

	I0930 10:23:16.743889   11632 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-kwm74" in "kube-system" namespace has status "Ready":"True"

	I0930 10:23:16.743919   11632 pod_ready.go:82] duration metric: took 8.529604ms for pod "nvidia-device-plugin-daemonset-kwm74" in "kube-system" namespace to be "Ready" ...

	I0930 10:23:16.743944   11632 pod_ready.go:39] duration metric: took 1m36.579092737s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 10:23:16.743965   11632 api_server.go:52] waiting for apiserver process to appear ...

	I0930 10:23:16.743999   11632 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0930 10:23:16.744059   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0930 10:23:16.812709   11632 cri.go:89] found id: "329f2855c369d1ab3a6f4f0909651f908db3cef3d91e70309661d46153650a72"

	I0930 10:23:16.812733   11632 cri.go:89] found id: ""

	I0930 10:23:16.812742   11632 logs.go:276] 1 containers: [329f2855c369d1ab3a6f4f0909651f908db3cef3d91e70309661d46153650a72]

	I0930 10:23:16.812803   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:23:16.820521   11632 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0930 10:23:16.820595   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0930 10:23:16.862828   11632 cri.go:89] found id: "43d1e8f87adc2e8166f34b850ac4d8aef01390f0f4d728377fc4acb221bb4d8a"

	I0930 10:23:16.862855   11632 cri.go:89] found id: ""

	I0930 10:23:16.862865   11632 logs.go:276] 1 containers: [43d1e8f87adc2e8166f34b850ac4d8aef01390f0f4d728377fc4acb221bb4d8a]

	I0930 10:23:16.862932   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:23:16.867449   11632 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0930 10:23:16.867527   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0930 10:23:16.912021   11632 cri.go:89] found id: "a74a16e467338b2244bb2e40eb7c60cb62762cfdb8e283e14ccadc3cc2833486"

	I0930 10:23:16.912056   11632 cri.go:89] found id: ""

	I0930 10:23:16.912067   11632 logs.go:276] 1 containers: [a74a16e467338b2244bb2e40eb7c60cb62762cfdb8e283e14ccadc3cc2833486]

	I0930 10:23:16.912119   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:23:16.916458   11632 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0930 10:23:16.916520   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0930 10:23:16.964191   11632 cri.go:89] found id: "9f19b165e1ee88685c466320c590be992ef4ee96f4de3b21a9bc9822a53d0535"

	I0930 10:23:16.964217   11632 cri.go:89] found id: ""

	I0930 10:23:16.964226   11632 logs.go:276] 1 containers: [9f19b165e1ee88685c466320c590be992ef4ee96f4de3b21a9bc9822a53d0535]

	I0930 10:23:16.964276   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:23:16.968601   11632 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0930 10:23:16.968683   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0930 10:23:17.012765   11632 cri.go:89] found id: "0fcbc0b59bd98544aec10dbb57ea4f1aa9462224e7e89d089b2f1daa88ca09c6"

	I0930 10:23:17.012798   11632 cri.go:89] found id: ""

	I0930 10:23:17.012807   11632 logs.go:276] 1 containers: [0fcbc0b59bd98544aec10dbb57ea4f1aa9462224e7e89d089b2f1daa88ca09c6]

	I0930 10:23:17.012869   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:23:17.017101   11632 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0930 10:23:17.017170   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0930 10:23:17.070801   11632 cri.go:89] found id: "97032ac69af1ce8c88a837f83e156a405e8a3051e5534676f90e35c468ec4c7c"

	I0930 10:23:17.070828   11632 cri.go:89] found id: ""

	I0930 10:23:17.070836   11632 logs.go:276] 1 containers: [97032ac69af1ce8c88a837f83e156a405e8a3051e5534676f90e35c468ec4c7c]

	I0930 10:23:17.070891   11632 ssh_runner.go:195] Run: which crictl

	I0930 10:23:17.076559   11632 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0930 10:23:17.076630   11632 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0930 10:23:17.121465   11632 cri.go:89] found id: ""

	I0930 10:23:17.121499   11632 logs.go:276] 0 containers: []

	W0930 10:23:17.121510   11632 logs.go:278] No container was found matching "kindnet"

	I0930 10:23:17.121523   11632 logs.go:123] Gathering logs for dmesg ...

	I0930 10:23:17.121538   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0930 10:23:17.138580   11632 logs.go:123] Gathering logs for describe nodes ...

	I0930 10:23:17.138614   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0930 10:23:17.309512   11632 logs.go:123] Gathering logs for kube-apiserver [329f2855c369d1ab3a6f4f0909651f908db3cef3d91e70309661d46153650a72] ...

	I0930 10:23:17.309542   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 329f2855c369d1ab3a6f4f0909651f908db3cef3d91e70309661d46153650a72"

	I0930 10:23:17.370578   11632 logs.go:123] Gathering logs for coredns [a74a16e467338b2244bb2e40eb7c60cb62762cfdb8e283e14ccadc3cc2833486] ...

	I0930 10:23:17.370611   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a74a16e467338b2244bb2e40eb7c60cb62762cfdb8e283e14ccadc3cc2833486"

	I0930 10:23:17.420804   11632 logs.go:123] Gathering logs for kube-scheduler [9f19b165e1ee88685c466320c590be992ef4ee96f4de3b21a9bc9822a53d0535] ...

	I0930 10:23:17.420833   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9f19b165e1ee88685c466320c590be992ef4ee96f4de3b21a9bc9822a53d0535"

	I0930 10:23:17.480757   11632 logs.go:123] Gathering logs for kube-controller-manager [97032ac69af1ce8c88a837f83e156a405e8a3051e5534676f90e35c468ec4c7c] ...

	I0930 10:23:17.480787   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 97032ac69af1ce8c88a837f83e156a405e8a3051e5534676f90e35c468ec4c7c"

	I0930 10:23:17.559189   11632 logs.go:123] Gathering logs for container status ...

	I0930 10:23:17.559234   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0930 10:23:17.621668   11632 logs.go:123] Gathering logs for kubelet ...

	I0930 10:23:17.621697   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W0930 10:23:17.680680   11632 logs.go:138] Found kubelet problem: Sep 30 10:21:30 addons-967811 kubelet[1213]: W0930 10:21:30.846407    1213 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:addons-967811" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-967811' and this object

	W0930 10:23:17.680859   11632 logs.go:138] Found kubelet problem: Sep 30 10:21:30 addons-967811 kubelet[1213]: E0930 10:21:30.846466    1213 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:addons-967811\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'addons-967811' and this object" logger="UnhandledError"

	W0930 10:23:17.687047   11632 logs.go:138] Found kubelet problem: Sep 30 10:21:37 addons-967811 kubelet[1213]: W0930 10:21:37.918989    1213 reflector.go:561] object-"gadget"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-967811" cannot list resource "configmaps" in API group "" in the namespace "gadget": no relationship found between node 'addons-967811' and this object

	W0930 10:23:17.687217   11632 logs.go:138] Found kubelet problem: Sep 30 10:21:37 addons-967811 kubelet[1213]: E0930 10:21:37.919030    1213 reflector.go:158] "Unhandled Error" err="object-\"gadget\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-967811\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"gadget\": no relationship found between node 'addons-967811' and this object" logger="UnhandledError"

	I0930 10:23:17.714218   11632 logs.go:123] Gathering logs for etcd [43d1e8f87adc2e8166f34b850ac4d8aef01390f0f4d728377fc4acb221bb4d8a] ...

	I0930 10:23:17.714246   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43d1e8f87adc2e8166f34b850ac4d8aef01390f0f4d728377fc4acb221bb4d8a"

	I0930 10:23:17.785766   11632 logs.go:123] Gathering logs for kube-proxy [0fcbc0b59bd98544aec10dbb57ea4f1aa9462224e7e89d089b2f1daa88ca09c6] ...

	I0930 10:23:17.785802   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0fcbc0b59bd98544aec10dbb57ea4f1aa9462224e7e89d089b2f1daa88ca09c6"

	I0930 10:23:17.822986   11632 logs.go:123] Gathering logs for CRI-O ...

	I0930 10:23:17.823010   11632 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:109: out/minikube-linux-amd64 start -p addons-967811 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns failed: signal: killed

--- FAIL: TestAddons/Setup (2400.05s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-linux-amd64 -p ha-033260 node stop m02 -v=7 --alsologtostderr

E0930 11:15:59.041066   11009 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/functional-020284/client.crt: no such file or directory" logger="UnhandledError"

E0930 11:16:40.002973   11009 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/functional-020284/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-033260 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.477290086s)

-- stdout --

	* Stopping node "ha-033260-m02"  ...

-- /stdout --

** stderr ** 

	I0930 11:15:55.698692   31004 out.go:345] Setting OutFile to fd 1 ...

	I0930 11:15:55.698859   31004 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 11:15:55.698872   31004 out.go:358] Setting ErrFile to fd 2...

	I0930 11:15:55.698879   31004 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 11:15:55.699187   31004 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19734-3842/.minikube/bin

	I0930 11:15:55.699535   31004 mustload.go:65] Loading cluster: ha-033260

	I0930 11:15:55.700097   31004 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:15:55.700116   31004 stop.go:39] StopHost: ha-033260-m02

	I0930 11:15:55.700500   31004 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:15:55.700565   31004 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:15:55.716326   31004 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40471

	I0930 11:15:55.716766   31004 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:15:55.717400   31004 main.go:141] libmachine: Using API Version  1

	I0930 11:15:55.717423   31004 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:15:55.717780   31004 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:15:55.720211   31004 out.go:177] * Stopping node "ha-033260-m02"  ...

	I0930 11:15:55.721423   31004 machine.go:156] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I0930 11:15:55.721464   31004 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:15:55.721750   31004 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I0930 11:15:55.721797   31004 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:15:55.724658   31004 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:15:55.725107   31004 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:15:55.725132   31004 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:15:55.725295   31004 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:15:55.725459   31004 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:15:55.725599   31004 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:15:55.725824   31004 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:15:55.815614   31004 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I0930 11:15:55.871550   31004 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I0930 11:15:55.927217   31004 main.go:141] libmachine: Stopping "ha-033260-m02"...

	I0930 11:15:55.927248   31004 main.go:141] libmachine: (ha-033260-m02) Calling .GetState

	I0930 11:15:55.928649   31004 main.go:141] libmachine: (ha-033260-m02) Calling .Stop

	I0930 11:15:55.932252   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 0/120

	I0930 11:15:56.933711   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 1/120

	I0930 11:15:57.935017   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 2/120

	I0930 11:15:58.936632   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 3/120

	I0930 11:15:59.937895   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 4/120

	I0930 11:16:00.940124   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 5/120

	I0930 11:16:01.941425   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 6/120

	I0930 11:16:02.942760   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 7/120

	I0930 11:16:03.944332   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 8/120

	I0930 11:16:04.945873   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 9/120

	I0930 11:16:05.948316   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 10/120

	I0930 11:16:06.950392   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 11/120

	I0930 11:16:07.952200   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 12/120

	I0930 11:16:08.953532   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 13/120

	I0930 11:16:09.955026   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 14/120

	I0930 11:16:10.957012   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 15/120

	I0930 11:16:11.958278   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 16/120

	I0930 11:16:12.960214   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 17/120

	I0930 11:16:13.961662   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 18/120

	I0930 11:16:14.963270   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 19/120

	I0930 11:16:15.965153   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 20/120

	I0930 11:16:16.966475   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 21/120

	I0930 11:16:17.967919   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 22/120

	I0930 11:16:18.969652   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 23/120

	I0930 11:16:19.971414   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 24/120

	I0930 11:16:20.973586   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 25/120

	I0930 11:16:21.975323   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 26/120

	I0930 11:16:22.976954   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 27/120

	I0930 11:16:23.978353   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 28/120

	I0930 11:16:24.980248   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 29/120

	I0930 11:16:25.982876   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 30/120

	I0930 11:16:26.984346   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 31/120

	I0930 11:16:27.985716   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 32/120

	I0930 11:16:28.987715   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 33/120

	I0930 11:16:29.989183   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 34/120

	I0930 11:16:30.990755   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 35/120

	I0930 11:16:31.992048   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 36/120

	I0930 11:16:32.993338   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 37/120

	I0930 11:16:33.994746   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 38/120

	I0930 11:16:34.996145   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 39/120

	I0930 11:16:35.997544   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 40/120

	I0930 11:16:36.998860   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 41/120

	I0930 11:16:38.000226   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 42/120

	I0930 11:16:39.001659   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 43/120

	I0930 11:16:40.003187   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 44/120

	I0930 11:16:41.005099   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 45/120

	I0930 11:16:42.006622   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 46/120

	I0930 11:16:43.008107   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 47/120

	I0930 11:16:44.009508   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 48/120

	I0930 11:16:45.011040   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 49/120

	I0930 11:16:46.013129   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 50/120

	I0930 11:16:47.015103   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 51/120

	I0930 11:16:48.016336   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 52/120

	I0930 11:16:49.017790   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 53/120

	I0930 11:16:50.019129   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 54/120

	I0930 11:16:51.021209   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 55/120

	I0930 11:16:52.022791   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 56/120

	I0930 11:16:53.024341   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 57/120

	I0930 11:16:54.025807   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 58/120

	I0930 11:16:55.027920   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 59/120

	I0930 11:16:56.029265   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 60/120

	I0930 11:16:57.030638   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 61/120

	I0930 11:16:58.031969   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 62/120

	I0930 11:16:59.033354   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 63/120

	I0930 11:17:00.035149   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 64/120

	I0930 11:17:01.037067   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 65/120

	I0930 11:17:02.038772   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 66/120

	I0930 11:17:03.040300   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 67/120

	I0930 11:17:04.041816   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 68/120

	I0930 11:17:05.044163   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 69/120

	I0930 11:17:06.046439   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 70/120

	I0930 11:17:07.047819   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 71/120

	I0930 11:17:08.049308   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 72/120

	I0930 11:17:09.051746   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 73/120

	I0930 11:17:10.053630   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 74/120

	I0930 11:17:11.055431   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 75/120

	I0930 11:17:12.057541   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 76/120

	I0930 11:17:13.059884   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 77/120

	I0930 11:17:14.061186   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 78/120

	I0930 11:17:15.062795   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 79/120

	I0930 11:17:16.065071   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 80/120

	I0930 11:17:17.066822   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 81/120

	I0930 11:17:18.068204   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 82/120

	I0930 11:17:19.069733   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 83/120

	I0930 11:17:20.071100   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 84/120

	I0930 11:17:21.073480   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 85/120

	I0930 11:17:22.075658   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 86/120

	I0930 11:17:23.077182   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 87/120

	I0930 11:17:24.078719   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 88/120

	I0930 11:17:25.080155   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 89/120

	I0930 11:17:26.082625   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 90/120

	I0930 11:17:27.084412   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 91/120

	I0930 11:17:28.086586   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 92/120

	I0930 11:17:29.088208   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 93/120

	I0930 11:17:30.089469   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 94/120

	I0930 11:17:31.091411   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 95/120

	I0930 11:17:32.093536   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 96/120

	I0930 11:17:33.094938   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 97/120

	I0930 11:17:34.096250   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 98/120

	I0930 11:17:35.097503   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 99/120

	I0930 11:17:36.099774   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 100/120

	I0930 11:17:37.101249   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 101/120

	I0930 11:17:38.102637   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 102/120

	I0930 11:17:39.104103   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 103/120

	I0930 11:17:40.105583   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 104/120

	I0930 11:17:41.107936   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 105/120

	I0930 11:17:42.109203   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 106/120

	I0930 11:17:43.110716   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 107/120

	I0930 11:17:44.112147   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 108/120

	I0930 11:17:45.113542   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 109/120

	I0930 11:17:46.115808   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 110/120

	I0930 11:17:47.117340   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 111/120

	I0930 11:17:48.118920   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 112/120

	I0930 11:17:49.120179   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 113/120

	I0930 11:17:50.122122   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 114/120

	I0930 11:17:51.124123   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 115/120

	I0930 11:17:52.125726   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 116/120

	I0930 11:17:53.126967   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 117/120

	I0930 11:17:54.128635   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 118/120

	I0930 11:17:55.130387   31004 main.go:141] libmachine: (ha-033260-m02) Waiting for machine to stop 119/120

	I0930 11:17:56.131316   31004 stop.go:66] stop err: unable to stop vm, current state "Running"

	W0930 11:17:56.131553   31004 out.go:270] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-033260 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:369: (dbg) Run:  out/minikube-linux-amd64 -p ha-033260 status -v=7 --alsologtostderr

E0930 11:18:01.925928   11009 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/functional-020284/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:369: (dbg) Done: out/minikube-linux-amd64 -p ha-033260 status -v=7 --alsologtostderr: (18.750388806s)

ha_test.go:375: status says not all three control-plane nodes are present: args "out/minikube-linux-amd64 -p ha-033260 status -v=7 --alsologtostderr": 

ha_test.go:378: status says not three hosts are running: args "out/minikube-linux-amd64 -p ha-033260 status -v=7 --alsologtostderr": 

ha_test.go:381: status says not three kubelets are running: args "out/minikube-linux-amd64 -p ha-033260 status -v=7 --alsologtostderr": 

ha_test.go:384: status says not two apiservers are running: args "out/minikube-linux-amd64 -p ha-033260 status -v=7 --alsologtostderr": 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-033260 -n ha-033260

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-033260 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-033260 logs -n 25: (1.418895356s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3040784691/001/cp-test_ha-033260-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260:/home/docker/cp-test_ha-033260-m03_ha-033260.txt                       |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260 sudo cat                                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m03_ha-033260.txt                                 |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m02:/home/docker/cp-test_ha-033260-m03_ha-033260-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m02 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m03_ha-033260-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04:/home/docker/cp-test_ha-033260-m03_ha-033260-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m04 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m03_ha-033260-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-033260 cp testdata/cp-test.txt                                                | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3040784691/001/cp-test_ha-033260-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260:/home/docker/cp-test_ha-033260-m04_ha-033260.txt                       |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260 sudo cat                                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m04_ha-033260.txt                                 |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m02:/home/docker/cp-test_ha-033260-m04_ha-033260-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m02 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m04_ha-033260-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03:/home/docker/cp-test_ha-033260-m04_ha-033260-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m03 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m04_ha-033260-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-033260 node stop m02 -v=7                                                     | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/30 11:11:16

	Running on machine: ubuntu-20-agent-15

	Binary: Built with gc go1.23.0 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0930 11:11:16.968147   26946 out.go:345] Setting OutFile to fd 1 ...

	I0930 11:11:16.968259   26946 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 11:11:16.968268   26946 out.go:358] Setting ErrFile to fd 2...

	I0930 11:11:16.968272   26946 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 11:11:16.968475   26946 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19734-3842/.minikube/bin

	I0930 11:11:16.969014   26946 out.go:352] Setting JSON to false

	I0930 11:11:16.969874   26946 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":3224,"bootTime":1727691453,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0930 11:11:16.969971   26946 start.go:139] virtualization: kvm guest

	I0930 11:11:16.972340   26946 out.go:177] * [ha-033260] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	I0930 11:11:16.973700   26946 notify.go:220] Checking for updates...

	I0930 11:11:16.973712   26946 out.go:177]   - MINIKUBE_LOCATION=19734

	I0930 11:11:16.975164   26946 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0930 11:11:16.976567   26946 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:11:16.977791   26946 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:11:16.978971   26946 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0930 11:11:16.980151   26946 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0930 11:11:16.981437   26946 driver.go:394] Setting default libvirt URI to qemu:///system

	I0930 11:11:17.016837   26946 out.go:177] * Using the kvm2 driver based on user configuration

	I0930 11:11:17.017911   26946 start.go:297] selected driver: kvm2

	I0930 11:11:17.017921   26946 start.go:901] validating driver "kvm2" against <nil>

	I0930 11:11:17.017932   26946 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0930 11:11:17.018657   26946 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0930 11:11:17.018742   26946 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19734-3842/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0930 11:11:17.034306   26946 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0

	I0930 11:11:17.034349   26946 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0930 11:11:17.034586   26946 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 11:11:17.034614   26946 cni.go:84] Creating CNI manager for ""

	I0930 11:11:17.034651   26946 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0930 11:11:17.034662   26946 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0930 11:11:17.034717   26946 start.go:340] cluster config:

	{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0930 11:11:17.034818   26946 iso.go:125] acquiring lock: {Name:mk95ca253939a7801a8ba4db8c15a1a3ab4169e5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0930 11:11:17.036732   26946 out.go:177] * Starting "ha-033260" primary control-plane node in "ha-033260" cluster

	I0930 11:11:17.037780   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:11:17.037816   26946 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4

	I0930 11:11:17.037823   26946 cache.go:56] Caching tarball of preloaded images

	I0930 11:11:17.037892   26946 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 11:11:17.037903   26946 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 11:11:17.038215   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:11:17.038236   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json: {Name:mkb40a3a18f0ab7d52c306f0204aa0e145307acc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:17.038367   26946 start.go:360] acquireMachinesLock for ha-033260: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 11:11:17.038394   26946 start.go:364] duration metric: took 15.009µs to acquireMachinesLock for "ha-033260"

	I0930 11:11:17.038414   26946 start.go:93] Provisioning new machine with config: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:11:17.038466   26946 start.go:125] createHost starting for "" (driver="kvm2")

	I0930 11:11:17.039863   26946 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0930 11:11:17.039975   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:11:17.040024   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:11:17.054681   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36539

	I0930 11:11:17.055106   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:11:17.055654   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:11:17.055673   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:11:17.056010   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:11:17.056264   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:17.056403   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:17.056571   26946 start.go:159] libmachine.API.Create for "ha-033260" (driver="kvm2")

	I0930 11:11:17.056596   26946 client.go:168] LocalClient.Create starting

	I0930 11:11:17.056623   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 11:11:17.056664   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:11:17.056676   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:11:17.056725   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 11:11:17.056743   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:11:17.056752   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:11:17.056765   26946 main.go:141] libmachine: Running pre-create checks...

	I0930 11:11:17.056773   26946 main.go:141] libmachine: (ha-033260) Calling .PreCreateCheck

	I0930 11:11:17.057093   26946 main.go:141] libmachine: (ha-033260) Calling .GetConfigRaw

	I0930 11:11:17.057527   26946 main.go:141] libmachine: Creating machine...

	I0930 11:11:17.057540   26946 main.go:141] libmachine: (ha-033260) Calling .Create

	I0930 11:11:17.057672   26946 main.go:141] libmachine: (ha-033260) Creating KVM machine...

	I0930 11:11:17.058923   26946 main.go:141] libmachine: (ha-033260) DBG | found existing default KVM network

	I0930 11:11:17.059559   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.059428   26970 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015b90}

	I0930 11:11:17.059596   26946 main.go:141] libmachine: (ha-033260) DBG | created network xml: 

	I0930 11:11:17.059615   26946 main.go:141] libmachine: (ha-033260) DBG | <network>

	I0930 11:11:17.059621   26946 main.go:141] libmachine: (ha-033260) DBG |   <name>mk-ha-033260</name>

	I0930 11:11:17.059629   26946 main.go:141] libmachine: (ha-033260) DBG |   <dns enable='no'/>

	I0930 11:11:17.059635   26946 main.go:141] libmachine: (ha-033260) DBG |   

	I0930 11:11:17.059640   26946 main.go:141] libmachine: (ha-033260) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0930 11:11:17.059646   26946 main.go:141] libmachine: (ha-033260) DBG |     <dhcp>

	I0930 11:11:17.059651   26946 main.go:141] libmachine: (ha-033260) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0930 11:11:17.059658   26946 main.go:141] libmachine: (ha-033260) DBG |     </dhcp>

	I0930 11:11:17.059663   26946 main.go:141] libmachine: (ha-033260) DBG |   </ip>

	I0930 11:11:17.059667   26946 main.go:141] libmachine: (ha-033260) DBG |   

	I0930 11:11:17.059673   26946 main.go:141] libmachine: (ha-033260) DBG | </network>

	I0930 11:11:17.059679   26946 main.go:141] libmachine: (ha-033260) DBG | 

	I0930 11:11:17.064624   26946 main.go:141] libmachine: (ha-033260) DBG | trying to create private KVM network mk-ha-033260 192.168.39.0/24...

	I0930 11:11:17.128145   26946 main.go:141] libmachine: (ha-033260) DBG | private KVM network mk-ha-033260 192.168.39.0/24 created

	I0930 11:11:17.128172   26946 main.go:141] libmachine: (ha-033260) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260 ...

	I0930 11:11:17.128183   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.128100   26970 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:11:17.128201   26946 main.go:141] libmachine: (ha-033260) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 11:11:17.128218   26946 main.go:141] libmachine: (ha-033260) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 11:11:17.365994   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.365804   26970 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa...

	I0930 11:11:17.493008   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.492862   26970 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/ha-033260.rawdisk...

	I0930 11:11:17.493034   26946 main.go:141] libmachine: (ha-033260) DBG | Writing magic tar header

	I0930 11:11:17.493046   26946 main.go:141] libmachine: (ha-033260) DBG | Writing SSH key tar header

	I0930 11:11:17.493053   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.492975   26970 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260 ...

	I0930 11:11:17.493066   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260

	I0930 11:11:17.493124   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260 (perms=drwx------)

	I0930 11:11:17.493158   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 11:11:17.493173   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 11:11:17.493181   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 11:11:17.493193   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 11:11:17.493202   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 11:11:17.493226   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:11:17.493246   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 11:11:17.493258   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 11:11:17.493264   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 11:11:17.493275   26946 main.go:141] libmachine: (ha-033260) Creating domain...

	I0930 11:11:17.493280   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins

	I0930 11:11:17.493286   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home

	I0930 11:11:17.493291   26946 main.go:141] libmachine: (ha-033260) DBG | Skipping /home - not owner

	I0930 11:11:17.494319   26946 main.go:141] libmachine: (ha-033260) define libvirt domain using xml: 

	I0930 11:11:17.494340   26946 main.go:141] libmachine: (ha-033260) <domain type='kvm'>

	I0930 11:11:17.494347   26946 main.go:141] libmachine: (ha-033260)   <name>ha-033260</name>

	I0930 11:11:17.494351   26946 main.go:141] libmachine: (ha-033260)   <memory unit='MiB'>2200</memory>

	I0930 11:11:17.494356   26946 main.go:141] libmachine: (ha-033260)   <vcpu>2</vcpu>

	I0930 11:11:17.494359   26946 main.go:141] libmachine: (ha-033260)   <features>

	I0930 11:11:17.494365   26946 main.go:141] libmachine: (ha-033260)     <acpi/>

	I0930 11:11:17.494370   26946 main.go:141] libmachine: (ha-033260)     <apic/>

	I0930 11:11:17.494377   26946 main.go:141] libmachine: (ha-033260)     <pae/>

	I0930 11:11:17.494399   26946 main.go:141] libmachine: (ha-033260)     

	I0930 11:11:17.494410   26946 main.go:141] libmachine: (ha-033260)   </features>

	I0930 11:11:17.494415   26946 main.go:141] libmachine: (ha-033260)   <cpu mode='host-passthrough'>

	I0930 11:11:17.494422   26946 main.go:141] libmachine: (ha-033260)   

	I0930 11:11:17.494425   26946 main.go:141] libmachine: (ha-033260)   </cpu>

	I0930 11:11:17.494429   26946 main.go:141] libmachine: (ha-033260)   <os>

	I0930 11:11:17.494433   26946 main.go:141] libmachine: (ha-033260)     <type>hvm</type>

	I0930 11:11:17.494461   26946 main.go:141] libmachine: (ha-033260)     <boot dev='cdrom'/>

	I0930 11:11:17.494487   26946 main.go:141] libmachine: (ha-033260)     <boot dev='hd'/>

	I0930 11:11:17.494498   26946 main.go:141] libmachine: (ha-033260)     <bootmenu enable='no'/>

	I0930 11:11:17.494504   26946 main.go:141] libmachine: (ha-033260)   </os>

	I0930 11:11:17.494511   26946 main.go:141] libmachine: (ha-033260)   <devices>

	I0930 11:11:17.494518   26946 main.go:141] libmachine: (ha-033260)     <disk type='file' device='cdrom'>

	I0930 11:11:17.494529   26946 main.go:141] libmachine: (ha-033260)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/boot2docker.iso'/>

	I0930 11:11:17.494540   26946 main.go:141] libmachine: (ha-033260)       <target dev='hdc' bus='scsi'/>

	I0930 11:11:17.494547   26946 main.go:141] libmachine: (ha-033260)       <readonly/>

	I0930 11:11:17.494558   26946 main.go:141] libmachine: (ha-033260)     </disk>

	I0930 11:11:17.494568   26946 main.go:141] libmachine: (ha-033260)     <disk type='file' device='disk'>

	I0930 11:11:17.494579   26946 main.go:141] libmachine: (ha-033260)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 11:11:17.494592   26946 main.go:141] libmachine: (ha-033260)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/ha-033260.rawdisk'/>

	I0930 11:11:17.494603   26946 main.go:141] libmachine: (ha-033260)       <target dev='hda' bus='virtio'/>

	I0930 11:11:17.494611   26946 main.go:141] libmachine: (ha-033260)     </disk>

	I0930 11:11:17.494625   26946 main.go:141] libmachine: (ha-033260)     <interface type='network'>

	I0930 11:11:17.494636   26946 main.go:141] libmachine: (ha-033260)       <source network='mk-ha-033260'/>

	I0930 11:11:17.494646   26946 main.go:141] libmachine: (ha-033260)       <model type='virtio'/>

	I0930 11:11:17.494655   26946 main.go:141] libmachine: (ha-033260)     </interface>

	I0930 11:11:17.494664   26946 main.go:141] libmachine: (ha-033260)     <interface type='network'>

	I0930 11:11:17.494672   26946 main.go:141] libmachine: (ha-033260)       <source network='default'/>

	I0930 11:11:17.494682   26946 main.go:141] libmachine: (ha-033260)       <model type='virtio'/>

	I0930 11:11:17.494731   26946 main.go:141] libmachine: (ha-033260)     </interface>

	I0930 11:11:17.494748   26946 main.go:141] libmachine: (ha-033260)     <serial type='pty'>

	I0930 11:11:17.494754   26946 main.go:141] libmachine: (ha-033260)       <target port='0'/>

	I0930 11:11:17.494763   26946 main.go:141] libmachine: (ha-033260)     </serial>

	I0930 11:11:17.494791   26946 main.go:141] libmachine: (ha-033260)     <console type='pty'>

	I0930 11:11:17.494813   26946 main.go:141] libmachine: (ha-033260)       <target type='serial' port='0'/>

	I0930 11:11:17.494833   26946 main.go:141] libmachine: (ha-033260)     </console>

	I0930 11:11:17.494851   26946 main.go:141] libmachine: (ha-033260)     <rng model='virtio'>

	I0930 11:11:17.494868   26946 main.go:141] libmachine: (ha-033260)       <backend model='random'>/dev/random</backend>

	I0930 11:11:17.494879   26946 main.go:141] libmachine: (ha-033260)     </rng>

	I0930 11:11:17.494884   26946 main.go:141] libmachine: (ha-033260)     

	I0930 11:11:17.494894   26946 main.go:141] libmachine: (ha-033260)     

	I0930 11:11:17.494900   26946 main.go:141] libmachine: (ha-033260)   </devices>

	I0930 11:11:17.494910   26946 main.go:141] libmachine: (ha-033260) </domain>

	I0930 11:11:17.494919   26946 main.go:141] libmachine: (ha-033260) 

	I0930 11:11:17.499284   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:1e:fd:d9 in network default

	I0930 11:11:17.499904   26946 main.go:141] libmachine: (ha-033260) Ensuring networks are active...

	I0930 11:11:17.499920   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:17.500618   26946 main.go:141] libmachine: (ha-033260) Ensuring network default is active

	I0930 11:11:17.501042   26946 main.go:141] libmachine: (ha-033260) Ensuring network mk-ha-033260 is active

	I0930 11:11:17.501643   26946 main.go:141] libmachine: (ha-033260) Getting domain xml...

	I0930 11:11:17.502369   26946 main.go:141] libmachine: (ha-033260) Creating domain...

	I0930 11:11:18.692089   26946 main.go:141] libmachine: (ha-033260) Waiting to get IP...

	I0930 11:11:18.692860   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:18.693297   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:18.693313   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:18.693260   26970 retry.go:31] will retry after 231.51107ms: waiting for machine to come up

	I0930 11:11:18.926878   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:18.927339   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:18.927367   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:18.927281   26970 retry.go:31] will retry after 238.29389ms: waiting for machine to come up

	I0930 11:11:19.167097   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:19.167813   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:19.167841   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:19.167759   26970 retry.go:31] will retry after 304.46036ms: waiting for machine to come up

	I0930 11:11:19.474179   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:19.474648   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:19.474678   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:19.474604   26970 retry.go:31] will retry after 472.499674ms: waiting for machine to come up

	I0930 11:11:19.948108   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:19.948622   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:19.948649   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:19.948597   26970 retry.go:31] will retry after 645.07677ms: waiting for machine to come up

	I0930 11:11:20.595504   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:20.595963   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:20.595984   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:20.595941   26970 retry.go:31] will retry after 894.966176ms: waiting for machine to come up

	I0930 11:11:21.492428   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:21.492831   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:21.492882   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:21.492814   26970 retry.go:31] will retry after 848.859093ms: waiting for machine to come up

	I0930 11:11:22.343403   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:22.343835   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:22.343861   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:22.343753   26970 retry.go:31] will retry after 1.05973931s: waiting for machine to come up

	I0930 11:11:23.404961   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:23.405359   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:23.405385   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:23.405316   26970 retry.go:31] will retry after 1.638432323s: waiting for machine to come up

	I0930 11:11:25.046055   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:25.046452   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:25.046477   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:25.046405   26970 retry.go:31] will retry after 2.080958051s: waiting for machine to come up

	I0930 11:11:27.128708   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:27.129133   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:27.129156   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:27.129053   26970 retry.go:31] will retry after 2.256414995s: waiting for machine to come up

	I0930 11:11:29.387356   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:29.387768   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:29.387788   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:29.387745   26970 retry.go:31] will retry after 3.372456281s: waiting for machine to come up

	I0930 11:11:32.761875   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:32.762235   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:32.762254   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:32.762202   26970 retry.go:31] will retry after 3.757571385s: waiting for machine to come up

	I0930 11:11:36.524130   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:36.524597   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:36.524613   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:36.524548   26970 retry.go:31] will retry after 4.081097536s: waiting for machine to come up

	I0930 11:11:40.609929   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.610386   26946 main.go:141] libmachine: (ha-033260) Found IP for machine: 192.168.39.249

	I0930 11:11:40.610415   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has current primary IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.610423   26946 main.go:141] libmachine: (ha-033260) Reserving static IP address...

	I0930 11:11:40.610796   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find host DHCP lease matching {name: "ha-033260", mac: "52:54:00:b0:2e:07", ip: "192.168.39.249"} in network mk-ha-033260

	I0930 11:11:40.682058   26946 main.go:141] libmachine: (ha-033260) DBG | Getting to WaitForSSH function...

	I0930 11:11:40.682112   26946 main.go:141] libmachine: (ha-033260) Reserved static IP address: 192.168.39.249

	I0930 11:11:40.682151   26946 main.go:141] libmachine: (ha-033260) Waiting for SSH to be available...

	I0930 11:11:40.684625   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.684964   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:minikube Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:40.684990   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.685088   26946 main.go:141] libmachine: (ha-033260) DBG | Using SSH client type: external

	I0930 11:11:40.685108   26946 main.go:141] libmachine: (ha-033260) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa (-rw-------)

	I0930 11:11:40.685155   26946 main.go:141] libmachine: (ha-033260) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.249 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:11:40.685168   26946 main.go:141] libmachine: (ha-033260) DBG | About to run SSH command:

	I0930 11:11:40.685196   26946 main.go:141] libmachine: (ha-033260) DBG | exit 0

	I0930 11:11:40.813832   26946 main.go:141] libmachine: (ha-033260) DBG | SSH cmd err, output: <nil>: 

	I0930 11:11:40.814089   26946 main.go:141] libmachine: (ha-033260) KVM machine creation complete!

	I0930 11:11:40.814483   26946 main.go:141] libmachine: (ha-033260) Calling .GetConfigRaw

	I0930 11:11:40.815001   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:40.815218   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:40.815362   26946 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 11:11:40.815373   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:11:40.816691   26946 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 11:11:40.816703   26946 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 11:11:40.816707   26946 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 11:11:40.816712   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:40.818838   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.819210   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:40.819240   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.819306   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:40.819465   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.819601   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.819739   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:40.819883   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:40.820061   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:40.820071   26946 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 11:11:40.929008   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:11:40.929033   26946 main.go:141] libmachine: Detecting the provisioner...

	I0930 11:11:40.929040   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:40.931913   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.932264   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:40.932308   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.932448   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:40.932679   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.932816   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.932931   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:40.933122   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:40.933283   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:40.933295   26946 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 11:11:41.042597   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 11:11:41.042675   26946 main.go:141] libmachine: found compatible host: buildroot

	I0930 11:11:41.042682   26946 main.go:141] libmachine: Provisioning with buildroot...

	I0930 11:11:41.042689   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:41.042906   26946 buildroot.go:166] provisioning hostname "ha-033260"

	I0930 11:11:41.042918   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:41.043088   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.045281   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.045591   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.045634   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.045749   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.045916   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.046048   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.046166   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.046324   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:41.046537   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:41.046554   26946 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-033260 && echo "ha-033260" | sudo tee /etc/hostname

	I0930 11:11:41.173460   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-033260

	I0930 11:11:41.173489   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.176142   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.176483   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.176513   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.176659   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.176845   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.176984   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.177110   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.177285   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:41.177443   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:41.177458   26946 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-033260' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-033260/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-033260' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 11:11:41.295471   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:11:41.295501   26946 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 11:11:41.295523   26946 buildroot.go:174] setting up certificates

	I0930 11:11:41.295535   26946 provision.go:84] configureAuth start

	I0930 11:11:41.295560   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:41.295824   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:41.298508   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.298844   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.298871   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.299011   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.301187   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.301504   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.301529   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.301674   26946 provision.go:143] copyHostCerts

	I0930 11:11:41.301701   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:11:41.301735   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem, removing ...

	I0930 11:11:41.301744   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:11:41.301807   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 11:11:41.301895   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:11:41.301913   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem, removing ...

	I0930 11:11:41.301919   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:11:41.301944   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 11:11:41.301997   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:11:41.302013   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem, removing ...

	I0930 11:11:41.302019   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:11:41.302039   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 11:11:41.302094   26946 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.ha-033260 san=[127.0.0.1 192.168.39.249 ha-033260 localhost minikube]

	I0930 11:11:41.595618   26946 provision.go:177] copyRemoteCerts

	I0930 11:11:41.595675   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 11:11:41.595700   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.598644   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.599092   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.599122   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.599308   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.599628   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.599809   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.599990   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:41.686253   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0930 11:11:41.686348   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 11:11:41.716396   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0930 11:11:41.716470   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0930 11:11:41.741350   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0930 11:11:41.741426   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0930 11:11:41.765879   26946 provision.go:87] duration metric: took 470.33102ms to configureAuth

	I0930 11:11:41.765904   26946 buildroot.go:189] setting minikube options for container-runtime

	I0930 11:11:41.766073   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:11:41.766153   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.768846   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.769139   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.769163   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.769350   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.769573   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.769751   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.769867   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.770004   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:41.770154   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:41.770171   26946 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 11:11:41.997580   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 11:11:41.997603   26946 main.go:141] libmachine: Checking connection to Docker...

	I0930 11:11:41.997612   26946 main.go:141] libmachine: (ha-033260) Calling .GetURL

	I0930 11:11:41.998809   26946 main.go:141] libmachine: (ha-033260) DBG | Using libvirt version 6000000

	I0930 11:11:42.000992   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.001367   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.001403   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.001552   26946 main.go:141] libmachine: Docker is up and running!

	I0930 11:11:42.001574   26946 main.go:141] libmachine: Reticulating splines...

	I0930 11:11:42.001580   26946 client.go:171] duration metric: took 24.944976164s to LocalClient.Create

	I0930 11:11:42.001599   26946 start.go:167] duration metric: took 24.945029476s to libmachine.API.Create "ha-033260"

	I0930 11:11:42.001605   26946 start.go:293] postStartSetup for "ha-033260" (driver="kvm2")

	I0930 11:11:42.001634   26946 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 11:11:42.001658   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.001903   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 11:11:42.001928   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.004137   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.004477   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.004506   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.004626   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.004785   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.004929   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.005073   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:42.088764   26946 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 11:11:42.093605   26946 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 11:11:42.093649   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 11:11:42.093718   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 11:11:42.093798   26946 filesync.go:149] local asset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> 110092.pem in /etc/ssl/certs

	I0930 11:11:42.093808   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /etc/ssl/certs/110092.pem

	I0930 11:11:42.093909   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0930 11:11:42.104383   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:11:42.133090   26946 start.go:296] duration metric: took 131.471881ms for postStartSetup

	I0930 11:11:42.133135   26946 main.go:141] libmachine: (ha-033260) Calling .GetConfigRaw

	I0930 11:11:42.133732   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:42.136141   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.136473   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.136492   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.136788   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:11:42.136956   26946 start.go:128] duration metric: took 25.09848122s to createHost

	I0930 11:11:42.136975   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.139440   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.139825   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.139853   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.139989   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.140175   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.140334   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.140446   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.140582   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:42.140793   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:42.140810   26946 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 11:11:42.250567   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727694702.228135172

	I0930 11:11:42.250590   26946 fix.go:216] guest clock: 1727694702.228135172

	I0930 11:11:42.250600   26946 fix.go:229] Guest: 2024-09-30 11:11:42.228135172 +0000 UTC Remote: 2024-09-30 11:11:42.136966335 +0000 UTC m=+25.202018114 (delta=91.168837ms)

	I0930 11:11:42.250654   26946 fix.go:200] guest clock delta is within tolerance: 91.168837ms

	I0930 11:11:42.250662   26946 start.go:83] releasing machines lock for "ha-033260", held for 25.21225918s

	I0930 11:11:42.250689   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.250959   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:42.253937   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.254263   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.254291   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.254395   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.254873   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.255071   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.255171   26946 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 11:11:42.255230   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.255277   26946 ssh_runner.go:195] Run: cat /version.json

	I0930 11:11:42.255305   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.257775   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258072   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258098   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.258117   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258247   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.258399   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.258499   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.258530   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258550   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.258636   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.258725   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:42.258782   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.258905   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.259023   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:42.338949   26946 ssh_runner.go:195] Run: systemctl --version

	I0930 11:11:42.367977   26946 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 11:11:42.529658   26946 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 11:11:42.535739   26946 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 11:11:42.535805   26946 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 11:11:42.553004   26946 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 11:11:42.553029   26946 start.go:495] detecting cgroup driver to use...

	I0930 11:11:42.553101   26946 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 11:11:42.571333   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 11:11:42.586474   26946 docker.go:217] disabling cri-docker service (if available) ...

	I0930 11:11:42.586529   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 11:11:42.600562   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 11:11:42.614592   26946 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 11:11:42.724714   26946 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 11:11:42.863957   26946 docker.go:233] disabling docker service ...

	I0930 11:11:42.864016   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 11:11:42.878829   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 11:11:42.892519   26946 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 11:11:43.031759   26946 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 11:11:43.156228   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 11:11:43.171439   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 11:11:43.190694   26946 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 11:11:43.190806   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.201572   26946 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 11:11:43.201660   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.212771   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.224198   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.235643   26946 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 11:11:43.247521   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.258652   26946 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.276825   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.288336   26946 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 11:11:43.299367   26946 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 11:11:43.299422   26946 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 11:11:43.314057   26946 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 11:11:43.324403   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:11:43.446606   26946 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 11:11:43.543986   26946 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 11:11:43.544064   26946 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 11:11:43.548794   26946 start.go:563] Will wait 60s for crictl version

	I0930 11:11:43.548857   26946 ssh_runner.go:195] Run: which crictl

	I0930 11:11:43.552827   26946 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 11:11:43.593000   26946 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 11:11:43.593096   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:11:43.624593   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:11:43.654845   26946 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 11:11:43.656217   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:43.658636   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:43.658956   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:43.658982   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:43.659236   26946 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 11:11:43.663528   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:11:43.677810   26946 kubeadm.go:883] updating cluster {Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Cl

usterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0930 11:11:43.677905   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:11:43.677950   26946 ssh_runner.go:195] Run: sudo crictl images --output json

	I0930 11:11:43.712140   26946 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.31.1". assuming images are not preloaded.

	I0930 11:11:43.712231   26946 ssh_runner.go:195] Run: which lz4

	I0930 11:11:43.716210   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0930 11:11:43.716286   26946 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0930 11:11:43.720372   26946 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0930 11:11:43.720397   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (388599353 bytes)

	I0930 11:11:45.117936   26946 crio.go:462] duration metric: took 1.401668541s to copy over tarball

	I0930 11:11:45.118009   26946 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0930 11:11:47.123971   26946 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.00593624s)

	I0930 11:11:47.124002   26946 crio.go:469] duration metric: took 2.006037646s to extract the tarball

	I0930 11:11:47.124011   26946 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0930 11:11:47.161484   26946 ssh_runner.go:195] Run: sudo crictl images --output json

	I0930 11:11:47.208444   26946 crio.go:514] all images are preloaded for cri-o runtime.

	I0930 11:11:47.208468   26946 cache_images.go:84] Images are preloaded, skipping loading

	I0930 11:11:47.208475   26946 kubeadm.go:934] updating node { 192.168.39.249 8443 v1.31.1 crio true true} ...

	I0930 11:11:47.208561   26946 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-033260 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.249

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 11:11:47.208632   26946 ssh_runner.go:195] Run: crio config

	I0930 11:11:47.256652   26946 cni.go:84] Creating CNI manager for ""

	I0930 11:11:47.256671   26946 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0930 11:11:47.256679   26946 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0930 11:11:47.256700   26946 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.249 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-033260 NodeName:ha-033260 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.249"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.249 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0930 11:11:47.256808   26946 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.249

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-033260"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.249

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.249"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0930 11:11:47.256829   26946 kube-vip.go:115] generating kube-vip config ...

	I0930 11:11:47.256866   26946 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0930 11:11:47.273274   26946 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0930 11:11:47.273411   26946 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0930 11:11:47.273489   26946 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 11:11:47.284468   26946 binaries.go:44] Found k8s binaries, skipping transfer

	I0930 11:11:47.284546   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0930 11:11:47.295086   26946 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0930 11:11:47.313062   26946 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 11:11:47.330490   26946 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0930 11:11:47.348148   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0930 11:11:47.364645   26946 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0930 11:11:47.368788   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:11:47.381517   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:11:47.516902   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:11:47.535500   26946 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260 for IP: 192.168.39.249

	I0930 11:11:47.535531   26946 certs.go:194] generating shared ca certs ...

	I0930 11:11:47.535554   26946 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.535745   26946 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 11:11:47.535819   26946 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 11:11:47.535836   26946 certs.go:256] generating profile certs ...

	I0930 11:11:47.535916   26946 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key

	I0930 11:11:47.535947   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt with IP's: []

	I0930 11:11:47.718587   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt ...

	I0930 11:11:47.718617   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt: {Name:mkef0c2b538ff6ec90e4096f6b30d2cc62a0498b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.718785   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key ...

	I0930 11:11:47.718795   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key: {Name:mk0bf4d552829907727733b9f23a1e78046426c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.718864   26946 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf

	I0930 11:11:47.718878   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.249 192.168.39.254]

	I0930 11:11:47.993565   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf ...

	I0930 11:11:47.993602   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf: {Name:mk8d827ffc338aba548bc3df464e9e04ae838b07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.993789   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf ...

	I0930 11:11:47.993807   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf: {Name:mka275015927a8ca9f533558d637ec2560f5b41f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.993887   26946 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt

	I0930 11:11:47.993965   26946 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key

	I0930 11:11:47.994041   26946 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key

	I0930 11:11:47.994059   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt with IP's: []

	I0930 11:11:48.098988   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt ...

	I0930 11:11:48.099020   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt: {Name:mk7106fd4af523e8a328dae6580fd1ecc34c18b9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:48.099178   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key ...

	I0930 11:11:48.099189   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key: {Name:mka3dbe7128ec5d469ec7906155af8e6e7cc2725 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:48.099265   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0930 11:11:48.099283   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0930 11:11:48.099294   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0930 11:11:48.099304   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0930 11:11:48.099314   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0930 11:11:48.099324   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0930 11:11:48.099333   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0930 11:11:48.099342   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0930 11:11:48.099385   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem (1338 bytes)

	W0930 11:11:48.099425   26946 certs.go:480] ignoring /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009_empty.pem, impossibly tiny 0 bytes

	I0930 11:11:48.099434   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 11:11:48.099457   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 11:11:48.099481   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 11:11:48.099502   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 11:11:48.099537   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:11:48.099561   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.099574   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.099592   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem -> /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.100091   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 11:11:48.126879   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 11:11:48.153722   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 11:11:48.179797   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 11:11:48.205074   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0930 11:11:48.230272   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0930 11:11:48.255030   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 11:11:48.279850   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 11:11:48.306723   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /usr/share/ca-certificates/110092.pem (1708 bytes)

	I0930 11:11:48.332995   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 11:11:48.363646   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem --> /usr/share/ca-certificates/11009.pem (1338 bytes)

	I0930 11:11:48.392223   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0930 11:11:48.410336   26946 ssh_runner.go:195] Run: openssl version

	I0930 11:11:48.416506   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110092.pem && ln -fs /usr/share/ca-certificates/110092.pem /etc/ssl/certs/110092.pem"

	I0930 11:11:48.428642   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.433601   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 30 11:01 /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.433673   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.439817   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110092.pem /etc/ssl/certs/3ec20f2e.0"

	I0930 11:11:48.451918   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 11:11:48.464282   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.469211   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.469276   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.475319   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 11:11:48.487558   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009.pem && ln -fs /usr/share/ca-certificates/11009.pem /etc/ssl/certs/11009.pem"

	I0930 11:11:48.500151   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.505278   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 30 11:01 /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.505355   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.511924   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11009.pem /etc/ssl/certs/51391683.0"

	I0930 11:11:48.525201   26946 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 11:11:48.529960   26946 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 11:11:48.530014   26946 kubeadm.go:392] StartCluster: {Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Clust

erName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 11:11:48.530081   26946 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0930 11:11:48.530129   26946 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0930 11:11:48.568913   26946 cri.go:89] found id: ""

	I0930 11:11:48.568975   26946 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0930 11:11:48.580292   26946 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0930 11:11:48.593494   26946 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0930 11:11:48.606006   26946 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0930 11:11:48.606037   26946 kubeadm.go:157] found existing configuration files:

	I0930 11:11:48.606079   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0930 11:11:48.615784   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0930 11:11:48.615855   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0930 11:11:48.626018   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0930 11:11:48.635953   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0930 11:11:48.636032   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0930 11:11:48.646292   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0930 11:11:48.657605   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0930 11:11:48.657679   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0930 11:11:48.669154   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0930 11:11:48.680279   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0930 11:11:48.680348   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0930 11:11:48.691798   26946 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0930 11:11:48.797903   26946 kubeadm.go:310] W0930 11:11:48.782166     830 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0930 11:11:48.798931   26946 kubeadm.go:310] W0930 11:11:48.783291     830 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0930 11:11:48.907657   26946 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0930 11:12:00.116285   26946 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1

	I0930 11:12:00.116363   26946 kubeadm.go:310] [preflight] Running pre-flight checks

	I0930 11:12:00.116459   26946 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0930 11:12:00.116597   26946 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0930 11:12:00.116728   26946 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0930 11:12:00.116817   26946 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0930 11:12:00.118253   26946 out.go:235]   - Generating certificates and keys ...

	I0930 11:12:00.118344   26946 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0930 11:12:00.118441   26946 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0930 11:12:00.118536   26946 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0930 11:12:00.118621   26946 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0930 11:12:00.118710   26946 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0930 11:12:00.118780   26946 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0930 11:12:00.118849   26946 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0930 11:12:00.118971   26946 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-033260 localhost] and IPs [192.168.39.249 127.0.0.1 ::1]

	I0930 11:12:00.119022   26946 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0930 11:12:00.119113   26946 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-033260 localhost] and IPs [192.168.39.249 127.0.0.1 ::1]

	I0930 11:12:00.119209   26946 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0930 11:12:00.119261   26946 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0930 11:12:00.119300   26946 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0930 11:12:00.119361   26946 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0930 11:12:00.119418   26946 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0930 11:12:00.119463   26946 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0930 11:12:00.119517   26946 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0930 11:12:00.119604   26946 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0930 11:12:00.119657   26946 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0930 11:12:00.119721   26946 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0930 11:12:00.119813   26946 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0930 11:12:00.121972   26946 out.go:235]   - Booting up control plane ...

	I0930 11:12:00.122077   26946 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0930 11:12:00.122168   26946 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0930 11:12:00.122257   26946 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0930 11:12:00.122354   26946 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0930 11:12:00.122445   26946 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0930 11:12:00.122493   26946 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0930 11:12:00.122632   26946 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0930 11:12:00.122746   26946 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0930 11:12:00.122807   26946 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.002277963s

	I0930 11:12:00.122866   26946 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0930 11:12:00.122914   26946 kubeadm.go:310] [api-check] The API server is healthy after 5.817139259s

	I0930 11:12:00.123017   26946 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0930 11:12:00.123126   26946 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0930 11:12:00.123189   26946 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0930 11:12:00.123373   26946 kubeadm.go:310] [mark-control-plane] Marking the node ha-033260 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0930 11:12:00.123455   26946 kubeadm.go:310] [bootstrap-token] Using token: mglnbr.4ysxjyfx6ulvufry

	I0930 11:12:00.124695   26946 out.go:235]   - Configuring RBAC rules ...

	I0930 11:12:00.124816   26946 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0930 11:12:00.124888   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0930 11:12:00.125008   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0930 11:12:00.125123   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0930 11:12:00.125226   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0930 11:12:00.125300   26946 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0930 11:12:00.125399   26946 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0930 11:12:00.125438   26946 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0930 11:12:00.125482   26946 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0930 11:12:00.125488   26946 kubeadm.go:310] 

	I0930 11:12:00.125543   26946 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0930 11:12:00.125548   26946 kubeadm.go:310] 

	I0930 11:12:00.125627   26946 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0930 11:12:00.125640   26946 kubeadm.go:310] 

	I0930 11:12:00.125667   26946 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0930 11:12:00.125722   26946 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0930 11:12:00.125765   26946 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0930 11:12:00.125771   26946 kubeadm.go:310] 

	I0930 11:12:00.125822   26946 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0930 11:12:00.125832   26946 kubeadm.go:310] 

	I0930 11:12:00.125875   26946 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0930 11:12:00.125882   26946 kubeadm.go:310] 

	I0930 11:12:00.125945   26946 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0930 11:12:00.126010   26946 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0930 11:12:00.126068   26946 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0930 11:12:00.126073   26946 kubeadm.go:310] 

	I0930 11:12:00.126141   26946 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0930 11:12:00.126212   26946 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0930 11:12:00.126219   26946 kubeadm.go:310] 

	I0930 11:12:00.126299   26946 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token mglnbr.4ysxjyfx6ulvufry \

	I0930 11:12:00.126384   26946 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 \

	I0930 11:12:00.126404   26946 kubeadm.go:310] 	--control-plane 

	I0930 11:12:00.126410   26946 kubeadm.go:310] 

	I0930 11:12:00.126493   26946 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0930 11:12:00.126501   26946 kubeadm.go:310] 

	I0930 11:12:00.126563   26946 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token mglnbr.4ysxjyfx6ulvufry \

	I0930 11:12:00.126653   26946 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 

	I0930 11:12:00.126666   26946 cni.go:84] Creating CNI manager for ""

	I0930 11:12:00.126671   26946 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0930 11:12:00.128070   26946 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0930 11:12:00.129234   26946 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0930 11:12:00.134944   26946 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...

	I0930 11:12:00.134960   26946 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)

	I0930 11:12:00.155333   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0930 11:12:00.530346   26946 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0930 11:12:00.530478   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-033260 minikube.k8s.io/updated_at=2024_09_30T11_12_00_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=ha-033260 minikube.k8s.io/primary=true

	I0930 11:12:00.530486   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:00.762071   26946 ops.go:34] apiserver oom_adj: -16

	I0930 11:12:00.762161   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:01.262836   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:01.762341   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:02.262939   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:02.762594   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:03.263292   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:03.762877   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:03.861166   26946 kubeadm.go:1113] duration metric: took 3.330735229s to wait for elevateKubeSystemPrivileges

	I0930 11:12:03.861207   26946 kubeadm.go:394] duration metric: took 15.331194175s to StartCluster

	I0930 11:12:03.861229   26946 settings.go:142] acquiring lock: {Name:mkdbb7ee3f4e112a79c58917f833dfd72cc7c3b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:03.861306   26946 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:12:03.861899   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/kubeconfig: {Name:mkbcc26962ad9a46a600e5f0a5facf24bf9d408d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:03.862096   26946 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:03.862109   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0930 11:12:03.862128   26946 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0930 11:12:03.862180   26946 addons.go:69] Setting storage-provisioner=true in profile "ha-033260"

	I0930 11:12:03.862192   26946 addons.go:234] Setting addon storage-provisioner=true in "ha-033260"

	I0930 11:12:03.862117   26946 start.go:241] waiting for startup goroutines ...

	I0930 11:12:03.862217   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:03.862220   26946 addons.go:69] Setting default-storageclass=true in profile "ha-033260"

	I0930 11:12:03.862242   26946 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-033260"

	I0930 11:12:03.862318   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:03.862546   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.862579   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.862640   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.862674   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.878311   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44373

	I0930 11:12:03.878524   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38709

	I0930 11:12:03.878793   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.878956   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.879296   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.879311   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.879437   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.879458   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.879666   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.879878   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.880063   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:03.880274   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.880317   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.882311   26946 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:12:03.882615   26946 kapi.go:59] client config for ha-033260: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt", KeyFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key", CAFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1f685c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0930 11:12:03.883117   26946 cert_rotation.go:140] Starting client certificate rotation controller

	I0930 11:12:03.883340   26946 addons.go:234] Setting addon default-storageclass=true in "ha-033260"

	I0930 11:12:03.883377   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:03.883734   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.883774   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.895612   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39339

	I0930 11:12:03.896182   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.896686   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.896706   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.897041   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.897263   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:03.899125   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:03.899133   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42283

	I0930 11:12:03.899601   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.900021   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.900036   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.900378   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.901008   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.901054   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.901205   26946 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0930 11:12:03.902407   26946 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0930 11:12:03.902428   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0930 11:12:03.902445   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:03.905497   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.906023   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:03.906045   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.906199   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:03.906396   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:03.906554   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:03.906702   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:03.917103   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34553

	I0930 11:12:03.917557   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.918124   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.918149   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.918507   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.918675   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:03.920302   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:03.920506   26946 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0930 11:12:03.920522   26946 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0930 11:12:03.920544   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:03.923151   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.923529   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:03.923552   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.923700   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:03.923867   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:03.923995   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:03.924108   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:03.981471   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0930 11:12:04.090970   26946 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0930 11:12:04.120632   26946 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0930 11:12:04.535542   26946 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0930 11:12:04.535597   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.535614   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.535906   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.535923   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.535937   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.535938   26946 main.go:141] libmachine: (ha-033260) DBG | Closing plugin on server side

	I0930 11:12:04.535945   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.536174   26946 main.go:141] libmachine: (ha-033260) DBG | Closing plugin on server side

	I0930 11:12:04.536192   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.536203   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.536265   26946 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false

	I0930 11:12:04.536288   26946 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false

	I0930 11:12:04.536378   26946 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0930 11:12:04.536387   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:04.536394   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:04.536397   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:04.616635   26946 round_trippers.go:574] Response Status: 200 OK in 80 milliseconds

	I0930 11:12:04.617143   26946 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0930 11:12:04.617157   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:04.617164   26946 round_trippers.go:473]     Content-Type: application/json

	I0930 11:12:04.617168   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:04.617171   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:04.644304   26946 round_trippers.go:574] Response Status: 200 OK in 27 milliseconds

	I0930 11:12:04.644577   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.644596   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.644880   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.644899   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.839773   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.839805   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.840111   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.840131   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.840140   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.840149   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.840370   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.840384   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.841979   26946 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0930 11:12:04.843256   26946 addons.go:510] duration metric: took 981.127437ms for enable addons: enabled=[default-storageclass storage-provisioner]

	I0930 11:12:04.843295   26946 start.go:246] waiting for cluster config update ...

	I0930 11:12:04.843309   26946 start.go:255] writing updated cluster config ...

	I0930 11:12:04.844944   26946 out.go:201] 

	I0930 11:12:04.846458   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:04.846524   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:12:04.848060   26946 out.go:177] * Starting "ha-033260-m02" control-plane node in "ha-033260" cluster

	I0930 11:12:04.849158   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:12:04.849179   26946 cache.go:56] Caching tarball of preloaded images

	I0930 11:12:04.849280   26946 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 11:12:04.849291   26946 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 11:12:04.849355   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:12:04.849507   26946 start.go:360] acquireMachinesLock for ha-033260-m02: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 11:12:04.849551   26946 start.go:364] duration metric: took 26.46µs to acquireMachinesLock for "ha-033260-m02"

	I0930 11:12:04.849567   26946 start.go:93] Provisioning new machine with config: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:04.849642   26946 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0930 11:12:04.851226   26946 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0930 11:12:04.851326   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:04.851360   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:04.866966   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34227

	I0930 11:12:04.867433   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:04.867975   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:04.867995   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:04.868336   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:04.868557   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:04.868710   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:04.868858   26946 start.go:159] libmachine.API.Create for "ha-033260" (driver="kvm2")

	I0930 11:12:04.868889   26946 client.go:168] LocalClient.Create starting

	I0930 11:12:04.868923   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 11:12:04.868957   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:12:04.868973   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:12:04.869023   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 11:12:04.869042   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:12:04.869052   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:12:04.869078   26946 main.go:141] libmachine: Running pre-create checks...

	I0930 11:12:04.869093   26946 main.go:141] libmachine: (ha-033260-m02) Calling .PreCreateCheck

	I0930 11:12:04.869253   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetConfigRaw

	I0930 11:12:04.869711   26946 main.go:141] libmachine: Creating machine...

	I0930 11:12:04.869724   26946 main.go:141] libmachine: (ha-033260-m02) Calling .Create

	I0930 11:12:04.869845   26946 main.go:141] libmachine: (ha-033260-m02) Creating KVM machine...

	I0930 11:12:04.871091   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found existing default KVM network

	I0930 11:12:04.871157   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found existing private KVM network mk-ha-033260

	I0930 11:12:04.871294   26946 main.go:141] libmachine: (ha-033260-m02) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02 ...

	I0930 11:12:04.871318   26946 main.go:141] libmachine: (ha-033260-m02) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 11:12:04.871364   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:04.871284   27323 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:12:04.871439   26946 main.go:141] libmachine: (ha-033260-m02) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 11:12:05.099309   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:05.099139   27323 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa...

	I0930 11:12:05.396113   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:05.395976   27323 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/ha-033260-m02.rawdisk...

	I0930 11:12:05.396137   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Writing magic tar header

	I0930 11:12:05.396150   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Writing SSH key tar header

	I0930 11:12:05.396161   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:05.396084   27323 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02 ...

	I0930 11:12:05.396175   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02

	I0930 11:12:05.396200   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02 (perms=drwx------)

	I0930 11:12:05.396209   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 11:12:05.396245   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 11:12:05.396258   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 11:12:05.396269   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 11:12:05.396285   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 11:12:05.396302   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 11:12:05.396315   26946 main.go:141] libmachine: (ha-033260-m02) Creating domain...

	I0930 11:12:05.396331   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:12:05.396348   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 11:12:05.396365   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 11:12:05.396376   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins

	I0930 11:12:05.396390   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home

	I0930 11:12:05.396400   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Skipping /home - not owner

	I0930 11:12:05.397208   26946 main.go:141] libmachine: (ha-033260-m02) define libvirt domain using xml: 

	I0930 11:12:05.397237   26946 main.go:141] libmachine: (ha-033260-m02) <domain type='kvm'>

	I0930 11:12:05.397248   26946 main.go:141] libmachine: (ha-033260-m02)   <name>ha-033260-m02</name>

	I0930 11:12:05.397259   26946 main.go:141] libmachine: (ha-033260-m02)   <memory unit='MiB'>2200</memory>

	I0930 11:12:05.397267   26946 main.go:141] libmachine: (ha-033260-m02)   <vcpu>2</vcpu>

	I0930 11:12:05.397273   26946 main.go:141] libmachine: (ha-033260-m02)   <features>

	I0930 11:12:05.397282   26946 main.go:141] libmachine: (ha-033260-m02)     <acpi/>

	I0930 11:12:05.397289   26946 main.go:141] libmachine: (ha-033260-m02)     <apic/>

	I0930 11:12:05.397297   26946 main.go:141] libmachine: (ha-033260-m02)     <pae/>

	I0930 11:12:05.397306   26946 main.go:141] libmachine: (ha-033260-m02)     

	I0930 11:12:05.397314   26946 main.go:141] libmachine: (ha-033260-m02)   </features>

	I0930 11:12:05.397321   26946 main.go:141] libmachine: (ha-033260-m02)   <cpu mode='host-passthrough'>

	I0930 11:12:05.397329   26946 main.go:141] libmachine: (ha-033260-m02)   

	I0930 11:12:05.397335   26946 main.go:141] libmachine: (ha-033260-m02)   </cpu>

	I0930 11:12:05.397359   26946 main.go:141] libmachine: (ha-033260-m02)   <os>

	I0930 11:12:05.397379   26946 main.go:141] libmachine: (ha-033260-m02)     <type>hvm</type>

	I0930 11:12:05.397384   26946 main.go:141] libmachine: (ha-033260-m02)     <boot dev='cdrom'/>

	I0930 11:12:05.397391   26946 main.go:141] libmachine: (ha-033260-m02)     <boot dev='hd'/>

	I0930 11:12:05.397407   26946 main.go:141] libmachine: (ha-033260-m02)     <bootmenu enable='no'/>

	I0930 11:12:05.397419   26946 main.go:141] libmachine: (ha-033260-m02)   </os>

	I0930 11:12:05.397427   26946 main.go:141] libmachine: (ha-033260-m02)   <devices>

	I0930 11:12:05.397438   26946 main.go:141] libmachine: (ha-033260-m02)     <disk type='file' device='cdrom'>

	I0930 11:12:05.397450   26946 main.go:141] libmachine: (ha-033260-m02)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/boot2docker.iso'/>

	I0930 11:12:05.397461   26946 main.go:141] libmachine: (ha-033260-m02)       <target dev='hdc' bus='scsi'/>

	I0930 11:12:05.397468   26946 main.go:141] libmachine: (ha-033260-m02)       <readonly/>

	I0930 11:12:05.397480   26946 main.go:141] libmachine: (ha-033260-m02)     </disk>

	I0930 11:12:05.397492   26946 main.go:141] libmachine: (ha-033260-m02)     <disk type='file' device='disk'>

	I0930 11:12:05.397501   26946 main.go:141] libmachine: (ha-033260-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 11:12:05.397518   26946 main.go:141] libmachine: (ha-033260-m02)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/ha-033260-m02.rawdisk'/>

	I0930 11:12:05.397528   26946 main.go:141] libmachine: (ha-033260-m02)       <target dev='hda' bus='virtio'/>

	I0930 11:12:05.397538   26946 main.go:141] libmachine: (ha-033260-m02)     </disk>

	I0930 11:12:05.397548   26946 main.go:141] libmachine: (ha-033260-m02)     <interface type='network'>

	I0930 11:12:05.397565   26946 main.go:141] libmachine: (ha-033260-m02)       <source network='mk-ha-033260'/>

	I0930 11:12:05.397579   26946 main.go:141] libmachine: (ha-033260-m02)       <model type='virtio'/>

	I0930 11:12:05.397590   26946 main.go:141] libmachine: (ha-033260-m02)     </interface>

	I0930 11:12:05.397605   26946 main.go:141] libmachine: (ha-033260-m02)     <interface type='network'>

	I0930 11:12:05.397627   26946 main.go:141] libmachine: (ha-033260-m02)       <source network='default'/>

	I0930 11:12:05.397641   26946 main.go:141] libmachine: (ha-033260-m02)       <model type='virtio'/>

	I0930 11:12:05.397651   26946 main.go:141] libmachine: (ha-033260-m02)     </interface>

	I0930 11:12:05.397663   26946 main.go:141] libmachine: (ha-033260-m02)     <serial type='pty'>

	I0930 11:12:05.397672   26946 main.go:141] libmachine: (ha-033260-m02)       <target port='0'/>

	I0930 11:12:05.397683   26946 main.go:141] libmachine: (ha-033260-m02)     </serial>

	I0930 11:12:05.397693   26946 main.go:141] libmachine: (ha-033260-m02)     <console type='pty'>

	I0930 11:12:05.397702   26946 main.go:141] libmachine: (ha-033260-m02)       <target type='serial' port='0'/>

	I0930 11:12:05.397716   26946 main.go:141] libmachine: (ha-033260-m02)     </console>

	I0930 11:12:05.397728   26946 main.go:141] libmachine: (ha-033260-m02)     <rng model='virtio'>

	I0930 11:12:05.397739   26946 main.go:141] libmachine: (ha-033260-m02)       <backend model='random'>/dev/random</backend>

	I0930 11:12:05.397750   26946 main.go:141] libmachine: (ha-033260-m02)     </rng>

	I0930 11:12:05.397758   26946 main.go:141] libmachine: (ha-033260-m02)     

	I0930 11:12:05.397766   26946 main.go:141] libmachine: (ha-033260-m02)     

	I0930 11:12:05.397771   26946 main.go:141] libmachine: (ha-033260-m02)   </devices>

	I0930 11:12:05.397781   26946 main.go:141] libmachine: (ha-033260-m02) </domain>

	I0930 11:12:05.397794   26946 main.go:141] libmachine: (ha-033260-m02) 

	I0930 11:12:05.404924   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:91:42:82 in network default

	I0930 11:12:05.405500   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:05.405515   26946 main.go:141] libmachine: (ha-033260-m02) Ensuring networks are active...

	I0930 11:12:05.406422   26946 main.go:141] libmachine: (ha-033260-m02) Ensuring network default is active

	I0930 11:12:05.406717   26946 main.go:141] libmachine: (ha-033260-m02) Ensuring network mk-ha-033260 is active

	I0930 11:12:05.407099   26946 main.go:141] libmachine: (ha-033260-m02) Getting domain xml...

	I0930 11:12:05.407766   26946 main.go:141] libmachine: (ha-033260-m02) Creating domain...

	I0930 11:12:06.665629   26946 main.go:141] libmachine: (ha-033260-m02) Waiting to get IP...

	I0930 11:12:06.666463   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:06.666923   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:06.666983   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:06.666914   27323 retry.go:31] will retry after 236.292128ms: waiting for machine to come up

	I0930 11:12:06.904458   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:06.904973   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:06.905008   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:06.904946   27323 retry.go:31] will retry after 373.72215ms: waiting for machine to come up

	I0930 11:12:07.280653   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:07.281148   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:07.281167   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:07.281127   27323 retry.go:31] will retry after 417.615707ms: waiting for machine to come up

	I0930 11:12:07.700723   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:07.701173   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:07.701199   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:07.701130   27323 retry.go:31] will retry after 495.480397ms: waiting for machine to come up

	I0930 11:12:08.198698   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:08.199207   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:08.199236   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:08.199183   27323 retry.go:31] will retry after 541.395524ms: waiting for machine to come up

	I0930 11:12:08.742190   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:08.742786   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:08.742812   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:08.742737   27323 retry.go:31] will retry after 711.22134ms: waiting for machine to come up

	I0930 11:12:09.455685   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:09.456147   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:09.456172   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:09.456119   27323 retry.go:31] will retry after 1.042420332s: waiting for machine to come up

	I0930 11:12:10.499804   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:10.500316   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:10.500353   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:10.500299   27323 retry.go:31] will retry after 1.048379902s: waiting for machine to come up

	I0930 11:12:11.550177   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:11.550587   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:11.550616   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:11.550525   27323 retry.go:31] will retry after 1.84570983s: waiting for machine to come up

	I0930 11:12:13.397532   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:13.398027   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:13.398052   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:13.397980   27323 retry.go:31] will retry after 1.566549945s: waiting for machine to come up

	I0930 11:12:14.966467   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:14.966938   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:14.966983   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:14.966914   27323 retry.go:31] will retry after 1.814424901s: waiting for machine to come up

	I0930 11:12:16.783827   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:16.784216   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:16.784247   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:16.784177   27323 retry.go:31] will retry after 3.594354669s: waiting for machine to come up

	I0930 11:12:20.380537   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:20.380935   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:20.380960   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:20.380904   27323 retry.go:31] will retry after 3.199139157s: waiting for machine to come up

	I0930 11:12:23.582795   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:23.583206   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:23.583227   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:23.583181   27323 retry.go:31] will retry after 5.054668279s: waiting for machine to come up

	I0930 11:12:28.639867   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.640504   26946 main.go:141] libmachine: (ha-033260-m02) Found IP for machine: 192.168.39.3

	I0930 11:12:28.640526   26946 main.go:141] libmachine: (ha-033260-m02) Reserving static IP address...

	I0930 11:12:28.640539   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has current primary IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.641001   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find host DHCP lease matching {name: "ha-033260-m02", mac: "52:54:00:31:8f:e1", ip: "192.168.39.3"} in network mk-ha-033260

	I0930 11:12:28.722236   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Getting to WaitForSSH function...

	I0930 11:12:28.722267   26946 main.go:141] libmachine: (ha-033260-m02) Reserved static IP address: 192.168.39.3

	I0930 11:12:28.722280   26946 main.go:141] libmachine: (ha-033260-m02) Waiting for SSH to be available...

	I0930 11:12:28.724853   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.725241   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:minikube Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:28.725265   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.725515   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Using SSH client type: external

	I0930 11:12:28.725540   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa (-rw-------)

	I0930 11:12:28.725576   26946 main.go:141] libmachine: (ha-033260-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.3 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:12:28.725598   26946 main.go:141] libmachine: (ha-033260-m02) DBG | About to run SSH command:

	I0930 11:12:28.725610   26946 main.go:141] libmachine: (ha-033260-m02) DBG | exit 0

	I0930 11:12:28.854399   26946 main.go:141] libmachine: (ha-033260-m02) DBG | SSH cmd err, output: <nil>: 

	I0930 11:12:28.854625   26946 main.go:141] libmachine: (ha-033260-m02) KVM machine creation complete!

	I0930 11:12:28.855272   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetConfigRaw

	I0930 11:12:28.855866   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:28.856047   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:28.856170   26946 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 11:12:28.856182   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetState

	I0930 11:12:28.857578   26946 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 11:12:28.857593   26946 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 11:12:28.857600   26946 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 11:12:28.857606   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:28.859889   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.860246   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:28.860279   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.860438   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:28.860622   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.860773   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.860913   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:28.861114   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:28.861325   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:28.861337   26946 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 11:12:28.973157   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:12:28.973184   26946 main.go:141] libmachine: Detecting the provisioner...

	I0930 11:12:28.973195   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:28.976106   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.976500   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:28.976531   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.976798   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:28.977021   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.977185   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.977339   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:28.977493   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:28.977714   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:28.977727   26946 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 11:12:29.086855   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 11:12:29.086927   26946 main.go:141] libmachine: found compatible host: buildroot

	I0930 11:12:29.086937   26946 main.go:141] libmachine: Provisioning with buildroot...

	I0930 11:12:29.086951   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:29.087245   26946 buildroot.go:166] provisioning hostname "ha-033260-m02"

	I0930 11:12:29.087269   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:29.087463   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.090156   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.090525   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.090551   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.090676   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.090846   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.090986   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.091115   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.091289   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:29.091467   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:29.091479   26946 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-033260-m02 && echo "ha-033260-m02" | sudo tee /etc/hostname

	I0930 11:12:29.220174   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-033260-m02

	I0930 11:12:29.220204   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.223091   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.223537   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.223567   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.223724   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.223905   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.224048   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.224217   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.224385   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:29.224590   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:29.224614   26946 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-033260-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-033260-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-033260-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 11:12:29.343733   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:12:29.343767   26946 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 11:12:29.343787   26946 buildroot.go:174] setting up certificates

	I0930 11:12:29.343798   26946 provision.go:84] configureAuth start

	I0930 11:12:29.343811   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:29.344093   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:29.346631   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.346930   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.346956   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.347096   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.349248   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.349664   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.349689   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.349858   26946 provision.go:143] copyHostCerts

	I0930 11:12:29.349889   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:12:29.349936   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem, removing ...

	I0930 11:12:29.349948   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:12:29.350055   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 11:12:29.350156   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:12:29.350176   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem, removing ...

	I0930 11:12:29.350181   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:12:29.350207   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 11:12:29.350254   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:12:29.350271   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem, removing ...

	I0930 11:12:29.350277   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:12:29.350298   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 11:12:29.350347   26946 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.ha-033260-m02 san=[127.0.0.1 192.168.39.3 ha-033260-m02 localhost minikube]

	I0930 11:12:29.533329   26946 provision.go:177] copyRemoteCerts

	I0930 11:12:29.533387   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 11:12:29.533409   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.535946   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.536287   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.536327   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.536541   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.536745   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.536906   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.537054   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:29.625264   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0930 11:12:29.625353   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 11:12:29.651589   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0930 11:12:29.651644   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0930 11:12:29.677526   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0930 11:12:29.677634   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0930 11:12:29.708210   26946 provision.go:87] duration metric: took 364.395657ms to configureAuth

	I0930 11:12:29.708246   26946 buildroot.go:189] setting minikube options for container-runtime

	I0930 11:12:29.708446   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:29.708540   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.711111   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.711545   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.711578   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.711743   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.711914   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.712073   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.712191   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.712381   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:29.712587   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:29.712611   26946 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 11:12:29.956548   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 11:12:29.956576   26946 main.go:141] libmachine: Checking connection to Docker...

	I0930 11:12:29.956585   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetURL

	I0930 11:12:29.957861   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Using libvirt version 6000000

	I0930 11:12:29.959943   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.960349   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.960376   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.960589   26946 main.go:141] libmachine: Docker is up and running!

	I0930 11:12:29.960605   26946 main.go:141] libmachine: Reticulating splines...

	I0930 11:12:29.960611   26946 client.go:171] duration metric: took 25.091713434s to LocalClient.Create

	I0930 11:12:29.960635   26946 start.go:167] duration metric: took 25.091779085s to libmachine.API.Create "ha-033260"

	I0930 11:12:29.960649   26946 start.go:293] postStartSetup for "ha-033260-m02" (driver="kvm2")

	I0930 11:12:29.960663   26946 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 11:12:29.960682   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:29.960894   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 11:12:29.960921   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.962943   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.963366   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.963390   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.963547   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.963747   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.963887   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.963995   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:30.049684   26946 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 11:12:30.054345   26946 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 11:12:30.054373   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 11:12:30.054430   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 11:12:30.054507   26946 filesync.go:149] local asset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> 110092.pem in /etc/ssl/certs

	I0930 11:12:30.054516   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /etc/ssl/certs/110092.pem

	I0930 11:12:30.054592   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0930 11:12:30.064685   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:12:30.090069   26946 start.go:296] duration metric: took 129.405576ms for postStartSetup

	I0930 11:12:30.090127   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetConfigRaw

	I0930 11:12:30.090769   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:30.093475   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.093805   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.093836   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.094011   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:12:30.094269   26946 start.go:128] duration metric: took 25.244614564s to createHost

	I0930 11:12:30.094293   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:30.096188   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.096490   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.096524   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.096656   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:30.096825   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.096963   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.097093   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:30.097253   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:30.097426   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:30.097439   26946 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 11:12:30.206856   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727694750.184612585

	I0930 11:12:30.206885   26946 fix.go:216] guest clock: 1727694750.184612585

	I0930 11:12:30.206895   26946 fix.go:229] Guest: 2024-09-30 11:12:30.184612585 +0000 UTC Remote: 2024-09-30 11:12:30.094281951 +0000 UTC m=+73.159334041 (delta=90.330634ms)

	I0930 11:12:30.206915   26946 fix.go:200] guest clock delta is within tolerance: 90.330634ms

	I0930 11:12:30.206922   26946 start.go:83] releasing machines lock for "ha-033260-m02", held for 25.357361614s

	I0930 11:12:30.206944   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.207256   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:30.209590   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.209935   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.209964   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.212335   26946 out.go:177] * Found network options:

	I0930 11:12:30.213673   26946 out.go:177]   - NO_PROXY=192.168.39.249

	W0930 11:12:30.215021   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:12:30.215056   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.215673   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.215843   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.215938   26946 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 11:12:30.215976   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	W0930 11:12:30.215983   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:12:30.216054   26946 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 11:12:30.216075   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:30.218771   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.218983   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.219125   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.219147   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.219360   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:30.219434   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.219459   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.219516   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.219662   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:30.219670   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:30.219831   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.219846   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:30.219963   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:30.220088   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:30.454192   26946 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 11:12:30.462288   26946 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 11:12:30.462348   26946 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 11:12:30.479853   26946 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 11:12:30.479878   26946 start.go:495] detecting cgroup driver to use...

	I0930 11:12:30.479941   26946 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 11:12:30.496617   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 11:12:30.512078   26946 docker.go:217] disabling cri-docker service (if available) ...

	I0930 11:12:30.512142   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 11:12:30.526557   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 11:12:30.541136   26946 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 11:12:30.655590   26946 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 11:12:30.814049   26946 docker.go:233] disabling docker service ...

	I0930 11:12:30.814123   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 11:12:30.829972   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 11:12:30.844068   26946 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 11:12:30.969831   26946 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 11:12:31.096443   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 11:12:31.111612   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 11:12:31.131553   26946 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 11:12:31.131621   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.143596   26946 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 11:12:31.143658   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.156112   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.167422   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.179559   26946 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 11:12:31.192037   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.203507   26946 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.222188   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.234115   26946 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 11:12:31.245344   26946 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 11:12:31.245401   26946 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 11:12:31.259589   26946 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 11:12:31.269907   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:12:31.388443   26946 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 11:12:31.482864   26946 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 11:12:31.482933   26946 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 11:12:31.487957   26946 start.go:563] Will wait 60s for crictl version

	I0930 11:12:31.488026   26946 ssh_runner.go:195] Run: which crictl

	I0930 11:12:31.492173   26946 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 11:12:31.530740   26946 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 11:12:31.530821   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:12:31.560435   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:12:31.592377   26946 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 11:12:31.593888   26946 out.go:177]   - env NO_PROXY=192.168.39.249

	I0930 11:12:31.595254   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:31.598165   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:31.598504   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:31.598535   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:31.598710   26946 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 11:12:31.603081   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:12:31.616231   26946 mustload.go:65] Loading cluster: ha-033260

	I0930 11:12:31.616424   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:31.616676   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:31.616714   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:31.631793   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46637

	I0930 11:12:31.632254   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:31.632734   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:31.632757   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:31.633092   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:31.633272   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:31.634860   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:31.635130   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:31.635170   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:31.649687   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44627

	I0930 11:12:31.650053   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:31.650497   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:31.650520   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:31.650803   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:31.650951   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:31.651118   26946 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260 for IP: 192.168.39.3

	I0930 11:12:31.651130   26946 certs.go:194] generating shared ca certs ...

	I0930 11:12:31.651148   26946 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:31.651260   26946 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 11:12:31.651304   26946 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 11:12:31.651313   26946 certs.go:256] generating profile certs ...

	I0930 11:12:31.651410   26946 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key

	I0930 11:12:31.651435   26946 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87

	I0930 11:12:31.651449   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.249 192.168.39.3 192.168.39.254]

	I0930 11:12:31.912914   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87 ...

	I0930 11:12:31.912947   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87: {Name:mk5789d867ee86689334498533835b6baa525e2e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:31.913110   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87 ...

	I0930 11:12:31.913123   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87: {Name:mkcd56431095ebd059864bd581ed7c141670cf4a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:31.913195   26946 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt

	I0930 11:12:31.913335   26946 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key

	I0930 11:12:31.913463   26946 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key

	I0930 11:12:31.913478   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0930 11:12:31.913490   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0930 11:12:31.913500   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0930 11:12:31.913510   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0930 11:12:31.913520   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0930 11:12:31.913529   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0930 11:12:31.913539   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0930 11:12:31.913551   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0930 11:12:31.913591   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem (1338 bytes)

	W0930 11:12:31.913648   26946 certs.go:480] ignoring /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009_empty.pem, impossibly tiny 0 bytes

	I0930 11:12:31.913661   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 11:12:31.913690   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 11:12:31.913712   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 11:12:31.913735   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 11:12:31.913780   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:12:31.913806   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:31.913824   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem -> /usr/share/ca-certificates/11009.pem

	I0930 11:12:31.913836   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /usr/share/ca-certificates/110092.pem

	I0930 11:12:31.913865   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:31.917099   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:31.917453   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:31.917482   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:31.917675   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:31.917892   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:31.918041   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:31.918169   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:31.994019   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I0930 11:12:31.999621   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0930 11:12:32.012410   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I0930 11:12:32.017661   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0930 11:12:32.028991   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I0930 11:12:32.034566   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0930 11:12:32.047607   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I0930 11:12:32.052664   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0930 11:12:32.069473   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I0930 11:12:32.074705   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0930 11:12:32.086100   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I0930 11:12:32.090557   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0930 11:12:32.103048   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 11:12:32.132371   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 11:12:32.159806   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 11:12:32.185933   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 11:12:32.210826   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0930 11:12:32.236862   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0930 11:12:32.262441   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 11:12:32.289773   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 11:12:32.318287   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 11:12:32.347371   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem --> /usr/share/ca-certificates/11009.pem (1338 bytes)

	I0930 11:12:32.372327   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /usr/share/ca-certificates/110092.pem (1708 bytes)

	I0930 11:12:32.397781   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0930 11:12:32.415260   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0930 11:12:32.433137   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0930 11:12:32.450661   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0930 11:12:32.467444   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0930 11:12:32.484994   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0930 11:12:32.503412   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0930 11:12:32.522919   26946 ssh_runner.go:195] Run: openssl version

	I0930 11:12:32.529057   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 11:12:32.541643   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:32.546691   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:32.546753   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:32.553211   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 11:12:32.565054   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009.pem && ln -fs /usr/share/ca-certificates/11009.pem /etc/ssl/certs/11009.pem"

	I0930 11:12:32.576855   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009.pem

	I0930 11:12:32.581764   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 30 11:01 /usr/share/ca-certificates/11009.pem

	I0930 11:12:32.581818   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009.pem

	I0930 11:12:32.588983   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11009.pem /etc/ssl/certs/51391683.0"

	I0930 11:12:32.602082   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110092.pem && ln -fs /usr/share/ca-certificates/110092.pem /etc/ssl/certs/110092.pem"

	I0930 11:12:32.613340   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110092.pem

	I0930 11:12:32.617722   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 30 11:01 /usr/share/ca-certificates/110092.pem

	I0930 11:12:32.617775   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110092.pem

	I0930 11:12:32.623445   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110092.pem /etc/ssl/certs/3ec20f2e.0"

	I0930 11:12:32.635275   26946 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 11:12:32.639755   26946 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 11:12:32.639812   26946 kubeadm.go:934] updating node {m02 192.168.39.3 8443 v1.31.1 crio true true} ...

	I0930 11:12:32.639905   26946 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-033260-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.3

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 11:12:32.639928   26946 kube-vip.go:115] generating kube-vip config ...

	I0930 11:12:32.639958   26946 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0930 11:12:32.657152   26946 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0930 11:12:32.657231   26946 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0930 11:12:32.657301   26946 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 11:12:32.669072   26946 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.1: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.1': No such file or directory

	Initiating transfer...

	I0930 11:12:32.669126   26946 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.1

	I0930 11:12:32.681078   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl.sha256

	I0930 11:12:32.681102   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl -> /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:12:32.681147   26946 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm

	I0930 11:12:32.681159   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:12:32.681202   26946 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet

	I0930 11:12:32.685896   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubectl': No such file or directory

	I0930 11:12:32.685930   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl --> /var/lib/minikube/binaries/v1.31.1/kubectl (56381592 bytes)

	I0930 11:12:33.355089   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm -> /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:12:33.355169   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:12:33.360551   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubeadm': No such file or directory

	I0930 11:12:33.360593   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm --> /var/lib/minikube/binaries/v1.31.1/kubeadm (58290328 bytes)

	I0930 11:12:33.497331   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:12:33.536292   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet -> /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:12:33.536381   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:12:33.556993   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubelet': No such file or directory

	I0930 11:12:33.557034   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet --> /var/lib/minikube/binaries/v1.31.1/kubelet (76869944 bytes)

	I0930 11:12:33.963212   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0930 11:12:33.973956   26946 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)

	I0930 11:12:33.992407   26946 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 11:12:34.010174   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0930 11:12:34.027647   26946 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0930 11:12:34.031715   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:12:34.045021   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:12:34.164493   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:12:34.181854   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:34.182385   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:34.182436   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:34.197448   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34395

	I0930 11:12:34.197925   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:34.198415   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:34.198439   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:34.198777   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:34.199019   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:34.199179   26946 start.go:317] joinCluster: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Cluster

Name:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:

26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 11:12:34.199281   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0930 11:12:34.199296   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:34.202318   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:34.202754   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:34.202783   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:34.202947   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:34.203150   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:34.203332   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:34.203477   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:34.356774   26946 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:34.356813   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token hn6im1.2otceyiojx5fmqqd --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m02 --control-plane --apiserver-advertise-address=192.168.39.3 --apiserver-bind-port=8443"

	I0930 11:12:56.361665   26946 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token hn6im1.2otceyiojx5fmqqd --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m02 --control-plane --apiserver-advertise-address=192.168.39.3 --apiserver-bind-port=8443": (22.004830324s)

	I0930 11:12:56.361703   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0930 11:12:57.091049   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-033260-m02 minikube.k8s.io/updated_at=2024_09_30T11_12_57_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=ha-033260 minikube.k8s.io/primary=false

	I0930 11:12:57.252660   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-033260-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0930 11:12:57.383009   26946 start.go:319] duration metric: took 23.183825523s to joinCluster

	I0930 11:12:57.383083   26946 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:57.383372   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:57.384696   26946 out.go:177] * Verifying Kubernetes components...

	I0930 11:12:57.385781   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:12:57.652948   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:12:57.700673   26946 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:12:57.700909   26946 kapi.go:59] client config for ha-033260: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt", KeyFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key", CAFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1f685c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0930 11:12:57.700967   26946 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.249:8443

	I0930 11:12:57.701166   26946 node_ready.go:35] waiting up to 6m0s for node "ha-033260-m02" to be "Ready" ...

	I0930 11:12:57.701263   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:57.701272   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:57.701283   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:57.701288   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:57.710787   26946 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0930 11:12:58.201703   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:58.201723   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:58.201733   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:58.201738   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:58.218761   26946 round_trippers.go:574] Response Status: 200 OK in 17 milliseconds

	I0930 11:12:58.701415   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:58.701436   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:58.701444   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:58.701447   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:58.707425   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:12:59.202375   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:59.202398   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:59.202410   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:59.202416   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:59.206657   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:12:59.701590   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:59.701611   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:59.701635   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:59.701642   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:59.706264   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:12:59.707024   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:00.201877   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:00.201901   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:00.201917   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:00.201924   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:00.205419   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:00.701357   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:00.701378   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:00.701386   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:00.701391   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:00.706252   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:01.202282   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:01.202307   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:01.202319   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:01.202325   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:01.206013   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:01.701738   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:01.701760   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:01.701768   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:01.701773   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:01.705302   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:02.202004   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:02.202030   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:02.202043   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:02.202051   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:02.205535   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:02.206136   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:02.701406   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:02.701427   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:02.701436   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:02.701440   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:02.704929   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:03.202160   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:03.202189   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:03.202198   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:03.202204   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:03.205838   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:03.701797   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:03.701821   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:03.701832   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:03.701841   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:03.706107   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:04.201592   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:04.201623   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:04.201634   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:04.201641   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:04.204858   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:04.701789   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:04.701812   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:04.701825   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:04.701831   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:04.710541   26946 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0930 11:13:04.711317   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:05.202211   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:05.202237   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:05.202248   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:05.202255   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:05.206000   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:05.702240   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:05.702263   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:05.702272   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:05.702276   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:05.713473   26946 round_trippers.go:574] Response Status: 200 OK in 11 milliseconds

	I0930 11:13:06.201370   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:06.201398   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:06.201412   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:06.201421   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:06.205062   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:06.702136   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:06.702157   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:06.702170   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:06.702178   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:06.707226   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:13:07.201911   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:07.201933   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:07.201941   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:07.201947   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:07.205398   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:07.206056   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:07.702203   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:07.702228   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:07.702236   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:07.702240   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:07.705652   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:08.201364   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:08.201385   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:08.201393   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:08.201397   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:08.204682   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:08.701564   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:08.701585   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:08.701593   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:08.701597   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:08.704941   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:09.201826   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:09.201874   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:09.201887   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:09.201892   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:09.205730   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:09.206265   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:09.701548   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:09.701576   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:09.701584   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:09.701588   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:09.704970   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:10.202351   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:10.202382   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:10.202393   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:10.202402   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:10.205886   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:10.701694   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:10.701717   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:10.701725   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:10.701729   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:10.705252   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:11.202235   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:11.202256   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:11.202264   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:11.202267   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:11.205904   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:11.206456   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:11.701817   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:11.701840   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:11.701848   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:11.701852   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:11.705418   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:12.202233   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:12.202257   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:12.202267   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:12.202273   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:12.206552   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:12.701910   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:12.701932   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:12.701940   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:12.701944   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:12.705423   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:13.201690   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:13.201715   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:13.201727   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:13.201733   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:13.205360   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:13.701378   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:13.701402   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:13.701410   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:13.701416   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:13.704921   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:13.705712   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:14.202280   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:14.202303   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.202313   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.202317   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.206153   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.701500   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:14.701536   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.701545   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.701549   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.705110   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.705891   26946 node_ready.go:49] node "ha-033260-m02" has status "Ready":"True"

	I0930 11:13:14.705919   26946 node_ready.go:38] duration metric: took 17.004728232s for node "ha-033260-m02" to be "Ready" ...

	I0930 11:13:14.705930   26946 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:13:14.706003   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:14.706012   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.706019   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.706027   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.710637   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:14.717034   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.717112   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-5frmm

	I0930 11:13:14.717120   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.717127   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.717132   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.720167   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.720847   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:14.720863   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.720870   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.720874   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.723869   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:13:14.724515   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.724535   26946 pod_ready.go:82] duration metric: took 7.4758ms for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.724545   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.724613   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-kt87v

	I0930 11:13:14.724621   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.724628   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.724634   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.727903   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.728724   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:14.728741   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.728751   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.728757   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.731653   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:13:14.732553   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.732574   26946 pod_ready.go:82] duration metric: took 8.020759ms for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.732586   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.732653   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260

	I0930 11:13:14.732664   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.732674   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.732682   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.735972   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.736968   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:14.736990   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.737001   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.737006   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.742593   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:13:14.743126   26946 pod_ready.go:93] pod "etcd-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.743157   26946 pod_ready.go:82] duration metric: took 10.560613ms for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.743170   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.743261   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m02

	I0930 11:13:14.743274   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.743284   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.743295   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.746988   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.747647   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:14.747666   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.747678   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.747685   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.752616   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:14.753409   26946 pod_ready.go:93] pod "etcd-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.753424   26946 pod_ready.go:82] duration metric: took 10.242469ms for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.753437   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.901974   26946 request.go:632] Waited for 148.458979ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:13:14.902036   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:13:14.902043   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.902055   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.902060   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.905987   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.101905   26946 request.go:632] Waited for 195.35281ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.101994   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.102002   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.102014   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.102020   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.106060   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:15.106613   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:15.106631   26946 pod_ready.go:82] duration metric: took 353.188275ms for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.106640   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.301775   26946 request.go:632] Waited for 195.071866ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:13:15.301852   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:13:15.301859   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.301869   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.301877   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.305432   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.502470   26946 request.go:632] Waited for 196.425957ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:15.502545   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:15.502550   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.502559   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.502564   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.506368   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.506795   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:15.506815   26946 pod_ready.go:82] duration metric: took 400.168693ms for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.506824   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.702050   26946 request.go:632] Waited for 195.162388ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:13:15.702133   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:13:15.702141   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.702152   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.702163   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.705891   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.901957   26946 request.go:632] Waited for 195.415244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.902015   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.902032   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.902045   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.902050   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.905760   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.906550   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:15.906568   26946 pod_ready.go:82] duration metric: took 399.738814ms for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.906577   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.101960   26946 request.go:632] Waited for 195.295618ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:13:16.102015   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:13:16.102020   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.102027   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.102034   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.105657   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:16.301949   26946 request.go:632] Waited for 195.400353ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.302010   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.302015   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.302022   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.302028   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.306149   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:16.306664   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:16.306684   26946 pod_ready.go:82] duration metric: took 400.100909ms for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.306693   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.501852   26946 request.go:632] Waited for 195.093896ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:13:16.501929   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:13:16.501936   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.501944   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.501948   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.505624   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:16.702111   26946 request.go:632] Waited for 195.755005ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.702172   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.702201   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.702232   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.702242   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.706191   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:16.706772   26946 pod_ready.go:93] pod "kube-proxy-fckwn" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:16.706793   26946 pod_ready.go:82] duration metric: took 400.093034ms for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.706806   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.901822   26946 request.go:632] Waited for 194.939903ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:13:16.901874   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:13:16.901878   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.901886   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.901890   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.905939   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:17.102468   26946 request.go:632] Waited for 195.869654ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.102551   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.102559   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.102570   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.102576   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.105889   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.106573   26946 pod_ready.go:93] pod "kube-proxy-mxvxr" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:17.106594   26946 pod_ready.go:82] duration metric: took 399.778126ms for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.106605   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.301593   26946 request.go:632] Waited for 194.913576ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:13:17.301653   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:13:17.301658   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.301671   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.301678   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.305178   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.502249   26946 request.go:632] Waited for 196.387698ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.502326   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.502350   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.502358   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.502362   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.505833   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.506907   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:17.506935   26946 pod_ready.go:82] duration metric: took 400.319251ms for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.506948   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.701919   26946 request.go:632] Waited for 194.9063ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:13:17.701999   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:13:17.702006   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.702017   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.702028   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.705520   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.902402   26946 request.go:632] Waited for 196.207639ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:17.902477   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:17.902485   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.902500   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.902526   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.906656   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:17.907109   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:17.907128   26946 pod_ready.go:82] duration metric: took 400.172408ms for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.907142   26946 pod_ready.go:39] duration metric: took 3.201195785s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:13:17.907159   26946 api_server.go:52] waiting for apiserver process to appear ...

	I0930 11:13:17.907218   26946 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0930 11:13:17.923202   26946 api_server.go:72] duration metric: took 20.540084285s to wait for apiserver process to appear ...

	I0930 11:13:17.923232   26946 api_server.go:88] waiting for apiserver healthz status ...

	I0930 11:13:17.923251   26946 api_server.go:253] Checking apiserver healthz at https://192.168.39.249:8443/healthz ...

	I0930 11:13:17.929517   26946 api_server.go:279] https://192.168.39.249:8443/healthz returned 200:

	ok

	I0930 11:13:17.929596   26946 round_trippers.go:463] GET https://192.168.39.249:8443/version

	I0930 11:13:17.929602   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.929631   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.929636   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.930581   26946 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0930 11:13:17.930807   26946 api_server.go:141] control plane version: v1.31.1

	I0930 11:13:17.930834   26946 api_server.go:131] duration metric: took 7.593991ms to wait for apiserver health ...

	I0930 11:13:17.930843   26946 system_pods.go:43] waiting for kube-system pods to appear ...

	I0930 11:13:18.102359   26946 request.go:632] Waited for 171.419304ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.102425   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.102433   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.102442   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.102449   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.107679   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:13:18.114591   26946 system_pods.go:59] 17 kube-system pods found

	I0930 11:13:18.114717   26946 system_pods.go:61] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:13:18.114749   26946 system_pods.go:61] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:13:18.114780   26946 system_pods.go:61] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:13:18.114803   26946 system_pods.go:61] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:13:18.114826   26946 system_pods.go:61] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:13:18.114841   26946 system_pods.go:61] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:13:18.114876   26946 system_pods.go:61] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:13:18.114899   26946 system_pods.go:61] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:13:18.114915   26946 system_pods.go:61] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:13:18.114935   26946 system_pods.go:61] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:13:18.114950   26946 system_pods.go:61] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:13:18.114975   26946 system_pods.go:61] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:13:18.114997   26946 system_pods.go:61] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:13:18.115011   26946 system_pods.go:61] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:13:18.115025   26946 system_pods.go:61] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:13:18.115059   26946 system_pods.go:61] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:13:18.115132   26946 system_pods.go:61] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:13:18.115146   26946 system_pods.go:74] duration metric: took 184.295086ms to wait for pod list to return data ...

	I0930 11:13:18.115155   26946 default_sa.go:34] waiting for default service account to be created ...

	I0930 11:13:18.301606   26946 request.go:632] Waited for 186.324564ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:13:18.301691   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:13:18.301697   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.301704   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.301708   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.305792   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:18.306031   26946 default_sa.go:45] found service account: "default"

	I0930 11:13:18.306053   26946 default_sa.go:55] duration metric: took 190.887438ms for default service account to be created ...

	I0930 11:13:18.306064   26946 system_pods.go:116] waiting for k8s-apps to be running ...

	I0930 11:13:18.502520   26946 request.go:632] Waited for 196.381212ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.502574   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.502580   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.502589   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.502594   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.507606   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:18.513786   26946 system_pods.go:86] 17 kube-system pods found

	I0930 11:13:18.513814   26946 system_pods.go:89] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:13:18.513820   26946 system_pods.go:89] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:13:18.513824   26946 system_pods.go:89] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:13:18.513828   26946 system_pods.go:89] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:13:18.513832   26946 system_pods.go:89] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:13:18.513835   26946 system_pods.go:89] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:13:18.513838   26946 system_pods.go:89] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:13:18.513842   26946 system_pods.go:89] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:13:18.513845   26946 system_pods.go:89] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:13:18.513849   26946 system_pods.go:89] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:13:18.513852   26946 system_pods.go:89] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:13:18.513855   26946 system_pods.go:89] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:13:18.513858   26946 system_pods.go:89] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:13:18.513864   26946 system_pods.go:89] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:13:18.513868   26946 system_pods.go:89] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:13:18.513871   26946 system_pods.go:89] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:13:18.513874   26946 system_pods.go:89] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:13:18.513883   26946 system_pods.go:126] duration metric: took 207.809961ms to wait for k8s-apps to be running ...

	I0930 11:13:18.513889   26946 system_svc.go:44] waiting for kubelet service to be running ....

	I0930 11:13:18.513933   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:13:18.530491   26946 system_svc.go:56] duration metric: took 16.594303ms WaitForService to wait for kubelet

	I0930 11:13:18.530520   26946 kubeadm.go:582] duration metric: took 21.147406438s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 11:13:18.530536   26946 node_conditions.go:102] verifying NodePressure condition ...

	I0930 11:13:18.701935   26946 request.go:632] Waited for 171.311845ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes

	I0930 11:13:18.701998   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes

	I0930 11:13:18.702004   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.702013   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.702020   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.706454   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:18.707258   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:13:18.707286   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:13:18.707302   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:13:18.707309   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:13:18.707315   26946 node_conditions.go:105] duration metric: took 176.773141ms to run NodePressure ...

	I0930 11:13:18.707329   26946 start.go:241] waiting for startup goroutines ...

	I0930 11:13:18.707365   26946 start.go:255] writing updated cluster config ...

	I0930 11:13:18.709744   26946 out.go:201] 

	I0930 11:13:18.711365   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:13:18.711455   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:13:18.713157   26946 out.go:177] * Starting "ha-033260-m03" control-plane node in "ha-033260" cluster

	I0930 11:13:18.714611   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:13:18.714636   26946 cache.go:56] Caching tarball of preloaded images

	I0930 11:13:18.714744   26946 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 11:13:18.714757   26946 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 11:13:18.714852   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:13:18.715040   26946 start.go:360] acquireMachinesLock for ha-033260-m03: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 11:13:18.715084   26946 start.go:364] duration metric: took 25.338µs to acquireMachinesLock for "ha-033260-m03"

	I0930 11:13:18.715101   26946 start.go:93] Provisioning new machine with config: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-

gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizatio

ns:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:13:18.715188   26946 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0930 11:13:18.716794   26946 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0930 11:13:18.716894   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:18.716928   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:18.732600   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42281

	I0930 11:13:18.733109   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:18.733561   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:18.733575   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:18.733910   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:18.734089   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:18.734238   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:18.734421   26946 start.go:159] libmachine.API.Create for "ha-033260" (driver="kvm2")

	I0930 11:13:18.734451   26946 client.go:168] LocalClient.Create starting

	I0930 11:13:18.734489   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 11:13:18.734529   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:13:18.734544   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:13:18.734600   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 11:13:18.734619   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:13:18.734631   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:13:18.734648   26946 main.go:141] libmachine: Running pre-create checks...

	I0930 11:13:18.734656   26946 main.go:141] libmachine: (ha-033260-m03) Calling .PreCreateCheck

	I0930 11:13:18.734797   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetConfigRaw

	I0930 11:13:18.735196   26946 main.go:141] libmachine: Creating machine...

	I0930 11:13:18.735209   26946 main.go:141] libmachine: (ha-033260-m03) Calling .Create

	I0930 11:13:18.735336   26946 main.go:141] libmachine: (ha-033260-m03) Creating KVM machine...

	I0930 11:13:18.736643   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found existing default KVM network

	I0930 11:13:18.736820   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found existing private KVM network mk-ha-033260

	I0930 11:13:18.736982   26946 main.go:141] libmachine: (ha-033260-m03) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03 ...

	I0930 11:13:18.737011   26946 main.go:141] libmachine: (ha-033260-m03) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 11:13:18.737118   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:18.736992   27716 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:13:18.737204   26946 main.go:141] libmachine: (ha-033260-m03) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 11:13:18.965830   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:18.965684   27716 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa...

	I0930 11:13:19.182387   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:19.182221   27716 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/ha-033260-m03.rawdisk...

	I0930 11:13:19.182427   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Writing magic tar header

	I0930 11:13:19.182442   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Writing SSH key tar header

	I0930 11:13:19.182454   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:19.182378   27716 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03 ...

	I0930 11:13:19.182548   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03

	I0930 11:13:19.182570   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 11:13:19.182578   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03 (perms=drwx------)

	I0930 11:13:19.182587   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 11:13:19.182596   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 11:13:19.182610   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 11:13:19.182620   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 11:13:19.182634   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:13:19.182647   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 11:13:19.182661   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 11:13:19.182678   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 11:13:19.182687   26946 main.go:141] libmachine: (ha-033260-m03) Creating domain...

	I0930 11:13:19.182699   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins

	I0930 11:13:19.182796   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home

	I0930 11:13:19.182820   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Skipping /home - not owner

	I0930 11:13:19.183716   26946 main.go:141] libmachine: (ha-033260-m03) define libvirt domain using xml: 

	I0930 11:13:19.183740   26946 main.go:141] libmachine: (ha-033260-m03) <domain type='kvm'>

	I0930 11:13:19.183766   26946 main.go:141] libmachine: (ha-033260-m03)   <name>ha-033260-m03</name>

	I0930 11:13:19.183787   26946 main.go:141] libmachine: (ha-033260-m03)   <memory unit='MiB'>2200</memory>

	I0930 11:13:19.183800   26946 main.go:141] libmachine: (ha-033260-m03)   <vcpu>2</vcpu>

	I0930 11:13:19.183806   26946 main.go:141] libmachine: (ha-033260-m03)   <features>

	I0930 11:13:19.183817   26946 main.go:141] libmachine: (ha-033260-m03)     <acpi/>

	I0930 11:13:19.183827   26946 main.go:141] libmachine: (ha-033260-m03)     <apic/>

	I0930 11:13:19.183836   26946 main.go:141] libmachine: (ha-033260-m03)     <pae/>

	I0930 11:13:19.183845   26946 main.go:141] libmachine: (ha-033260-m03)     

	I0930 11:13:19.183853   26946 main.go:141] libmachine: (ha-033260-m03)   </features>

	I0930 11:13:19.183861   26946 main.go:141] libmachine: (ha-033260-m03)   <cpu mode='host-passthrough'>

	I0930 11:13:19.183868   26946 main.go:141] libmachine: (ha-033260-m03)   

	I0930 11:13:19.183881   26946 main.go:141] libmachine: (ha-033260-m03)   </cpu>

	I0930 11:13:19.183892   26946 main.go:141] libmachine: (ha-033260-m03)   <os>

	I0930 11:13:19.183902   26946 main.go:141] libmachine: (ha-033260-m03)     <type>hvm</type>

	I0930 11:13:19.183911   26946 main.go:141] libmachine: (ha-033260-m03)     <boot dev='cdrom'/>

	I0930 11:13:19.183924   26946 main.go:141] libmachine: (ha-033260-m03)     <boot dev='hd'/>

	I0930 11:13:19.183936   26946 main.go:141] libmachine: (ha-033260-m03)     <bootmenu enable='no'/>

	I0930 11:13:19.183942   26946 main.go:141] libmachine: (ha-033260-m03)   </os>

	I0930 11:13:19.183951   26946 main.go:141] libmachine: (ha-033260-m03)   <devices>

	I0930 11:13:19.183961   26946 main.go:141] libmachine: (ha-033260-m03)     <disk type='file' device='cdrom'>

	I0930 11:13:19.183975   26946 main.go:141] libmachine: (ha-033260-m03)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/boot2docker.iso'/>

	I0930 11:13:19.183985   26946 main.go:141] libmachine: (ha-033260-m03)       <target dev='hdc' bus='scsi'/>

	I0930 11:13:19.183993   26946 main.go:141] libmachine: (ha-033260-m03)       <readonly/>

	I0930 11:13:19.184007   26946 main.go:141] libmachine: (ha-033260-m03)     </disk>

	I0930 11:13:19.184019   26946 main.go:141] libmachine: (ha-033260-m03)     <disk type='file' device='disk'>

	I0930 11:13:19.184028   26946 main.go:141] libmachine: (ha-033260-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 11:13:19.184041   26946 main.go:141] libmachine: (ha-033260-m03)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/ha-033260-m03.rawdisk'/>

	I0930 11:13:19.184052   26946 main.go:141] libmachine: (ha-033260-m03)       <target dev='hda' bus='virtio'/>

	I0930 11:13:19.184065   26946 main.go:141] libmachine: (ha-033260-m03)     </disk>

	I0930 11:13:19.184076   26946 main.go:141] libmachine: (ha-033260-m03)     <interface type='network'>

	I0930 11:13:19.184137   26946 main.go:141] libmachine: (ha-033260-m03)       <source network='mk-ha-033260'/>

	I0930 11:13:19.184167   26946 main.go:141] libmachine: (ha-033260-m03)       <model type='virtio'/>

	I0930 11:13:19.184179   26946 main.go:141] libmachine: (ha-033260-m03)     </interface>

	I0930 11:13:19.184187   26946 main.go:141] libmachine: (ha-033260-m03)     <interface type='network'>

	I0930 11:13:19.184197   26946 main.go:141] libmachine: (ha-033260-m03)       <source network='default'/>

	I0930 11:13:19.184205   26946 main.go:141] libmachine: (ha-033260-m03)       <model type='virtio'/>

	I0930 11:13:19.184215   26946 main.go:141] libmachine: (ha-033260-m03)     </interface>

	I0930 11:13:19.184223   26946 main.go:141] libmachine: (ha-033260-m03)     <serial type='pty'>

	I0930 11:13:19.184242   26946 main.go:141] libmachine: (ha-033260-m03)       <target port='0'/>

	I0930 11:13:19.184249   26946 main.go:141] libmachine: (ha-033260-m03)     </serial>

	I0930 11:13:19.184259   26946 main.go:141] libmachine: (ha-033260-m03)     <console type='pty'>

	I0930 11:13:19.184267   26946 main.go:141] libmachine: (ha-033260-m03)       <target type='serial' port='0'/>

	I0930 11:13:19.184277   26946 main.go:141] libmachine: (ha-033260-m03)     </console>

	I0930 11:13:19.184285   26946 main.go:141] libmachine: (ha-033260-m03)     <rng model='virtio'>

	I0930 11:13:19.184297   26946 main.go:141] libmachine: (ha-033260-m03)       <backend model='random'>/dev/random</backend>

	I0930 11:13:19.184305   26946 main.go:141] libmachine: (ha-033260-m03)     </rng>

	I0930 11:13:19.184313   26946 main.go:141] libmachine: (ha-033260-m03)     

	I0930 11:13:19.184326   26946 main.go:141] libmachine: (ha-033260-m03)     

	I0930 11:13:19.184337   26946 main.go:141] libmachine: (ha-033260-m03)   </devices>

	I0930 11:13:19.184344   26946 main.go:141] libmachine: (ha-033260-m03) </domain>

	I0930 11:13:19.184355   26946 main.go:141] libmachine: (ha-033260-m03) 

	I0930 11:13:19.191067   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:09:7f:ae in network default

	I0930 11:13:19.191719   26946 main.go:141] libmachine: (ha-033260-m03) Ensuring networks are active...

	I0930 11:13:19.191738   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:19.192592   26946 main.go:141] libmachine: (ha-033260-m03) Ensuring network default is active

	I0930 11:13:19.192924   26946 main.go:141] libmachine: (ha-033260-m03) Ensuring network mk-ha-033260 is active

	I0930 11:13:19.193268   26946 main.go:141] libmachine: (ha-033260-m03) Getting domain xml...

	I0930 11:13:19.193941   26946 main.go:141] libmachine: (ha-033260-m03) Creating domain...

	I0930 11:13:20.468738   26946 main.go:141] libmachine: (ha-033260-m03) Waiting to get IP...

	I0930 11:13:20.469515   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:20.469944   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:20.469970   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:20.469926   27716 retry.go:31] will retry after 232.398954ms: waiting for machine to come up

	I0930 11:13:20.704544   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:20.704996   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:20.705026   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:20.704955   27716 retry.go:31] will retry after 380.728938ms: waiting for machine to come up

	I0930 11:13:21.087407   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:21.087831   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:21.087853   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:21.087810   27716 retry.go:31] will retry after 405.871711ms: waiting for machine to come up

	I0930 11:13:21.495366   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:21.495857   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:21.495885   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:21.495810   27716 retry.go:31] will retry after 380.57456ms: waiting for machine to come up

	I0930 11:13:21.878262   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:21.878697   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:21.878718   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:21.878678   27716 retry.go:31] will retry after 486.639816ms: waiting for machine to come up

	I0930 11:13:22.367485   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:22.367998   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:22.368026   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:22.367946   27716 retry.go:31] will retry after 818.869274ms: waiting for machine to come up

	I0930 11:13:23.187832   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:23.188286   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:23.188306   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:23.188246   27716 retry.go:31] will retry after 870.541242ms: waiting for machine to come up

	I0930 11:13:24.060866   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:24.061364   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:24.061403   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:24.061339   27716 retry.go:31] will retry after 1.026163442s: waiting for machine to come up

	I0930 11:13:25.089407   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:25.089859   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:25.089889   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:25.089789   27716 retry.go:31] will retry after 1.677341097s: waiting for machine to come up

	I0930 11:13:26.769716   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:26.770127   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:26.770173   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:26.770102   27716 retry.go:31] will retry after 2.102002194s: waiting for machine to come up

	I0930 11:13:28.873495   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:28.874089   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:28.874118   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:28.874042   27716 retry.go:31] will retry after 2.512249945s: waiting for machine to come up

	I0930 11:13:31.388375   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:31.388813   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:31.388842   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:31.388766   27716 retry.go:31] will retry after 3.025058152s: waiting for machine to come up

	I0930 11:13:34.415391   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:34.415806   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:34.415826   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:34.415764   27716 retry.go:31] will retry after 3.6491044s: waiting for machine to come up

	I0930 11:13:38.067512   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:38.067932   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:38.067957   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:38.067891   27716 retry.go:31] will retry after 5.462753525s: waiting for machine to come up

	I0930 11:13:43.535257   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:43.535767   26946 main.go:141] libmachine: (ha-033260-m03) Found IP for machine: 192.168.39.238

	I0930 11:13:43.535792   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has current primary IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:43.535800   26946 main.go:141] libmachine: (ha-033260-m03) Reserving static IP address...

	I0930 11:13:43.536253   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find host DHCP lease matching {name: "ha-033260-m03", mac: "52:54:00:f2:70:c8", ip: "192.168.39.238"} in network mk-ha-033260

	I0930 11:13:43.612168   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Getting to WaitForSSH function...

	I0930 11:13:43.612200   26946 main.go:141] libmachine: (ha-033260-m03) Reserved static IP address: 192.168.39.238

	I0930 11:13:43.612213   26946 main.go:141] libmachine: (ha-033260-m03) Waiting for SSH to be available...

	I0930 11:13:43.614758   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:43.615073   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260

	I0930 11:13:43.615102   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find defined IP address of network mk-ha-033260 interface with MAC address 52:54:00:f2:70:c8

	I0930 11:13:43.615180   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH client type: external

	I0930 11:13:43.615208   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa (-rw-------)

	I0930 11:13:43.615240   26946 main.go:141] libmachine: (ha-033260-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:13:43.615252   26946 main.go:141] libmachine: (ha-033260-m03) DBG | About to run SSH command:

	I0930 11:13:43.615269   26946 main.go:141] libmachine: (ha-033260-m03) DBG | exit 0

	I0930 11:13:43.619189   26946 main.go:141] libmachine: (ha-033260-m03) DBG | SSH cmd err, output: exit status 255: 

	I0930 11:13:43.619212   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0930 11:13:43.619222   26946 main.go:141] libmachine: (ha-033260-m03) DBG | command : exit 0

	I0930 11:13:43.619233   26946 main.go:141] libmachine: (ha-033260-m03) DBG | err     : exit status 255

	I0930 11:13:43.619246   26946 main.go:141] libmachine: (ha-033260-m03) DBG | output  : 

	I0930 11:13:46.621877   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Getting to WaitForSSH function...

	I0930 11:13:46.624327   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.624849   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.624873   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.625052   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH client type: external

	I0930 11:13:46.625075   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa (-rw-------)

	I0930 11:13:46.625113   26946 main.go:141] libmachine: (ha-033260-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.238 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:13:46.625125   26946 main.go:141] libmachine: (ha-033260-m03) DBG | About to run SSH command:

	I0930 11:13:46.625137   26946 main.go:141] libmachine: (ha-033260-m03) DBG | exit 0

	I0930 11:13:46.749932   26946 main.go:141] libmachine: (ha-033260-m03) DBG | SSH cmd err, output: <nil>: 

	I0930 11:13:46.750211   26946 main.go:141] libmachine: (ha-033260-m03) KVM machine creation complete!

	I0930 11:13:46.750551   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetConfigRaw

	I0930 11:13:46.751116   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:46.751371   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:46.751553   26946 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 11:13:46.751568   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetState

	I0930 11:13:46.752698   26946 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 11:13:46.752714   26946 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 11:13:46.752721   26946 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 11:13:46.752728   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:46.755296   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.755714   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.755738   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.755877   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:46.756027   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.756136   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.756284   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:46.756448   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:46.756639   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:46.756651   26946 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 11:13:46.857068   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:13:46.857090   26946 main.go:141] libmachine: Detecting the provisioner...

	I0930 11:13:46.857097   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:46.859904   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.860340   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.860372   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.860564   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:46.860899   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.861065   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.861200   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:46.861350   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:46.861511   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:46.861526   26946 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 11:13:46.970453   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 11:13:46.970520   26946 main.go:141] libmachine: found compatible host: buildroot

	I0930 11:13:46.970534   26946 main.go:141] libmachine: Provisioning with buildroot...

	I0930 11:13:46.970543   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:46.970766   26946 buildroot.go:166] provisioning hostname "ha-033260-m03"

	I0930 11:13:46.970791   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:46.970955   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:46.973539   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.973929   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.973956   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.974221   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:46.974372   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.974556   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.974665   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:46.974786   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:46.974938   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:46.974953   26946 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-033260-m03 && echo "ha-033260-m03" | sudo tee /etc/hostname

	I0930 11:13:47.087604   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-033260-m03

	I0930 11:13:47.087636   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.090559   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.090866   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.090895   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.091089   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.091283   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.091400   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.091516   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.091649   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:47.091811   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:47.091834   26946 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-033260-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-033260-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-033260-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 11:13:47.203919   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:13:47.203950   26946 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 11:13:47.203969   26946 buildroot.go:174] setting up certificates

	I0930 11:13:47.203977   26946 provision.go:84] configureAuth start

	I0930 11:13:47.203986   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:47.204270   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:47.207236   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.207589   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.207618   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.207750   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.210196   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.210560   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.210587   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.210754   26946 provision.go:143] copyHostCerts

	I0930 11:13:47.210783   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:13:47.210816   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem, removing ...

	I0930 11:13:47.210826   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:13:47.210895   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 11:13:47.210966   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:13:47.210983   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem, removing ...

	I0930 11:13:47.210989   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:13:47.211013   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 11:13:47.211059   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:13:47.211076   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem, removing ...

	I0930 11:13:47.211082   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:13:47.211104   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 11:13:47.211150   26946 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.ha-033260-m03 san=[127.0.0.1 192.168.39.238 ha-033260-m03 localhost minikube]

	I0930 11:13:47.437398   26946 provision.go:177] copyRemoteCerts

	I0930 11:13:47.437447   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 11:13:47.437470   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.440541   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.440922   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.440953   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.441156   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.441379   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.441583   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.441760   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:47.524024   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0930 11:13:47.524094   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0930 11:13:47.548921   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0930 11:13:47.548991   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 11:13:47.573300   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0930 11:13:47.573362   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0930 11:13:47.597885   26946 provision.go:87] duration metric: took 393.894244ms to configureAuth

	I0930 11:13:47.597913   26946 buildroot.go:189] setting minikube options for container-runtime

	I0930 11:13:47.598137   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:13:47.598221   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.600783   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.601100   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.601141   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.601308   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.601511   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.601694   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.601837   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.601988   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:47.602139   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:47.602153   26946 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 11:13:47.824726   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 11:13:47.824757   26946 main.go:141] libmachine: Checking connection to Docker...

	I0930 11:13:47.824767   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetURL

	I0930 11:13:47.826205   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using libvirt version 6000000

	I0930 11:13:47.829313   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.829732   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.829758   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.829979   26946 main.go:141] libmachine: Docker is up and running!

	I0930 11:13:47.829995   26946 main.go:141] libmachine: Reticulating splines...

	I0930 11:13:47.830002   26946 client.go:171] duration metric: took 29.095541403s to LocalClient.Create

	I0930 11:13:47.830029   26946 start.go:167] duration metric: took 29.095609634s to libmachine.API.Create "ha-033260"

	I0930 11:13:47.830042   26946 start.go:293] postStartSetup for "ha-033260-m03" (driver="kvm2")

	I0930 11:13:47.830059   26946 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 11:13:47.830080   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:47.830308   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 11:13:47.830331   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.832443   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.832840   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.832866   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.833032   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.833204   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.833336   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.833448   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:47.911982   26946 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 11:13:47.916413   26946 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 11:13:47.916434   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 11:13:47.916512   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 11:13:47.916604   26946 filesync.go:149] local asset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> 110092.pem in /etc/ssl/certs

	I0930 11:13:47.916615   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /etc/ssl/certs/110092.pem

	I0930 11:13:47.916726   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0930 11:13:47.926360   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:13:47.951398   26946 start.go:296] duration metric: took 121.337458ms for postStartSetup

	I0930 11:13:47.951443   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetConfigRaw

	I0930 11:13:47.951959   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:47.954522   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.954882   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.954902   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.955203   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:13:47.955450   26946 start.go:128] duration metric: took 29.240250665s to createHost

	I0930 11:13:47.955475   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.957714   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.958054   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.958091   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.958262   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.958436   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.958562   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.958708   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.958822   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:47.958982   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:47.958994   26946 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 11:13:48.062976   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727694828.042605099

	I0930 11:13:48.062999   26946 fix.go:216] guest clock: 1727694828.042605099

	I0930 11:13:48.063009   26946 fix.go:229] Guest: 2024-09-30 11:13:48.042605099 +0000 UTC Remote: 2024-09-30 11:13:47.955462433 +0000 UTC m=+151.020514213 (delta=87.142666ms)

	I0930 11:13:48.063030   26946 fix.go:200] guest clock delta is within tolerance: 87.142666ms

	I0930 11:13:48.063037   26946 start.go:83] releasing machines lock for "ha-033260-m03", held for 29.347943498s

	I0930 11:13:48.063057   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.063295   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:48.065833   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.066130   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:48.066166   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.068440   26946 out.go:177] * Found network options:

	I0930 11:13:48.070194   26946 out.go:177]   - NO_PROXY=192.168.39.249,192.168.39.3

	W0930 11:13:48.071578   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	W0930 11:13:48.071602   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:13:48.071621   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.072253   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.072426   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.072506   26946 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 11:13:48.072552   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	W0930 11:13:48.072605   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	W0930 11:13:48.072630   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:13:48.072698   26946 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 11:13:48.072719   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:48.075267   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075365   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075641   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:48.075667   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075715   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:48.075746   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075778   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:48.075958   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:48.075973   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:48.076123   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:48.076126   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:48.076233   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:48.076311   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:48.076464   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:48.315424   26946 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 11:13:48.322103   26946 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 11:13:48.322167   26946 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 11:13:48.340329   26946 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 11:13:48.340354   26946 start.go:495] detecting cgroup driver to use...

	I0930 11:13:48.340419   26946 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 11:13:48.356866   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 11:13:48.372077   26946 docker.go:217] disabling cri-docker service (if available) ...

	I0930 11:13:48.372139   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 11:13:48.387616   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 11:13:48.402259   26946 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 11:13:48.523588   26946 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 11:13:48.671634   26946 docker.go:233] disabling docker service ...

	I0930 11:13:48.671693   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 11:13:48.687483   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 11:13:48.702106   26946 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 11:13:48.848121   26946 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 11:13:48.976600   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 11:13:48.991745   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 11:13:49.014226   26946 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 11:13:49.014303   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.025816   26946 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 11:13:49.025892   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.038153   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.049762   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.061409   26946 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 11:13:49.073521   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.084788   26946 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.104074   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.116909   26946 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 11:13:49.129116   26946 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 11:13:49.129180   26946 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 11:13:49.143704   26946 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 11:13:49.155037   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:13:49.274882   26946 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 11:13:49.369751   26946 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 11:13:49.369822   26946 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 11:13:49.375071   26946 start.go:563] Will wait 60s for crictl version

	I0930 11:13:49.375129   26946 ssh_runner.go:195] Run: which crictl

	I0930 11:13:49.379040   26946 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 11:13:49.421444   26946 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 11:13:49.421545   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:13:49.450271   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:13:49.481221   26946 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 11:13:49.482604   26946 out.go:177]   - env NO_PROXY=192.168.39.249

	I0930 11:13:49.483828   26946 out.go:177]   - env NO_PROXY=192.168.39.249,192.168.39.3

	I0930 11:13:49.485093   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:49.488106   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:49.488528   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:49.488555   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:49.488791   26946 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 11:13:49.493484   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:13:49.506933   26946 mustload.go:65] Loading cluster: ha-033260

	I0930 11:13:49.507212   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:13:49.507471   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:49.507506   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:49.522665   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36191

	I0930 11:13:49.523038   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:49.523529   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:49.523558   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:49.523847   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:49.524064   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:13:49.525464   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:13:49.525875   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:49.525916   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:49.540657   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45857

	I0930 11:13:49.541129   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:49.541659   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:49.541680   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:49.541991   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:49.542172   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:13:49.542336   26946 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260 for IP: 192.168.39.238

	I0930 11:13:49.542347   26946 certs.go:194] generating shared ca certs ...

	I0930 11:13:49.542362   26946 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:13:49.542476   26946 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 11:13:49.542515   26946 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 11:13:49.542525   26946 certs.go:256] generating profile certs ...

	I0930 11:13:49.542591   26946 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key

	I0930 11:13:49.542615   26946 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37

	I0930 11:13:49.542628   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.249 192.168.39.3 192.168.39.238 192.168.39.254]

	I0930 11:13:49.661476   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37 ...

	I0930 11:13:49.661515   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37: {Name:mk149c204bf31f855e781b37ed00d2d45943dc74 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:13:49.661762   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37 ...

	I0930 11:13:49.661785   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37: {Name:mka1c6759c2661bfc3ab07f3168b7da60e9fc340 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:13:49.661922   26946 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt

	I0930 11:13:49.662094   26946 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key

	I0930 11:13:49.662275   26946 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key

	I0930 11:13:49.662294   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0930 11:13:49.662313   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0930 11:13:49.662333   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0930 11:13:49.662351   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0930 11:13:49.662368   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0930 11:13:49.662384   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0930 11:13:49.662452   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0930 11:13:49.677713   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0930 11:13:49.677801   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem (1338 bytes)

	W0930 11:13:49.677835   26946 certs.go:480] ignoring /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009_empty.pem, impossibly tiny 0 bytes

	I0930 11:13:49.677845   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 11:13:49.677866   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 11:13:49.677888   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 11:13:49.677908   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 11:13:49.677944   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:13:49.677971   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem -> /usr/share/ca-certificates/11009.pem

	I0930 11:13:49.677983   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /usr/share/ca-certificates/110092.pem

	I0930 11:13:49.677997   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:49.678030   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:13:49.681296   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:49.681887   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:13:49.681920   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:49.682144   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:13:49.682365   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:13:49.682543   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:13:49.682691   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:13:49.766051   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I0930 11:13:49.771499   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0930 11:13:49.783878   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I0930 11:13:49.789403   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0930 11:13:49.801027   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I0930 11:13:49.806774   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0930 11:13:49.824334   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I0930 11:13:49.828617   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0930 11:13:49.838958   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I0930 11:13:49.843225   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0930 11:13:49.853655   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I0930 11:13:49.857681   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0930 11:13:49.869752   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 11:13:49.897794   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 11:13:49.925363   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 11:13:49.951437   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 11:13:49.978863   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0930 11:13:50.005498   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0930 11:13:50.030426   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 11:13:50.055825   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 11:13:50.080625   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem --> /usr/share/ca-certificates/11009.pem (1338 bytes)

	I0930 11:13:50.113315   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /usr/share/ca-certificates/110092.pem (1708 bytes)

	I0930 11:13:50.142931   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 11:13:50.168186   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0930 11:13:50.185792   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0930 11:13:50.203667   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0930 11:13:50.222202   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0930 11:13:50.241795   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0930 11:13:50.260704   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0930 11:13:50.278865   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0930 11:13:50.296763   26946 ssh_runner.go:195] Run: openssl version

	I0930 11:13:50.303234   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 11:13:50.314412   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:50.319228   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:50.319276   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:50.325090   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 11:13:50.337510   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009.pem && ln -fs /usr/share/ca-certificates/11009.pem /etc/ssl/certs/11009.pem"

	I0930 11:13:50.351103   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009.pem

	I0930 11:13:50.356273   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 30 11:01 /usr/share/ca-certificates/11009.pem

	I0930 11:13:50.356331   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009.pem

	I0930 11:13:50.362227   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11009.pem /etc/ssl/certs/51391683.0"

	I0930 11:13:50.373066   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110092.pem && ln -fs /usr/share/ca-certificates/110092.pem /etc/ssl/certs/110092.pem"

	I0930 11:13:50.384243   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110092.pem

	I0930 11:13:50.388958   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 30 11:01 /usr/share/ca-certificates/110092.pem

	I0930 11:13:50.389012   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110092.pem

	I0930 11:13:50.394820   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110092.pem /etc/ssl/certs/3ec20f2e.0"

	I0930 11:13:50.406295   26946 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 11:13:50.410622   26946 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 11:13:50.410674   26946 kubeadm.go:934] updating node {m03 192.168.39.238 8443 v1.31.1 crio true true} ...

	I0930 11:13:50.410806   26946 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-033260-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.238

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 11:13:50.410833   26946 kube-vip.go:115] generating kube-vip config ...

	I0930 11:13:50.410873   26946 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0930 11:13:50.426800   26946 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0930 11:13:50.426870   26946 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0930 11:13:50.426931   26946 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 11:13:50.437767   26946 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.1: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.1': No such file or directory

	Initiating transfer...

	I0930 11:13:50.437827   26946 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.1

	I0930 11:13:50.448545   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet.sha256

	I0930 11:13:50.448565   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm.sha256

	I0930 11:13:50.448591   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm -> /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:13:50.448597   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl.sha256

	I0930 11:13:50.448619   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl -> /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:13:50.448655   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:13:50.448668   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:13:50.448599   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:13:50.460142   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubeadm': No such file or directory

	I0930 11:13:50.460178   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm --> /var/lib/minikube/binaries/v1.31.1/kubeadm (58290328 bytes)

	I0930 11:13:50.460491   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubectl': No such file or directory

	I0930 11:13:50.460521   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl --> /var/lib/minikube/binaries/v1.31.1/kubectl (56381592 bytes)

	I0930 11:13:50.475258   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet -> /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:13:50.475370   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:13:50.603685   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubelet': No such file or directory

	I0930 11:13:50.603734   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet --> /var/lib/minikube/binaries/v1.31.1/kubelet (76869944 bytes)

	I0930 11:13:51.331864   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0930 11:13:51.343111   26946 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0930 11:13:51.361905   26946 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 11:13:51.380114   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0930 11:13:51.398229   26946 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0930 11:13:51.402565   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:13:51.414789   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:13:51.547939   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:13:51.568598   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:13:51.569032   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:51.569117   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:51.584541   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45637

	I0930 11:13:51.585019   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:51.585485   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:51.585506   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:51.585824   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:51.586011   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:13:51.586156   26946 start.go:317] joinCluster: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Cluster

Name:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.238 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:fal

se istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false D

isableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 11:13:51.586275   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0930 11:13:51.586294   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:13:51.589730   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:51.590160   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:13:51.590189   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:51.590326   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:13:51.590673   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:13:51.590813   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:13:51.590943   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:13:51.742155   26946 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.238 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:13:51.742217   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token ve4s5e.z27uafhrt4vwx76f --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m03 --control-plane --apiserver-advertise-address=192.168.39.238 --apiserver-bind-port=8443"

	I0930 11:14:14.534669   26946 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token ve4s5e.z27uafhrt4vwx76f --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m03 --control-plane --apiserver-advertise-address=192.168.39.238 --apiserver-bind-port=8443": (22.792425292s)

	I0930 11:14:14.534703   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0930 11:14:15.090933   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-033260-m03 minikube.k8s.io/updated_at=2024_09_30T11_14_15_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=ha-033260 minikube.k8s.io/primary=false

	I0930 11:14:15.217971   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-033260-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0930 11:14:15.356327   26946 start.go:319] duration metric: took 23.770167838s to joinCluster

	I0930 11:14:15.356406   26946 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.238 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:14:15.356782   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:14:15.358117   26946 out.go:177] * Verifying Kubernetes components...

	I0930 11:14:15.359571   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:14:15.622789   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:14:15.640897   26946 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:14:15.641233   26946 kapi.go:59] client config for ha-033260: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt", KeyFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key", CAFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1f685c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0930 11:14:15.641327   26946 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.249:8443

	I0930 11:14:15.641657   26946 node_ready.go:35] waiting up to 6m0s for node "ha-033260-m03" to be "Ready" ...

	I0930 11:14:15.641759   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:15.641771   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:15.641783   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:15.641790   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:15.644778   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:14:16.142790   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:16.142817   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:16.142829   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:16.142842   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:16.146568   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:16.642107   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:16.642131   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:16.642142   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:16.642147   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:16.648466   26946 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0930 11:14:17.142339   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:17.142362   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:17.142375   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:17.142381   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:17.146498   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:17.642900   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:17.642921   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:17.642930   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:17.642934   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:17.646792   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:17.647749   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:18.141856   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:18.141880   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:18.141889   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:18.141893   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:18.145059   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:18.641848   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:18.641883   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:18.641896   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:18.641905   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:18.645609   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:19.142000   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:19.142030   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:19.142041   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:19.142046   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:19.146124   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:19.642709   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:19.642734   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:19.642746   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:19.642751   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:19.647278   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:19.648375   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:20.142851   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:20.142871   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:20.142879   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:20.142883   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:20.146328   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:20.642913   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:20.642940   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:20.642954   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:20.642961   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:20.653974   26946 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0930 11:14:21.142909   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:21.142931   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:21.142942   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:21.142954   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:21.146862   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:21.642348   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:21.642373   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:21.642383   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:21.642388   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:21.647699   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:14:22.142178   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:22.142198   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:22.142206   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:22.142210   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:22.145760   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:22.146824   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:22.642895   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:22.642917   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:22.642925   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:22.642931   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:22.648085   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:14:23.141847   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:23.141872   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:23.141883   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:23.141888   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:23.149699   26946 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0930 11:14:23.641992   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:23.642013   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:23.642023   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:23.642029   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:23.645640   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:24.142073   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:24.142096   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:24.142104   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:24.142108   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:24.146322   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:24.146891   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:24.642695   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:24.642716   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:24.642724   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:24.642731   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:24.646216   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:25.142500   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:25.142538   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:25.142546   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:25.142552   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:25.146687   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:25.642542   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:25.642566   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:25.642573   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:25.642577   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:25.646661   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:26.142499   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:26.142535   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:26.142545   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:26.142552   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:26.146202   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:26.147018   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:26.642712   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:26.642739   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:26.642751   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:26.642756   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:26.646338   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:27.142246   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:27.142276   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:27.142286   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:27.142292   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:27.146473   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:27.642325   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:27.642347   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:27.642355   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:27.642359   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:27.646109   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:28.142885   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:28.142912   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:28.142923   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:28.142929   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:28.146499   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:28.147250   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:28.642625   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:28.642652   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:28.642663   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:28.642669   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:28.646618   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:29.142391   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:29.142412   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:29.142420   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:29.142424   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:29.146320   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:29.642615   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:29.642640   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:29.642649   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:29.642653   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:29.646130   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:30.142916   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:30.142938   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:30.142947   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:30.142951   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:30.146109   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:30.642863   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:30.642885   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:30.642893   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:30.642897   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:30.646458   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:30.647204   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:31.142601   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:31.142623   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.142631   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.142635   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.146623   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.642077   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:31.642103   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.642114   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.642119   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.645322   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.645964   26946 node_ready.go:49] node "ha-033260-m03" has status "Ready":"True"

	I0930 11:14:31.645987   26946 node_ready.go:38] duration metric: took 16.004306964s for node "ha-033260-m03" to be "Ready" ...

	I0930 11:14:31.645997   26946 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:14:31.646075   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:31.646090   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.646099   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.646106   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.653396   26946 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0930 11:14:31.663320   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.663400   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-5frmm

	I0930 11:14:31.663405   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.663412   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.663420   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.666829   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.667522   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:31.667537   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.667544   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.667550   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.670668   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.671278   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.671301   26946 pod_ready.go:82] duration metric: took 7.951059ms for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.671309   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.671362   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-kt87v

	I0930 11:14:31.671369   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.671376   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.671383   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.674317   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:14:31.675093   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:31.675107   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.675114   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.675120   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.678167   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.678702   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.678717   26946 pod_ready.go:82] duration metric: took 7.402263ms for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.678725   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.678775   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260

	I0930 11:14:31.678782   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.678789   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.678794   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.682042   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.683033   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:31.683050   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.683060   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.683067   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.686124   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.686928   26946 pod_ready.go:93] pod "etcd-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.686944   26946 pod_ready.go:82] duration metric: took 8.212366ms for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.686951   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.687047   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m02

	I0930 11:14:31.687059   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.687068   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.687077   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.690190   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.690825   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:31.690840   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.690850   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.690858   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.693597   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:14:31.694016   26946 pod_ready.go:93] pod "etcd-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.694032   26946 pod_ready.go:82] duration metric: took 7.073598ms for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.694050   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.842476   26946 request.go:632] Waited for 148.347924ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m03

	I0930 11:14:31.842535   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m03

	I0930 11:14:31.842540   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.842547   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.842551   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.846779   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:32.042378   26946 request.go:632] Waited for 194.977116ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:32.042433   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:32.042441   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.042451   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.042460   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.046938   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:32.047883   26946 pod_ready.go:93] pod "etcd-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:32.047901   26946 pod_ready.go:82] duration metric: took 353.843104ms for pod "etcd-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.047915   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.242541   26946 request.go:632] Waited for 194.549595ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:14:32.242605   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:14:32.242614   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.242625   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.242634   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.246270   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.443112   26946 request.go:632] Waited for 196.194005ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:32.443180   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:32.443188   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.443196   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.443204   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.446839   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.447484   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:32.447503   26946 pod_ready.go:82] duration metric: took 399.580784ms for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.447514   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.642591   26946 request.go:632] Waited for 194.994624ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:14:32.642658   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:14:32.642663   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.642670   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.642674   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.646484   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.842626   26946 request.go:632] Waited for 195.406068ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:32.842682   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:32.842700   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.842723   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.842729   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.846693   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.847589   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:32.847611   26946 pod_ready.go:82] duration metric: took 400.088499ms for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.847622   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.042743   26946 request.go:632] Waited for 195.040991ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m03

	I0930 11:14:33.042794   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m03

	I0930 11:14:33.042810   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.042822   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.042831   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.047437   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:33.242766   26946 request.go:632] Waited for 194.350243ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:33.242826   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:33.242831   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.242838   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.242842   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.246530   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:33.247420   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:33.247442   26946 pod_ready.go:82] duration metric: took 399.811844ms for pod "kube-apiserver-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.247458   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.442488   26946 request.go:632] Waited for 194.945176ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:14:33.442539   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:14:33.442545   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.442552   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.442555   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.446162   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:33.642540   26946 request.go:632] Waited for 195.369281ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:33.642603   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:33.642609   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.642615   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.642620   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.646221   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:33.646635   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:33.646655   26946 pod_ready.go:82] duration metric: took 399.188776ms for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.646667   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.843125   26946 request.go:632] Waited for 196.391494ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:14:33.843216   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:14:33.843227   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.843238   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.843244   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.846706   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.042579   26946 request.go:632] Waited for 195.024865ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.042680   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.042689   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.042697   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.042701   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.046091   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.046788   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:34.046810   26946 pod_ready.go:82] duration metric: took 400.13538ms for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.046823   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.242282   26946 request.go:632] Waited for 195.389369ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m03

	I0930 11:14:34.242349   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m03

	I0930 11:14:34.242356   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.242365   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.242370   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.246179   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.442166   26946 request.go:632] Waited for 195.280581ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:34.442224   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:34.442230   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.442237   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.442240   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.445326   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.445954   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:34.445978   26946 pod_ready.go:82] duration metric: took 399.145783ms for pod "kube-controller-manager-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.445991   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.643049   26946 request.go:632] Waited for 196.981464ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:14:34.643124   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:14:34.643131   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.643141   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.643148   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.647040   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.843108   26946 request.go:632] Waited for 195.398341ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.843190   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.843212   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.843227   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.843238   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.846825   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.847411   26946 pod_ready.go:93] pod "kube-proxy-fckwn" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:34.847432   26946 pod_ready.go:82] duration metric: took 401.432801ms for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.847445   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fctld" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.043014   26946 request.go:632] Waited for 195.507309ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fctld

	I0930 11:14:35.043093   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fctld

	I0930 11:14:35.043102   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.043109   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.043117   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.046836   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.242781   26946 request.go:632] Waited for 195.218665ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:35.242851   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:35.242856   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.242862   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.242866   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.246468   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.247353   26946 pod_ready.go:93] pod "kube-proxy-fctld" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:35.247380   26946 pod_ready.go:82] duration metric: took 399.923772ms for pod "kube-proxy-fctld" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.247393   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.442345   26946 request.go:632] Waited for 194.883869ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:14:35.442516   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:14:35.442529   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.442541   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.442550   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.446031   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.642937   26946 request.go:632] Waited for 196.342972ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:35.642985   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:35.642990   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.642997   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.643001   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.646624   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.647369   26946 pod_ready.go:93] pod "kube-proxy-mxvxr" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:35.647389   26946 pod_ready.go:82] duration metric: took 399.989175ms for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.647398   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.842485   26946 request.go:632] Waited for 195.020246ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:14:35.842575   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:14:35.842586   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.842597   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.842605   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.845997   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.043063   26946 request.go:632] Waited for 196.343615ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:36.043113   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:36.043119   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.043125   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.043131   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.046327   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.046783   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:36.046799   26946 pod_ready.go:82] duration metric: took 399.395226ms for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.046810   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.242936   26946 request.go:632] Waited for 196.062784ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:14:36.243003   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:14:36.243024   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.243037   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.243046   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.246888   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.442803   26946 request.go:632] Waited for 195.27104ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:36.442859   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:36.442867   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.442877   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.442888   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.446304   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.446972   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:36.447001   26946 pod_ready.go:82] duration metric: took 400.183775ms for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.447011   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.642468   26946 request.go:632] Waited for 195.395201ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m03

	I0930 11:14:36.642532   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m03

	I0930 11:14:36.642538   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.642545   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.642549   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.646175   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.842841   26946 request.go:632] Waited for 195.970164ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:36.842911   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:36.842924   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.842938   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.842946   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.846452   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.847134   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:36.847153   26946 pod_ready.go:82] duration metric: took 400.136505ms for pod "kube-scheduler-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.847163   26946 pod_ready.go:39] duration metric: took 5.201155018s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:14:36.847177   26946 api_server.go:52] waiting for apiserver process to appear ...

	I0930 11:14:36.847229   26946 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0930 11:14:36.869184   26946 api_server.go:72] duration metric: took 21.512734614s to wait for apiserver process to appear ...

	I0930 11:14:36.869210   26946 api_server.go:88] waiting for apiserver healthz status ...

	I0930 11:14:36.869231   26946 api_server.go:253] Checking apiserver healthz at https://192.168.39.249:8443/healthz ...

	I0930 11:14:36.875656   26946 api_server.go:279] https://192.168.39.249:8443/healthz returned 200:

	ok

	I0930 11:14:36.875723   26946 round_trippers.go:463] GET https://192.168.39.249:8443/version

	I0930 11:14:36.875730   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.875741   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.875751   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.876680   26946 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0930 11:14:36.876763   26946 api_server.go:141] control plane version: v1.31.1

	I0930 11:14:36.876785   26946 api_server.go:131] duration metric: took 7.567961ms to wait for apiserver health ...

	I0930 11:14:36.876795   26946 system_pods.go:43] waiting for kube-system pods to appear ...

	I0930 11:14:37.042474   26946 request.go:632] Waited for 165.583212ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.042549   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.042557   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.042568   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.042577   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.049247   26946 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0930 11:14:37.056036   26946 system_pods.go:59] 24 kube-system pods found

	I0930 11:14:37.056063   26946 system_pods.go:61] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:14:37.056069   26946 system_pods.go:61] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:14:37.056073   26946 system_pods.go:61] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:14:37.056076   26946 system_pods.go:61] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:14:37.056079   26946 system_pods.go:61] "etcd-ha-033260-m03" [69f89dd9-3421-46a4-a577-4d9fc1dc2f40] Running

	I0930 11:14:37.056082   26946 system_pods.go:61] "kindnet-4rpgw" [e9fd1809-f010-4725-ad29-7c7b4978a70f] Running

	I0930 11:14:37.056085   26946 system_pods.go:61] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:14:37.056088   26946 system_pods.go:61] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:14:37.056091   26946 system_pods.go:61] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:14:37.056094   26946 system_pods.go:61] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:14:37.056097   26946 system_pods.go:61] "kube-apiserver-ha-033260-m03" [24f2e5a6-8ccd-41a4-9881-b3326db38a78] Running

	I0930 11:14:37.056100   26946 system_pods.go:61] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:14:37.056105   26946 system_pods.go:61] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:14:37.056108   26946 system_pods.go:61] "kube-controller-manager-ha-033260-m03" [aff121d2-41f1-4a58-8d41-09ee2759e183] Running

	I0930 11:14:37.056111   26946 system_pods.go:61] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:14:37.056115   26946 system_pods.go:61] "kube-proxy-fctld" [6ebb84e4-ea77-42d4-8237-30564d82cc03] Running

	I0930 11:14:37.056120   26946 system_pods.go:61] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:14:37.056151   26946 system_pods.go:61] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:14:37.056164   26946 system_pods.go:61] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:14:37.056169   26946 system_pods.go:61] "kube-scheduler-ha-033260-m03" [30086d5f-5b9b-4e93-bc1e-dee878d5ec71] Running

	I0930 11:14:37.056177   26946 system_pods.go:61] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:14:37.056182   26946 system_pods.go:61] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:14:37.056189   26946 system_pods.go:61] "kube-vip-ha-033260-m03" [043e0bff-9099-41a1-98e5-d0f6c47a853d] Running

	I0930 11:14:37.056194   26946 system_pods.go:61] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:14:37.056204   26946 system_pods.go:74] duration metric: took 179.399341ms to wait for pod list to return data ...

	I0930 11:14:37.056216   26946 default_sa.go:34] waiting for default service account to be created ...

	I0930 11:14:37.242741   26946 request.go:632] Waited for 186.4192ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:14:37.242795   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:14:37.242800   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.242807   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.242813   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.247153   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:37.247269   26946 default_sa.go:45] found service account: "default"

	I0930 11:14:37.247285   26946 default_sa.go:55] duration metric: took 191.060236ms for default service account to be created ...

	I0930 11:14:37.247292   26946 system_pods.go:116] waiting for k8s-apps to be running ...

	I0930 11:14:37.442756   26946 request.go:632] Waited for 195.39174ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.442830   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.442840   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.442850   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.442861   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.450094   26946 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0930 11:14:37.457440   26946 system_pods.go:86] 24 kube-system pods found

	I0930 11:14:37.457477   26946 system_pods.go:89] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:14:37.457485   26946 system_pods.go:89] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:14:37.457491   26946 system_pods.go:89] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:14:37.457497   26946 system_pods.go:89] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:14:37.457506   26946 system_pods.go:89] "etcd-ha-033260-m03" [69f89dd9-3421-46a4-a577-4d9fc1dc2f40] Running

	I0930 11:14:37.457512   26946 system_pods.go:89] "kindnet-4rpgw" [e9fd1809-f010-4725-ad29-7c7b4978a70f] Running

	I0930 11:14:37.457518   26946 system_pods.go:89] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:14:37.457524   26946 system_pods.go:89] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:14:37.457530   26946 system_pods.go:89] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:14:37.457538   26946 system_pods.go:89] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:14:37.457547   26946 system_pods.go:89] "kube-apiserver-ha-033260-m03" [24f2e5a6-8ccd-41a4-9881-b3326db38a78] Running

	I0930 11:14:37.457553   26946 system_pods.go:89] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:14:37.457562   26946 system_pods.go:89] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:14:37.457569   26946 system_pods.go:89] "kube-controller-manager-ha-033260-m03" [aff121d2-41f1-4a58-8d41-09ee2759e183] Running

	I0930 11:14:37.457575   26946 system_pods.go:89] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:14:37.457584   26946 system_pods.go:89] "kube-proxy-fctld" [6ebb84e4-ea77-42d4-8237-30564d82cc03] Running

	I0930 11:14:37.457590   26946 system_pods.go:89] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:14:37.457597   26946 system_pods.go:89] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:14:37.457603   26946 system_pods.go:89] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:14:37.457612   26946 system_pods.go:89] "kube-scheduler-ha-033260-m03" [30086d5f-5b9b-4e93-bc1e-dee878d5ec71] Running

	I0930 11:14:37.457630   26946 system_pods.go:89] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:14:37.457637   26946 system_pods.go:89] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:14:37.457643   26946 system_pods.go:89] "kube-vip-ha-033260-m03" [043e0bff-9099-41a1-98e5-d0f6c47a853d] Running

	I0930 11:14:37.457648   26946 system_pods.go:89] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:14:37.457657   26946 system_pods.go:126] duration metric: took 210.359061ms to wait for k8s-apps to be running ...

	I0930 11:14:37.457669   26946 system_svc.go:44] waiting for kubelet service to be running ....

	I0930 11:14:37.457721   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:14:37.476929   26946 system_svc.go:56] duration metric: took 19.252575ms WaitForService to wait for kubelet

	I0930 11:14:37.476958   26946 kubeadm.go:582] duration metric: took 22.120515994s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 11:14:37.476982   26946 node_conditions.go:102] verifying NodePressure condition ...

	I0930 11:14:37.642377   26946 request.go:632] Waited for 165.309074ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes

	I0930 11:14:37.642424   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes

	I0930 11:14:37.642429   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.642438   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.642449   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.646747   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:37.647864   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:14:37.647885   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:14:37.647896   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:14:37.647900   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:14:37.647904   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:14:37.647908   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:14:37.647912   26946 node_conditions.go:105] duration metric: took 170.925329ms to run NodePressure ...

	I0930 11:14:37.647922   26946 start.go:241] waiting for startup goroutines ...

	I0930 11:14:37.647945   26946 start.go:255] writing updated cluster config ...

	I0930 11:14:37.648212   26946 ssh_runner.go:195] Run: rm -f paused

	I0930 11:14:37.699426   26946 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)

	I0930 11:14:37.701518   26946 out.go:177] * Done! kubectl is now configured to use "ha-033260" cluster and "default" namespace by default

	==> CRI-O <==

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.617324073Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695095617302226,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=e6a08c13-8990-4d98-b984-40b7a175d54e name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.617941634Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=f49d40cf-1c30-43ce-93ac-2b12fdd2b55e name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.618004340Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=f49d40cf-1c30-43ce-93ac-2b12fdd2b55e name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.618245262Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=f49d40cf-1c30-43ce-93ac-2b12fdd2b55e name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.658043988Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=74deb4af-02e5-4e2a-b6ad-4849d7ee3570 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.658122694Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=74deb4af-02e5-4e2a-b6ad-4849d7ee3570 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.659430208Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=012c177f-5e41-461c-8f55-d7d6761e9581 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.659933978Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695095659908850,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=012c177f-5e41-461c-8f55-d7d6761e9581 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.660481536Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=9a4f9679-42d9-451d-96e1-d6c329f0622d name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.660537065Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=9a4f9679-42d9-451d-96e1-d6c329f0622d name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.661514982Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=9a4f9679-42d9-451d-96e1-d6c329f0622d name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.703871312Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=5b8b85c0-cf63-4bac-b182-002cf991510b name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.703951780Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=5b8b85c0-cf63-4bac-b182-002cf991510b name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.705548885Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=690a4d48-1143-46c9-9bbe-d909f7dd1770 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.706036221Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695095706005388,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=690a4d48-1143-46c9-9bbe-d909f7dd1770 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.706609185Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=305721fd-ae9c-466a-a180-e685364ef5cf name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.706725734Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=305721fd-ae9c-466a-a180-e685364ef5cf name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.706983739Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=305721fd-ae9c-466a-a180-e685364ef5cf name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.746022471Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=2c29d4b1-3fd4-4f98-a872-704bd3fba730 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.746230911Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=2c29d4b1-3fd4-4f98-a872-704bd3fba730 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.747802019Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=701f4c21-e152-46dc-ad89-06ce66da9e11 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.748293318Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695095748262276,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=701f4c21-e152-46dc-ad89-06ce66da9e11 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.749109295Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=3a1a4af3-9972-452e-9130-2c7ad134b75e name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.749183870Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3a1a4af3-9972-452e-9130-2c7ad134b75e name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:15 ha-033260 crio[660]: time="2024-09-30 11:18:15.749499726Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3a1a4af3-9972-452e-9130-2c7ad134b75e name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	970aed3b1f96b       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   e5a4e140afd6a       busybox-7dff88458-nbhwc

	856f46390ed07       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      5 minutes ago       Running             coredns                   0                   ee2a6eb69b10a       coredns-7c65d6cfc9-kt87v

	f612e29e1b4eb       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      5 minutes ago       Running             storage-provisioner       0                   571ace347c86d       storage-provisioner

	2aac013f37bf9       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      5 minutes ago       Running             coredns                   0                   724d02dce7a0d       coredns-7c65d6cfc9-5frmm

	347597ebf9b20       60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561                                      6 minutes ago       Running             kube-proxy                0                   b08b772dab41d       kube-proxy-mxvxr

	6cf899810e161       12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f                                      6 minutes ago       Running             kindnet-cni               0                   b2990036962da       kindnet-g94k6

	7a9e01197e5c6       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     6 minutes ago       Running             kube-vip                  0                   2bd722c6afa63       kube-vip-ha-033260

	aa8ecc81d0af2       2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4                                      6 minutes ago       Running             etcd                      0                   f789f882a4d3c       etcd-ha-033260

	e62c0a6cc031f       175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1                                      6 minutes ago       Running             kube-controller-manager   0                   6bdfa51706557       kube-controller-manager-ha-033260

	2435a21a0f6f8       9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b                                      6 minutes ago       Running             kube-scheduler            0                   fd27dbf29ee9b       kube-scheduler-ha-033260

	cd2027f0a04e1       6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee                                      6 minutes ago       Running             kube-apiserver            0                   676d3fbaf3e6f       kube-apiserver-ha-033260

	==> coredns [2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7] <==

	[INFO] 10.244.1.2:53856 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00078279s

	[INFO] 10.244.0.4:40457 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001984462s

	[INFO] 10.244.2.2:53822 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 31 0.006986108s

	[INFO] 10.244.2.2:56668 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001677174s

	[INFO] 10.244.1.2:39538 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000172765s

	[INFO] 10.244.1.2:52635 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.028646205s

	[INFO] 10.244.1.2:41853 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000176274s

	[INFO] 10.244.1.2:35962 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000170835s

	[INFO] 10.244.0.4:41550 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130972s

	[INFO] 10.244.0.4:32938 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000173381s

	[INFO] 10.244.0.4:56409 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000073902s

	[INFO] 10.244.2.2:58163 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000268677s

	[INFO] 10.244.2.2:36365 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00010796s

	[INFO] 10.244.2.2:56656 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000115088s

	[INFO] 10.244.2.2:56306 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000139171s

	[INFO] 10.244.1.2:35824 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000200215s

	[INFO] 10.244.1.2:55897 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000096777s

	[INFO] 10.244.1.2:41692 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000109849s

	[INFO] 10.244.0.4:40290 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000106794s

	[INFO] 10.244.0.4:46779 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000132069s

	[INFO] 10.244.1.2:51125 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000201243s

	[INFO] 10.244.1.2:54698 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000184568s

	[INFO] 10.244.0.4:53882 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000193917s

	[INFO] 10.244.0.4:47773 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000121126s

	[INFO] 10.244.2.2:58238 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000117978s

	==> coredns [856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0] <==

	[INFO] 10.244.1.2:57277 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000266561s

	[INFO] 10.244.1.2:48530 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000385853s

	[INFO] 10.244.0.4:37489 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002109336s

	[INFO] 10.244.0.4:53881 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000132699s

	[INFO] 10.244.0.4:35131 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000120989s

	[INFO] 10.244.0.4:53761 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001344827s

	[INFO] 10.244.0.4:59481 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000051804s

	[INFO] 10.244.2.2:39523 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000137336s

	[INFO] 10.244.2.2:35477 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002190323s

	[INFO] 10.244.2.2:37515 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001525471s

	[INFO] 10.244.2.2:34201 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000119381s

	[INFO] 10.244.1.2:42886 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000230949s

	[INFO] 10.244.0.4:43156 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000079033s

	[INFO] 10.244.0.4:55330 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00010674s

	[INFO] 10.244.2.2:47730 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000245903s

	[INFO] 10.244.2.2:54559 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000165285s

	[INFO] 10.244.2.2:56225 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000115859s

	[INFO] 10.244.2.2:54334 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.0001069s

	[INFO] 10.244.1.2:43809 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130742s

	[INFO] 10.244.1.2:56685 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000199555s

	[INFO] 10.244.0.4:44188 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000154269s

	[INFO] 10.244.0.4:56530 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000138351s

	[INFO] 10.244.2.2:34814 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000138709s

	[INFO] 10.244.2.2:49549 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000124443s

	[INFO] 10.244.2.2:35669 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000100712s

	==> describe nodes <==

	Name:               ha-033260

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_30T11_12_00_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:11:56 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:18:08 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:11:55 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:11:55 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:11:55 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:12:18 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.249

	  Hostname:    ha-033260

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 285e64dc8d10442694303513a400e333

	  System UUID:                285e64dc-8d10-4426-9430-3513a400e333

	  Boot ID:                    e1ab2d78-3004-455b-b8b3-86a48689299f

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-nbhwc              0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m38s

	  kube-system                 coredns-7c65d6cfc9-5frmm             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m12s

	  kube-system                 coredns-7c65d6cfc9-kt87v             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m12s

	  kube-system                 etcd-ha-033260                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         6m17s

	  kube-system                 kindnet-g94k6                        100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      6m12s

	  kube-system                 kube-apiserver-ha-033260             250m (12%)    0 (0%)      0 (0%)           0 (0%)         6m17s

	  kube-system                 kube-controller-manager-ha-033260    200m (10%)    0 (0%)      0 (0%)           0 (0%)         6m17s

	  kube-system                 kube-proxy-mxvxr                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m12s

	  kube-system                 kube-scheduler-ha-033260             100m (5%)     0 (0%)      0 (0%)           0 (0%)         6m17s

	  kube-system                 kube-vip-ha-033260                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m19s

	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m12s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%)   100m (5%)

	  memory             290Mi (13%)  390Mi (18%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m9s   kube-proxy       

	  Normal  Starting                 6m17s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m17s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m17s  kubelet          Node ha-033260 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m17s  kubelet          Node ha-033260 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m17s  kubelet          Node ha-033260 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m13s  node-controller  Node ha-033260 event: Registered Node ha-033260 in Controller

	  Normal  NodeReady                5m58s  kubelet          Node ha-033260 status is now: NodeReady

	  Normal  RegisteredNode           5m13s  node-controller  Node ha-033260 event: Registered Node ha-033260 in Controller

	  Normal  RegisteredNode           3m56s  node-controller  Node ha-033260 event: Registered Node ha-033260 in Controller

	Name:               ha-033260-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_09_30T11_12_57_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:12:54 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:15:48 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.3

	  Hostname:    ha-033260-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 1504aa96b0e7414e83ec57ce754ea274

	  System UUID:                1504aa96-b0e7-414e-83ec-57ce754ea274

	  Boot ID:                    08e05cdc-874f-4f82-99d4-84bb26fd07ac

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-748nr                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m38s

	  kube-system                 etcd-ha-033260-m02                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         5m20s

	  kube-system                 kindnet-752cm                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      5m22s

	  kube-system                 kube-apiserver-ha-033260-m02             250m (12%)    0 (0%)      0 (0%)           0 (0%)         5m21s

	  kube-system                 kube-controller-manager-ha-033260-m02    200m (10%)    0 (0%)      0 (0%)           0 (0%)         5m17s

	  kube-system                 kube-proxy-fckwn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m22s

	  kube-system                 kube-scheduler-ha-033260-m02             100m (5%)     0 (0%)      0 (0%)           0 (0%)         5m21s

	  kube-system                 kube-vip-ha-033260-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m18s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m16s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  5m22s (x8 over 5m22s)  kubelet          Node ha-033260-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m22s (x8 over 5m22s)  kubelet          Node ha-033260-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m22s (x7 over 5m22s)  kubelet          Node ha-033260-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5m22s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           5m18s                  node-controller  Node ha-033260-m02 event: Registered Node ha-033260-m02 in Controller

	  Normal  RegisteredNode           5m13s                  node-controller  Node ha-033260-m02 event: Registered Node ha-033260-m02 in Controller

	  Normal  RegisteredNode           3m56s                  node-controller  Node ha-033260-m02 event: Registered Node ha-033260-m02 in Controller

	  Normal  NodeNotReady             105s                   node-controller  Node ha-033260-m02 status is now: NodeNotReady

	Name:               ha-033260-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_09_30T11_14_15_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:14:11 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:18:07 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:11 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:11 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:11 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:31 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.238

	  Hostname:    ha-033260-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 581b37e2b76245bf813ddd1801a6b9a3

	  System UUID:                581b37e2-b762-45bf-813d-dd1801a6b9a3

	  Boot ID:                    92c7790b-7ee9-43e4-b1b8-fd69ae5fa989

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-rkczc                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m38s

	  kube-system                 etcd-ha-033260-m03                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         4m3s

	  kube-system                 kindnet-4rpgw                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      4m5s

	  kube-system                 kube-apiserver-ha-033260-m03             250m (12%)    0 (0%)      0 (0%)           0 (0%)         4m3s

	  kube-system                 kube-controller-manager-ha-033260-m03    200m (10%)    0 (0%)      0 (0%)           0 (0%)         4m3s

	  kube-system                 kube-proxy-fctld                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m5s

	  kube-system                 kube-scheduler-ha-033260-m03             100m (5%)     0 (0%)      0 (0%)           0 (0%)         4m3s

	  kube-system                 kube-vip-ha-033260-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m1s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 3m59s                kube-proxy       

	  Normal  NodeHasSufficientMemory  4m5s (x8 over 4m5s)  kubelet          Node ha-033260-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m5s (x8 over 4m5s)  kubelet          Node ha-033260-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m5s (x7 over 4m5s)  kubelet          Node ha-033260-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m5s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m3s                 node-controller  Node ha-033260-m03 event: Registered Node ha-033260-m03 in Controller

	  Normal  RegisteredNode           4m3s                 node-controller  Node ha-033260-m03 event: Registered Node ha-033260-m03 in Controller

	  Normal  RegisteredNode           3m56s                node-controller  Node ha-033260-m03 event: Registered Node ha-033260-m03 in Controller

	Name:               ha-033260-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_09_30T11_15_15_0700

	                    minikube.k8s.io/version=v1.34.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:15:14 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:18:07 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:14 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:14 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:14 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:34 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.104

	  Hostname:    ha-033260-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 3f7e5ab5969e49808de6a4938b82b604

	  System UUID:                3f7e5ab5-969e-4980-8de6-a4938b82b604

	  Boot ID:                    15a5a2bf-b69b-4b89-b5f2-f6529ae084b3

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-kb2cp       100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      3m2s

	  kube-system                 kube-proxy-cr58q    0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m2s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%)  100m (5%)

	  memory             50Mi (2%)  50Mi (2%)

	  ephemeral-storage  0 (0%)     0 (0%)

	  hugepages-2Mi      0 (0%)     0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m56s                kube-proxy       

	  Normal  NodeHasSufficientMemory  3m2s (x2 over 3m2s)  kubelet          Node ha-033260-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m2s (x2 over 3m2s)  kubelet          Node ha-033260-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m2s (x2 over 3m2s)  kubelet          Node ha-033260-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m2s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m1s                 node-controller  Node ha-033260-m04 event: Registered Node ha-033260-m04 in Controller

	  Normal  RegisteredNode           2m58s                node-controller  Node ha-033260-m04 event: Registered Node ha-033260-m04 in Controller

	  Normal  RegisteredNode           2m58s                node-controller  Node ha-033260-m04 event: Registered Node ha-033260-m04 in Controller

	  Normal  NodeReady                2m42s                kubelet          Node ha-033260-m04 status is now: NodeReady

	==> dmesg <==

	[Sep30 11:11] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050905] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.040385] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.839402] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.653040] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.597753] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +9.651623] systemd-fstab-generator[584]: Ignoring "noauto" option for root device

	[  +0.057096] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.058580] systemd-fstab-generator[596]: Ignoring "noauto" option for root device

	[  +0.170861] systemd-fstab-generator[610]: Ignoring "noauto" option for root device

	[  +0.144465] systemd-fstab-generator[622]: Ignoring "noauto" option for root device

	[  +0.293344] systemd-fstab-generator[651]: Ignoring "noauto" option for root device

	[  +4.055212] systemd-fstab-generator[744]: Ignoring "noauto" option for root device

	[  +4.356595] systemd-fstab-generator[883]: Ignoring "noauto" option for root device

	[  +0.065791] kauditd_printk_skb: 158 callbacks suppressed

	[  +7.315036] systemd-fstab-generator[1300]: Ignoring "noauto" option for root device

	[  +0.090322] kauditd_printk_skb: 79 callbacks suppressed

	[Sep30 11:12] kauditd_printk_skb: 21 callbacks suppressed

	[ +12.137075] kauditd_printk_skb: 38 callbacks suppressed

	[Sep30 11:13] kauditd_printk_skb: 24 callbacks suppressed

	==> etcd [aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8] <==

	{"level":"warn","ts":"2024-09-30T11:18:15.650603Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:15.751289Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:15.808718Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:15.810705Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:15.850840Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:15.951322Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.064326Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.073112Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.083882Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.088245Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.091800Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.097487Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.103978Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.110558Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.114829Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.118182Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.127906Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.134890Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.142041Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.147837Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.150742Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.152753Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.156357Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.162397Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:16.169235Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 11:18:16 up 6 min,  0 users,  load average: 0.33, 0.18, 0.08

	Linux ha-033260 5.10.207 #1 SMP Mon Sep 23 21:01:39 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346] <==

	I0930 11:17:37.855586       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	I0930 11:17:47.860490       1 main.go:295] Handling node with IPs: map[192.168.39.249:{}]

	I0930 11:17:47.860600       1 main.go:299] handling current node

	I0930 11:17:47.860694       1 main.go:295] Handling node with IPs: map[192.168.39.3:{}]

	I0930 11:17:47.860727       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	I0930 11:17:47.860874       1 main.go:295] Handling node with IPs: map[192.168.39.238:{}]

	I0930 11:17:47.860897       1 main.go:322] Node ha-033260-m03 has CIDR [10.244.2.0/24] 

	I0930 11:17:47.860960       1 main.go:295] Handling node with IPs: map[192.168.39.104:{}]

	I0930 11:17:47.860978       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:17:57.862776       1 main.go:295] Handling node with IPs: map[192.168.39.238:{}]

	I0930 11:17:57.862852       1 main.go:322] Node ha-033260-m03 has CIDR [10.244.2.0/24] 

	I0930 11:17:57.862995       1 main.go:295] Handling node with IPs: map[192.168.39.104:{}]

	I0930 11:17:57.863020       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:17:57.863078       1 main.go:295] Handling node with IPs: map[192.168.39.249:{}]

	I0930 11:17:57.863084       1 main.go:299] handling current node

	I0930 11:17:57.863098       1 main.go:295] Handling node with IPs: map[192.168.39.3:{}]

	I0930 11:17:57.863102       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	I0930 11:18:07.854593       1 main.go:295] Handling node with IPs: map[192.168.39.3:{}]

	I0930 11:18:07.854770       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	I0930 11:18:07.854951       1 main.go:295] Handling node with IPs: map[192.168.39.238:{}]

	I0930 11:18:07.854979       1 main.go:322] Node ha-033260-m03 has CIDR [10.244.2.0/24] 

	I0930 11:18:07.855034       1 main.go:295] Handling node with IPs: map[192.168.39.104:{}]

	I0930 11:18:07.855052       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:18:07.855106       1 main.go:295] Handling node with IPs: map[192.168.39.249:{}]

	I0930 11:18:07.855130       1 main.go:299] handling current node

	==> kube-apiserver [cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac] <==

	I0930 11:11:58.463989       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0930 11:11:58.477865       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.249]

	I0930 11:11:58.479372       1 controller.go:615] quota admission added evaluator for: endpoints

	I0930 11:11:58.487328       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0930 11:11:58.586099       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0930 11:11:59.517972       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0930 11:11:59.542879       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0930 11:11:59.558820       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0930 11:12:04.282712       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0930 11:12:04.376507       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E0930 11:14:41.794861       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58556: use of closed network connection

	E0930 11:14:41.976585       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58584: use of closed network connection

	E0930 11:14:42.175263       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58602: use of closed network connection

	E0930 11:14:42.398453       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58626: use of closed network connection

	E0930 11:14:42.598999       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58646: use of closed network connection

	E0930 11:14:42.786264       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58670: use of closed network connection

	E0930 11:14:42.985795       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58688: use of closed network connection

	E0930 11:14:43.164451       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58700: use of closed network connection

	E0930 11:14:43.352582       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58708: use of closed network connection

	E0930 11:14:43.634509       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58726: use of closed network connection

	E0930 11:14:43.812335       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58746: use of closed network connection

	E0930 11:14:44.006684       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58766: use of closed network connection

	E0930 11:14:44.194031       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58782: use of closed network connection

	E0930 11:14:44.561371       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58814: use of closed network connection

	W0930 11:16:08.485734       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.238 192.168.39.249]

	==> kube-controller-manager [e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489] <==

	I0930 11:15:14.593101       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:14.593158       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:14.605401       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:14.879876       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:15.297330       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:16.002721       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:18.158455       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:18.429273       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:18.922721       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-033260-m04"

	I0930 11:15:18.922856       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:19.229459       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:24.734460       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:34.561602       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:34.561906       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-033260-m04"

	I0930 11:15:34.575771       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:35.966445       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:45.204985       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:16:30.993129       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:30.994314       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-033260-m04"

	I0930 11:16:31.023898       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:31.050052       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="14.150574ms"

	I0930 11:16:31.050219       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="52.36µs"

	I0930 11:16:31.218479       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:34.045967       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:36.316239       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	==> kube-proxy [347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0930 11:12:06.949025       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0930 11:12:06.986064       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.39.249"]

	E0930 11:12:06.986193       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0930 11:12:07.041171       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0930 11:12:07.041238       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0930 11:12:07.041262       1 server_linux.go:169] "Using iptables Proxier"

	I0930 11:12:07.044020       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0930 11:12:07.044727       1 server.go:483] "Version info" version="v1.31.1"

	I0930 11:12:07.044757       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0930 11:12:07.047853       1 config.go:199] "Starting service config controller"

	I0930 11:12:07.048187       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0930 11:12:07.048613       1 config.go:105] "Starting endpoint slice config controller"

	I0930 11:12:07.048700       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0930 11:12:07.051971       1 config.go:328] "Starting node config controller"

	I0930 11:12:07.052033       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0930 11:12:07.148982       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0930 11:12:07.149026       1 shared_informer.go:320] Caches are synced for service config

	I0930 11:12:07.152927       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2] <==

	I0930 11:11:59.743507       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0930 11:14:38.641000       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-rkczc\": pod busybox-7dff88458-rkczc is already assigned to node \"ha-033260-m03\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-rkczc" node="ha-033260-m03"

	E0930 11:14:38.642588       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 12532e14-b4c0-4c7d-ab93-e96698fbc986(default/busybox-7dff88458-rkczc) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-rkczc"

	E0930 11:14:38.642720       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-rkczc\": pod busybox-7dff88458-rkczc is already assigned to node \"ha-033260-m03\"" pod="default/busybox-7dff88458-rkczc"

	I0930 11:14:38.642772       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-rkczc" node="ha-033260-m03"

	E0930 11:14:38.700019       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-nbhwc\": pod busybox-7dff88458-nbhwc is already assigned to node \"ha-033260\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-nbhwc" node="ha-033260"

	E0930 11:14:38.700408       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod e62e1e44-3723-496c-85a3-7a79e9c8264b(default/busybox-7dff88458-nbhwc) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-nbhwc"

	E0930 11:14:38.700579       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-nbhwc\": pod busybox-7dff88458-nbhwc is already assigned to node \"ha-033260\"" pod="default/busybox-7dff88458-nbhwc"

	I0930 11:14:38.700685       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-nbhwc" node="ha-033260"

	E0930 11:14:38.701396       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-748nr\": pod busybox-7dff88458-748nr is already assigned to node \"ha-033260-m02\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-748nr" node="ha-033260-m02"

	E0930 11:14:38.701487       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 004c0140-b81f-4e7b-aa0d-0aa6f7403351(default/busybox-7dff88458-748nr) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-748nr"

	E0930 11:14:38.701528       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-748nr\": pod busybox-7dff88458-748nr is already assigned to node \"ha-033260-m02\"" pod="default/busybox-7dff88458-748nr"

	I0930 11:14:38.701566       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-748nr" node="ha-033260-m02"

	E0930 11:15:14.650435       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-mkbm9\": pod kube-proxy-mkbm9 is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-mkbm9" node="ha-033260-m04"

	E0930 11:15:14.650543       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-mkbm9\": pod kube-proxy-mkbm9 is already assigned to node \"ha-033260-m04\"" pod="kube-system/kube-proxy-mkbm9"

	E0930 11:15:14.687957       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-kb2cp\": pod kindnet-kb2cp is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-kb2cp" node="ha-033260-m04"

	E0930 11:15:14.688017       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod c071322f-794b-4d6f-a33a-92077352ef5d(kube-system/kindnet-kb2cp) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-kb2cp"

	E0930 11:15:14.688032       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-kb2cp\": pod kindnet-kb2cp is already assigned to node \"ha-033260-m04\"" pod="kube-system/kindnet-kb2cp"

	I0930 11:15:14.688047       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-kb2cp" node="ha-033260-m04"

	E0930 11:15:14.701899       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-nbts6\": pod kindnet-nbts6 is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-nbts6" node="ha-033260-m04"

	E0930 11:15:14.702003       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-nbts6\": pod kindnet-nbts6 is already assigned to node \"ha-033260-m04\"" pod="kube-system/kindnet-nbts6"

	E0930 11:15:14.702565       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-cr58q\": pod kube-proxy-cr58q is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-cr58q" node="ha-033260-m04"

	E0930 11:15:14.705542       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod b2de7434-03f1-4bbc-ab62-3101483908c1(kube-system/kube-proxy-cr58q) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-cr58q"

	E0930 11:15:14.705602       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-cr58q\": pod kube-proxy-cr58q is already assigned to node \"ha-033260-m04\"" pod="kube-system/kube-proxy-cr58q"

	I0930 11:15:14.705671       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-cr58q" node="ha-033260-m04"

	==> kubelet <==

	Sep 30 11:16:59 ha-033260 kubelet[1307]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Sep 30 11:16:59 ha-033260 kubelet[1307]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Sep 30 11:16:59 ha-033260 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Sep 30 11:16:59 ha-033260 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Sep 30 11:16:59 ha-033260 kubelet[1307]: E0930 11:16:59.603405    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695019602992032,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:16:59 ha-033260 kubelet[1307]: E0930 11:16:59.603474    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695019602992032,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:09 ha-033260 kubelet[1307]: E0930 11:17:09.605544    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695029605156885,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:09 ha-033260 kubelet[1307]: E0930 11:17:09.605573    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695029605156885,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:19 ha-033260 kubelet[1307]: E0930 11:17:19.607869    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695039607317316,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:19 ha-033260 kubelet[1307]: E0930 11:17:19.608153    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695039607317316,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:29 ha-033260 kubelet[1307]: E0930 11:17:29.611241    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695049610444192,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:29 ha-033260 kubelet[1307]: E0930 11:17:29.611290    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695049610444192,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:39 ha-033260 kubelet[1307]: E0930 11:17:39.612829    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695059612275436,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:39 ha-033260 kubelet[1307]: E0930 11:17:39.613366    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695059612275436,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:49 ha-033260 kubelet[1307]: E0930 11:17:49.615817    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695069615300757,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:49 ha-033260 kubelet[1307]: E0930 11:17:49.616359    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695069615300757,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:59 ha-033260 kubelet[1307]: E0930 11:17:59.469234    1307 iptables.go:577] "Could not set up iptables canary" err=<

	Sep 30 11:17:59 ha-033260 kubelet[1307]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Sep 30 11:17:59 ha-033260 kubelet[1307]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Sep 30 11:17:59 ha-033260 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Sep 30 11:17:59 ha-033260 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Sep 30 11:17:59 ha-033260 kubelet[1307]: E0930 11:17:59.620277    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695079619430930,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:59 ha-033260 kubelet[1307]: E0930 11:17:59.620330    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695079619430930,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:18:09 ha-033260 kubelet[1307]: E0930 11:18:09.622386    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695089621956899,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:18:09 ha-033260 kubelet[1307]: E0930 11:18:09.622824    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695089621956899,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-033260 -n ha-033260

helpers_test.go:261: (dbg) Run:  kubectl --context ha-033260 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (141.53s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:390: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

ha_test.go:390: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (3.394195173s)

ha_test.go:413: expected profile "ha-033260" in json of 'profile list' to have "Degraded" status but have "Unknown" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-033260\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-033260\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"kvm2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":

1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-033260\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.39.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"crio\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.39.249\",\"Port\":8443,\"Kube

rnetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.39.3\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.39.238\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.39.104\",\"Port\":0,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\":false,\"logviewer\":false,\"

metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/home/jenkins:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\"

:262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-linux-amd64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-033260 -n ha-033260

helpers_test.go:244: <<< TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-033260 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-033260 logs -n 25: (1.354715684s)

helpers_test.go:252: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3040784691/001/cp-test_ha-033260-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260:/home/docker/cp-test_ha-033260-m03_ha-033260.txt                       |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260 sudo cat                                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m03_ha-033260.txt                                 |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m02:/home/docker/cp-test_ha-033260-m03_ha-033260-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m02 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m03_ha-033260-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m03:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04:/home/docker/cp-test_ha-033260-m03_ha-033260-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m04 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m03_ha-033260-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-033260 cp testdata/cp-test.txt                                                | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3040784691/001/cp-test_ha-033260-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260:/home/docker/cp-test_ha-033260-m04_ha-033260.txt                       |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260 sudo cat                                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m04_ha-033260.txt                                 |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m02:/home/docker/cp-test_ha-033260-m04_ha-033260-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m02 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m04_ha-033260-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-033260 cp ha-033260-m04:/home/docker/cp-test.txt                              | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m03:/home/docker/cp-test_ha-033260-m04_ha-033260-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n                                                                 | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | ha-033260-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-033260 ssh -n ha-033260-m03 sudo cat                                          | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC | 30 Sep 24 11:15 UTC |

	|         | /home/docker/cp-test_ha-033260-m04_ha-033260-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-033260 node stop m02 -v=7                                                     | ha-033260 | jenkins | v1.34.0 | 30 Sep 24 11:15 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/30 11:11:16

	Running on machine: ubuntu-20-agent-15

	Binary: Built with gc go1.23.0 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0930 11:11:16.968147   26946 out.go:345] Setting OutFile to fd 1 ...

	I0930 11:11:16.968259   26946 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 11:11:16.968268   26946 out.go:358] Setting ErrFile to fd 2...

	I0930 11:11:16.968272   26946 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0930 11:11:16.968475   26946 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19734-3842/.minikube/bin

	I0930 11:11:16.969014   26946 out.go:352] Setting JSON to false

	I0930 11:11:16.969874   26946 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":3224,"bootTime":1727691453,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0930 11:11:16.969971   26946 start.go:139] virtualization: kvm guest

	I0930 11:11:16.972340   26946 out.go:177] * [ha-033260] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	I0930 11:11:16.973700   26946 notify.go:220] Checking for updates...

	I0930 11:11:16.973712   26946 out.go:177]   - MINIKUBE_LOCATION=19734

	I0930 11:11:16.975164   26946 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0930 11:11:16.976567   26946 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:11:16.977791   26946 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:11:16.978971   26946 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0930 11:11:16.980151   26946 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0930 11:11:16.981437   26946 driver.go:394] Setting default libvirt URI to qemu:///system

	I0930 11:11:17.016837   26946 out.go:177] * Using the kvm2 driver based on user configuration

	I0930 11:11:17.017911   26946 start.go:297] selected driver: kvm2

	I0930 11:11:17.017921   26946 start.go:901] validating driver "kvm2" against <nil>

	I0930 11:11:17.017932   26946 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0930 11:11:17.018657   26946 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0930 11:11:17.018742   26946 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19734-3842/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0930 11:11:17.034306   26946 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0

	I0930 11:11:17.034349   26946 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0930 11:11:17.034586   26946 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 11:11:17.034614   26946 cni.go:84] Creating CNI manager for ""

	I0930 11:11:17.034651   26946 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0930 11:11:17.034662   26946 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0930 11:11:17.034717   26946 start.go:340] cluster config:

	{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0930 11:11:17.034818   26946 iso.go:125] acquiring lock: {Name:mk95ca253939a7801a8ba4db8c15a1a3ab4169e5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0930 11:11:17.036732   26946 out.go:177] * Starting "ha-033260" primary control-plane node in "ha-033260" cluster

	I0930 11:11:17.037780   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:11:17.037816   26946 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4

	I0930 11:11:17.037823   26946 cache.go:56] Caching tarball of preloaded images

	I0930 11:11:17.037892   26946 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 11:11:17.037903   26946 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 11:11:17.038215   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:11:17.038236   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json: {Name:mkb40a3a18f0ab7d52c306f0204aa0e145307acc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:17.038367   26946 start.go:360] acquireMachinesLock for ha-033260: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 11:11:17.038394   26946 start.go:364] duration metric: took 15.009µs to acquireMachinesLock for "ha-033260"

	I0930 11:11:17.038414   26946 start.go:93] Provisioning new machine with config: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:11:17.038466   26946 start.go:125] createHost starting for "" (driver="kvm2")

	I0930 11:11:17.039863   26946 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0930 11:11:17.039975   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:11:17.040024   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:11:17.054681   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36539

	I0930 11:11:17.055106   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:11:17.055654   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:11:17.055673   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:11:17.056010   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:11:17.056264   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:17.056403   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:17.056571   26946 start.go:159] libmachine.API.Create for "ha-033260" (driver="kvm2")

	I0930 11:11:17.056596   26946 client.go:168] LocalClient.Create starting

	I0930 11:11:17.056623   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 11:11:17.056664   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:11:17.056676   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:11:17.056725   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 11:11:17.056743   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:11:17.056752   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:11:17.056765   26946 main.go:141] libmachine: Running pre-create checks...

	I0930 11:11:17.056773   26946 main.go:141] libmachine: (ha-033260) Calling .PreCreateCheck

	I0930 11:11:17.057093   26946 main.go:141] libmachine: (ha-033260) Calling .GetConfigRaw

	I0930 11:11:17.057527   26946 main.go:141] libmachine: Creating machine...

	I0930 11:11:17.057540   26946 main.go:141] libmachine: (ha-033260) Calling .Create

	I0930 11:11:17.057672   26946 main.go:141] libmachine: (ha-033260) Creating KVM machine...

	I0930 11:11:17.058923   26946 main.go:141] libmachine: (ha-033260) DBG | found existing default KVM network

	I0930 11:11:17.059559   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.059428   26970 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015b90}

	I0930 11:11:17.059596   26946 main.go:141] libmachine: (ha-033260) DBG | created network xml: 

	I0930 11:11:17.059615   26946 main.go:141] libmachine: (ha-033260) DBG | <network>

	I0930 11:11:17.059621   26946 main.go:141] libmachine: (ha-033260) DBG |   <name>mk-ha-033260</name>

	I0930 11:11:17.059629   26946 main.go:141] libmachine: (ha-033260) DBG |   <dns enable='no'/>

	I0930 11:11:17.059635   26946 main.go:141] libmachine: (ha-033260) DBG |   

	I0930 11:11:17.059640   26946 main.go:141] libmachine: (ha-033260) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0930 11:11:17.059646   26946 main.go:141] libmachine: (ha-033260) DBG |     <dhcp>

	I0930 11:11:17.059651   26946 main.go:141] libmachine: (ha-033260) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0930 11:11:17.059658   26946 main.go:141] libmachine: (ha-033260) DBG |     </dhcp>

	I0930 11:11:17.059663   26946 main.go:141] libmachine: (ha-033260) DBG |   </ip>

	I0930 11:11:17.059667   26946 main.go:141] libmachine: (ha-033260) DBG |   

	I0930 11:11:17.059673   26946 main.go:141] libmachine: (ha-033260) DBG | </network>

	I0930 11:11:17.059679   26946 main.go:141] libmachine: (ha-033260) DBG | 

	I0930 11:11:17.064624   26946 main.go:141] libmachine: (ha-033260) DBG | trying to create private KVM network mk-ha-033260 192.168.39.0/24...

	I0930 11:11:17.128145   26946 main.go:141] libmachine: (ha-033260) DBG | private KVM network mk-ha-033260 192.168.39.0/24 created

	I0930 11:11:17.128172   26946 main.go:141] libmachine: (ha-033260) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260 ...

	I0930 11:11:17.128183   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.128100   26970 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:11:17.128201   26946 main.go:141] libmachine: (ha-033260) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 11:11:17.128218   26946 main.go:141] libmachine: (ha-033260) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 11:11:17.365994   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.365804   26970 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa...

	I0930 11:11:17.493008   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.492862   26970 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/ha-033260.rawdisk...

	I0930 11:11:17.493034   26946 main.go:141] libmachine: (ha-033260) DBG | Writing magic tar header

	I0930 11:11:17.493046   26946 main.go:141] libmachine: (ha-033260) DBG | Writing SSH key tar header

	I0930 11:11:17.493053   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:17.492975   26970 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260 ...

	I0930 11:11:17.493066   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260

	I0930 11:11:17.493124   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260 (perms=drwx------)

	I0930 11:11:17.493158   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 11:11:17.493173   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 11:11:17.493181   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 11:11:17.493193   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 11:11:17.493202   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 11:11:17.493226   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:11:17.493246   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 11:11:17.493258   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 11:11:17.493264   26946 main.go:141] libmachine: (ha-033260) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 11:11:17.493275   26946 main.go:141] libmachine: (ha-033260) Creating domain...

	I0930 11:11:17.493280   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home/jenkins

	I0930 11:11:17.493286   26946 main.go:141] libmachine: (ha-033260) DBG | Checking permissions on dir: /home

	I0930 11:11:17.493291   26946 main.go:141] libmachine: (ha-033260) DBG | Skipping /home - not owner

	I0930 11:11:17.494319   26946 main.go:141] libmachine: (ha-033260) define libvirt domain using xml: 

	I0930 11:11:17.494340   26946 main.go:141] libmachine: (ha-033260) <domain type='kvm'>

	I0930 11:11:17.494347   26946 main.go:141] libmachine: (ha-033260)   <name>ha-033260</name>

	I0930 11:11:17.494351   26946 main.go:141] libmachine: (ha-033260)   <memory unit='MiB'>2200</memory>

	I0930 11:11:17.494356   26946 main.go:141] libmachine: (ha-033260)   <vcpu>2</vcpu>

	I0930 11:11:17.494359   26946 main.go:141] libmachine: (ha-033260)   <features>

	I0930 11:11:17.494365   26946 main.go:141] libmachine: (ha-033260)     <acpi/>

	I0930 11:11:17.494370   26946 main.go:141] libmachine: (ha-033260)     <apic/>

	I0930 11:11:17.494377   26946 main.go:141] libmachine: (ha-033260)     <pae/>

	I0930 11:11:17.494399   26946 main.go:141] libmachine: (ha-033260)     

	I0930 11:11:17.494410   26946 main.go:141] libmachine: (ha-033260)   </features>

	I0930 11:11:17.494415   26946 main.go:141] libmachine: (ha-033260)   <cpu mode='host-passthrough'>

	I0930 11:11:17.494422   26946 main.go:141] libmachine: (ha-033260)   

	I0930 11:11:17.494425   26946 main.go:141] libmachine: (ha-033260)   </cpu>

	I0930 11:11:17.494429   26946 main.go:141] libmachine: (ha-033260)   <os>

	I0930 11:11:17.494433   26946 main.go:141] libmachine: (ha-033260)     <type>hvm</type>

	I0930 11:11:17.494461   26946 main.go:141] libmachine: (ha-033260)     <boot dev='cdrom'/>

	I0930 11:11:17.494487   26946 main.go:141] libmachine: (ha-033260)     <boot dev='hd'/>

	I0930 11:11:17.494498   26946 main.go:141] libmachine: (ha-033260)     <bootmenu enable='no'/>

	I0930 11:11:17.494504   26946 main.go:141] libmachine: (ha-033260)   </os>

	I0930 11:11:17.494511   26946 main.go:141] libmachine: (ha-033260)   <devices>

	I0930 11:11:17.494518   26946 main.go:141] libmachine: (ha-033260)     <disk type='file' device='cdrom'>

	I0930 11:11:17.494529   26946 main.go:141] libmachine: (ha-033260)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/boot2docker.iso'/>

	I0930 11:11:17.494540   26946 main.go:141] libmachine: (ha-033260)       <target dev='hdc' bus='scsi'/>

	I0930 11:11:17.494547   26946 main.go:141] libmachine: (ha-033260)       <readonly/>

	I0930 11:11:17.494558   26946 main.go:141] libmachine: (ha-033260)     </disk>

	I0930 11:11:17.494568   26946 main.go:141] libmachine: (ha-033260)     <disk type='file' device='disk'>

	I0930 11:11:17.494579   26946 main.go:141] libmachine: (ha-033260)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 11:11:17.494592   26946 main.go:141] libmachine: (ha-033260)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/ha-033260.rawdisk'/>

	I0930 11:11:17.494603   26946 main.go:141] libmachine: (ha-033260)       <target dev='hda' bus='virtio'/>

	I0930 11:11:17.494611   26946 main.go:141] libmachine: (ha-033260)     </disk>

	I0930 11:11:17.494625   26946 main.go:141] libmachine: (ha-033260)     <interface type='network'>

	I0930 11:11:17.494636   26946 main.go:141] libmachine: (ha-033260)       <source network='mk-ha-033260'/>

	I0930 11:11:17.494646   26946 main.go:141] libmachine: (ha-033260)       <model type='virtio'/>

	I0930 11:11:17.494655   26946 main.go:141] libmachine: (ha-033260)     </interface>

	I0930 11:11:17.494664   26946 main.go:141] libmachine: (ha-033260)     <interface type='network'>

	I0930 11:11:17.494672   26946 main.go:141] libmachine: (ha-033260)       <source network='default'/>

	I0930 11:11:17.494682   26946 main.go:141] libmachine: (ha-033260)       <model type='virtio'/>

	I0930 11:11:17.494731   26946 main.go:141] libmachine: (ha-033260)     </interface>

	I0930 11:11:17.494748   26946 main.go:141] libmachine: (ha-033260)     <serial type='pty'>

	I0930 11:11:17.494754   26946 main.go:141] libmachine: (ha-033260)       <target port='0'/>

	I0930 11:11:17.494763   26946 main.go:141] libmachine: (ha-033260)     </serial>

	I0930 11:11:17.494791   26946 main.go:141] libmachine: (ha-033260)     <console type='pty'>

	I0930 11:11:17.494813   26946 main.go:141] libmachine: (ha-033260)       <target type='serial' port='0'/>

	I0930 11:11:17.494833   26946 main.go:141] libmachine: (ha-033260)     </console>

	I0930 11:11:17.494851   26946 main.go:141] libmachine: (ha-033260)     <rng model='virtio'>

	I0930 11:11:17.494868   26946 main.go:141] libmachine: (ha-033260)       <backend model='random'>/dev/random</backend>

	I0930 11:11:17.494879   26946 main.go:141] libmachine: (ha-033260)     </rng>

	I0930 11:11:17.494884   26946 main.go:141] libmachine: (ha-033260)     

	I0930 11:11:17.494894   26946 main.go:141] libmachine: (ha-033260)     

	I0930 11:11:17.494900   26946 main.go:141] libmachine: (ha-033260)   </devices>

	I0930 11:11:17.494910   26946 main.go:141] libmachine: (ha-033260) </domain>

	I0930 11:11:17.494919   26946 main.go:141] libmachine: (ha-033260) 

	I0930 11:11:17.499284   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:1e:fd:d9 in network default

	I0930 11:11:17.499904   26946 main.go:141] libmachine: (ha-033260) Ensuring networks are active...

	I0930 11:11:17.499920   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:17.500618   26946 main.go:141] libmachine: (ha-033260) Ensuring network default is active

	I0930 11:11:17.501042   26946 main.go:141] libmachine: (ha-033260) Ensuring network mk-ha-033260 is active

	I0930 11:11:17.501643   26946 main.go:141] libmachine: (ha-033260) Getting domain xml...

	I0930 11:11:17.502369   26946 main.go:141] libmachine: (ha-033260) Creating domain...

	I0930 11:11:18.692089   26946 main.go:141] libmachine: (ha-033260) Waiting to get IP...

	I0930 11:11:18.692860   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:18.693297   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:18.693313   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:18.693260   26970 retry.go:31] will retry after 231.51107ms: waiting for machine to come up

	I0930 11:11:18.926878   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:18.927339   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:18.927367   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:18.927281   26970 retry.go:31] will retry after 238.29389ms: waiting for machine to come up

	I0930 11:11:19.167097   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:19.167813   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:19.167841   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:19.167759   26970 retry.go:31] will retry after 304.46036ms: waiting for machine to come up

	I0930 11:11:19.474179   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:19.474648   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:19.474678   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:19.474604   26970 retry.go:31] will retry after 472.499674ms: waiting for machine to come up

	I0930 11:11:19.948108   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:19.948622   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:19.948649   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:19.948597   26970 retry.go:31] will retry after 645.07677ms: waiting for machine to come up

	I0930 11:11:20.595504   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:20.595963   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:20.595984   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:20.595941   26970 retry.go:31] will retry after 894.966176ms: waiting for machine to come up

	I0930 11:11:21.492428   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:21.492831   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:21.492882   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:21.492814   26970 retry.go:31] will retry after 848.859093ms: waiting for machine to come up

	I0930 11:11:22.343403   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:22.343835   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:22.343861   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:22.343753   26970 retry.go:31] will retry after 1.05973931s: waiting for machine to come up

	I0930 11:11:23.404961   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:23.405359   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:23.405385   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:23.405316   26970 retry.go:31] will retry after 1.638432323s: waiting for machine to come up

	I0930 11:11:25.046055   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:25.046452   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:25.046477   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:25.046405   26970 retry.go:31] will retry after 2.080958051s: waiting for machine to come up

	I0930 11:11:27.128708   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:27.129133   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:27.129156   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:27.129053   26970 retry.go:31] will retry after 2.256414995s: waiting for machine to come up

	I0930 11:11:29.387356   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:29.387768   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:29.387788   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:29.387745   26970 retry.go:31] will retry after 3.372456281s: waiting for machine to come up

	I0930 11:11:32.761875   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:32.762235   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:32.762254   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:32.762202   26970 retry.go:31] will retry after 3.757571385s: waiting for machine to come up

	I0930 11:11:36.524130   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:36.524597   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find current IP address of domain ha-033260 in network mk-ha-033260

	I0930 11:11:36.524613   26946 main.go:141] libmachine: (ha-033260) DBG | I0930 11:11:36.524548   26970 retry.go:31] will retry after 4.081097536s: waiting for machine to come up

	I0930 11:11:40.609929   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.610386   26946 main.go:141] libmachine: (ha-033260) Found IP for machine: 192.168.39.249

	I0930 11:11:40.610415   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has current primary IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.610423   26946 main.go:141] libmachine: (ha-033260) Reserving static IP address...

	I0930 11:11:40.610796   26946 main.go:141] libmachine: (ha-033260) DBG | unable to find host DHCP lease matching {name: "ha-033260", mac: "52:54:00:b0:2e:07", ip: "192.168.39.249"} in network mk-ha-033260

	I0930 11:11:40.682058   26946 main.go:141] libmachine: (ha-033260) DBG | Getting to WaitForSSH function...

	I0930 11:11:40.682112   26946 main.go:141] libmachine: (ha-033260) Reserved static IP address: 192.168.39.249

	I0930 11:11:40.682151   26946 main.go:141] libmachine: (ha-033260) Waiting for SSH to be available...

	I0930 11:11:40.684625   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.684964   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:minikube Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:40.684990   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.685088   26946 main.go:141] libmachine: (ha-033260) DBG | Using SSH client type: external

	I0930 11:11:40.685108   26946 main.go:141] libmachine: (ha-033260) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa (-rw-------)

	I0930 11:11:40.685155   26946 main.go:141] libmachine: (ha-033260) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.249 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:11:40.685168   26946 main.go:141] libmachine: (ha-033260) DBG | About to run SSH command:

	I0930 11:11:40.685196   26946 main.go:141] libmachine: (ha-033260) DBG | exit 0

	I0930 11:11:40.813832   26946 main.go:141] libmachine: (ha-033260) DBG | SSH cmd err, output: <nil>: 

	I0930 11:11:40.814089   26946 main.go:141] libmachine: (ha-033260) KVM machine creation complete!

	I0930 11:11:40.814483   26946 main.go:141] libmachine: (ha-033260) Calling .GetConfigRaw

	I0930 11:11:40.815001   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:40.815218   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:40.815362   26946 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 11:11:40.815373   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:11:40.816691   26946 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 11:11:40.816703   26946 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 11:11:40.816707   26946 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 11:11:40.816712   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:40.818838   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.819210   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:40.819240   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.819306   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:40.819465   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.819601   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.819739   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:40.819883   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:40.820061   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:40.820071   26946 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 11:11:40.929008   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:11:40.929033   26946 main.go:141] libmachine: Detecting the provisioner...

	I0930 11:11:40.929040   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:40.931913   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.932264   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:40.932308   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:40.932448   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:40.932679   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.932816   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:40.932931   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:40.933122   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:40.933283   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:40.933295   26946 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 11:11:41.042597   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 11:11:41.042675   26946 main.go:141] libmachine: found compatible host: buildroot

	I0930 11:11:41.042682   26946 main.go:141] libmachine: Provisioning with buildroot...

	I0930 11:11:41.042689   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:41.042906   26946 buildroot.go:166] provisioning hostname "ha-033260"

	I0930 11:11:41.042918   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:41.043088   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.045281   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.045591   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.045634   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.045749   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.045916   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.046048   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.046166   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.046324   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:41.046537   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:41.046554   26946 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-033260 && echo "ha-033260" | sudo tee /etc/hostname

	I0930 11:11:41.173460   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-033260

	I0930 11:11:41.173489   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.176142   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.176483   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.176513   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.176659   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.176845   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.176984   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.177110   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.177285   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:41.177443   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:41.177458   26946 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-033260' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-033260/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-033260' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 11:11:41.295471   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:11:41.295501   26946 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 11:11:41.295523   26946 buildroot.go:174] setting up certificates

	I0930 11:11:41.295535   26946 provision.go:84] configureAuth start

	I0930 11:11:41.295560   26946 main.go:141] libmachine: (ha-033260) Calling .GetMachineName

	I0930 11:11:41.295824   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:41.298508   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.298844   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.298871   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.299011   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.301187   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.301504   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.301529   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.301674   26946 provision.go:143] copyHostCerts

	I0930 11:11:41.301701   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:11:41.301735   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem, removing ...

	I0930 11:11:41.301744   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:11:41.301807   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 11:11:41.301895   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:11:41.301913   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem, removing ...

	I0930 11:11:41.301919   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:11:41.301944   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 11:11:41.301997   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:11:41.302013   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem, removing ...

	I0930 11:11:41.302019   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:11:41.302039   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 11:11:41.302094   26946 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.ha-033260 san=[127.0.0.1 192.168.39.249 ha-033260 localhost minikube]

	I0930 11:11:41.595618   26946 provision.go:177] copyRemoteCerts

	I0930 11:11:41.595675   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 11:11:41.595700   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.598644   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.599092   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.599122   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.599308   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.599628   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.599809   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.599990   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:41.686253   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0930 11:11:41.686348   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 11:11:41.716396   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0930 11:11:41.716470   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0930 11:11:41.741350   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0930 11:11:41.741426   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0930 11:11:41.765879   26946 provision.go:87] duration metric: took 470.33102ms to configureAuth

	I0930 11:11:41.765904   26946 buildroot.go:189] setting minikube options for container-runtime

	I0930 11:11:41.766073   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:11:41.766153   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:41.768846   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.769139   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:41.769163   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:41.769350   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:41.769573   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.769751   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:41.769867   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:41.770004   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:41.770154   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:41.770171   26946 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 11:11:41.997580   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 11:11:41.997603   26946 main.go:141] libmachine: Checking connection to Docker...

	I0930 11:11:41.997612   26946 main.go:141] libmachine: (ha-033260) Calling .GetURL

	I0930 11:11:41.998809   26946 main.go:141] libmachine: (ha-033260) DBG | Using libvirt version 6000000

	I0930 11:11:42.000992   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.001367   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.001403   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.001552   26946 main.go:141] libmachine: Docker is up and running!

	I0930 11:11:42.001574   26946 main.go:141] libmachine: Reticulating splines...

	I0930 11:11:42.001580   26946 client.go:171] duration metric: took 24.944976164s to LocalClient.Create

	I0930 11:11:42.001599   26946 start.go:167] duration metric: took 24.945029476s to libmachine.API.Create "ha-033260"

	I0930 11:11:42.001605   26946 start.go:293] postStartSetup for "ha-033260" (driver="kvm2")

	I0930 11:11:42.001634   26946 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 11:11:42.001658   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.001903   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 11:11:42.001928   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.004137   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.004477   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.004506   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.004626   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.004785   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.004929   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.005073   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:42.088764   26946 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 11:11:42.093605   26946 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 11:11:42.093649   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 11:11:42.093718   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 11:11:42.093798   26946 filesync.go:149] local asset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> 110092.pem in /etc/ssl/certs

	I0930 11:11:42.093808   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /etc/ssl/certs/110092.pem

	I0930 11:11:42.093909   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0930 11:11:42.104383   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:11:42.133090   26946 start.go:296] duration metric: took 131.471881ms for postStartSetup

	I0930 11:11:42.133135   26946 main.go:141] libmachine: (ha-033260) Calling .GetConfigRaw

	I0930 11:11:42.133732   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:42.136141   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.136473   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.136492   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.136788   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:11:42.136956   26946 start.go:128] duration metric: took 25.09848122s to createHost

	I0930 11:11:42.136975   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.139440   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.139825   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.139853   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.139989   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.140175   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.140334   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.140446   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.140582   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:11:42.140793   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.249 22 <nil> <nil>}

	I0930 11:11:42.140810   26946 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 11:11:42.250567   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727694702.228135172

	I0930 11:11:42.250590   26946 fix.go:216] guest clock: 1727694702.228135172

	I0930 11:11:42.250600   26946 fix.go:229] Guest: 2024-09-30 11:11:42.228135172 +0000 UTC Remote: 2024-09-30 11:11:42.136966335 +0000 UTC m=+25.202018114 (delta=91.168837ms)

	I0930 11:11:42.250654   26946 fix.go:200] guest clock delta is within tolerance: 91.168837ms

	I0930 11:11:42.250662   26946 start.go:83] releasing machines lock for "ha-033260", held for 25.21225918s

	I0930 11:11:42.250689   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.250959   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:42.253937   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.254263   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.254291   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.254395   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.254873   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.255071   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:11:42.255171   26946 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 11:11:42.255230   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.255277   26946 ssh_runner.go:195] Run: cat /version.json

	I0930 11:11:42.255305   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:11:42.257775   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258072   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258098   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.258117   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258247   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.258399   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.258499   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:42.258530   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:42.258550   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.258636   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:11:42.258725   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:42.258782   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:11:42.258905   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:11:42.259023   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:11:42.338949   26946 ssh_runner.go:195] Run: systemctl --version

	I0930 11:11:42.367977   26946 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 11:11:42.529658   26946 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 11:11:42.535739   26946 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 11:11:42.535805   26946 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 11:11:42.553004   26946 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 11:11:42.553029   26946 start.go:495] detecting cgroup driver to use...

	I0930 11:11:42.553101   26946 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 11:11:42.571333   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 11:11:42.586474   26946 docker.go:217] disabling cri-docker service (if available) ...

	I0930 11:11:42.586529   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 11:11:42.600562   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 11:11:42.614592   26946 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 11:11:42.724714   26946 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 11:11:42.863957   26946 docker.go:233] disabling docker service ...

	I0930 11:11:42.864016   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 11:11:42.878829   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 11:11:42.892519   26946 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 11:11:43.031759   26946 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 11:11:43.156228   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 11:11:43.171439   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 11:11:43.190694   26946 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 11:11:43.190806   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.201572   26946 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 11:11:43.201660   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.212771   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.224198   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.235643   26946 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 11:11:43.247521   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.258652   26946 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.276825   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:11:43.288336   26946 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 11:11:43.299367   26946 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 11:11:43.299422   26946 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 11:11:43.314057   26946 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 11:11:43.324403   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:11:43.446606   26946 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 11:11:43.543986   26946 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 11:11:43.544064   26946 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 11:11:43.548794   26946 start.go:563] Will wait 60s for crictl version

	I0930 11:11:43.548857   26946 ssh_runner.go:195] Run: which crictl

	I0930 11:11:43.552827   26946 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 11:11:43.593000   26946 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 11:11:43.593096   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:11:43.624593   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:11:43.654845   26946 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 11:11:43.656217   26946 main.go:141] libmachine: (ha-033260) Calling .GetIP

	I0930 11:11:43.658636   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:43.658956   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:11:43.658982   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:11:43.659236   26946 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 11:11:43.663528   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:11:43.677810   26946 kubeadm.go:883] updating cluster {Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Cl

usterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0930 11:11:43.677905   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:11:43.677950   26946 ssh_runner.go:195] Run: sudo crictl images --output json

	I0930 11:11:43.712140   26946 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.31.1". assuming images are not preloaded.

	I0930 11:11:43.712231   26946 ssh_runner.go:195] Run: which lz4

	I0930 11:11:43.716210   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0930 11:11:43.716286   26946 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0930 11:11:43.720372   26946 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0930 11:11:43.720397   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (388599353 bytes)

	I0930 11:11:45.117936   26946 crio.go:462] duration metric: took 1.401668541s to copy over tarball

	I0930 11:11:45.118009   26946 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0930 11:11:47.123971   26946 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.00593624s)

	I0930 11:11:47.124002   26946 crio.go:469] duration metric: took 2.006037646s to extract the tarball

	I0930 11:11:47.124011   26946 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0930 11:11:47.161484   26946 ssh_runner.go:195] Run: sudo crictl images --output json

	I0930 11:11:47.208444   26946 crio.go:514] all images are preloaded for cri-o runtime.

	I0930 11:11:47.208468   26946 cache_images.go:84] Images are preloaded, skipping loading

	I0930 11:11:47.208475   26946 kubeadm.go:934] updating node { 192.168.39.249 8443 v1.31.1 crio true true} ...

	I0930 11:11:47.208561   26946 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-033260 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.249

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 11:11:47.208632   26946 ssh_runner.go:195] Run: crio config

	I0930 11:11:47.256652   26946 cni.go:84] Creating CNI manager for ""

	I0930 11:11:47.256671   26946 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0930 11:11:47.256679   26946 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0930 11:11:47.256700   26946 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.249 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-033260 NodeName:ha-033260 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.249"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.249 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0930 11:11:47.256808   26946 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.249

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-033260"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.249

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.249"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0930 11:11:47.256829   26946 kube-vip.go:115] generating kube-vip config ...

	I0930 11:11:47.256866   26946 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0930 11:11:47.273274   26946 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0930 11:11:47.273411   26946 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0930 11:11:47.273489   26946 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 11:11:47.284468   26946 binaries.go:44] Found k8s binaries, skipping transfer

	I0930 11:11:47.284546   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0930 11:11:47.295086   26946 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0930 11:11:47.313062   26946 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 11:11:47.330490   26946 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0930 11:11:47.348148   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0930 11:11:47.364645   26946 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0930 11:11:47.368788   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:11:47.381517   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:11:47.516902   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:11:47.535500   26946 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260 for IP: 192.168.39.249

	I0930 11:11:47.535531   26946 certs.go:194] generating shared ca certs ...

	I0930 11:11:47.535554   26946 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.535745   26946 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 11:11:47.535819   26946 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 11:11:47.535836   26946 certs.go:256] generating profile certs ...

	I0930 11:11:47.535916   26946 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key

	I0930 11:11:47.535947   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt with IP's: []

	I0930 11:11:47.718587   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt ...

	I0930 11:11:47.718617   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt: {Name:mkef0c2b538ff6ec90e4096f6b30d2cc62a0498b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.718785   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key ...

	I0930 11:11:47.718795   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key: {Name:mk0bf4d552829907727733b9f23a1e78046426c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.718864   26946 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf

	I0930 11:11:47.718878   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.249 192.168.39.254]

	I0930 11:11:47.993565   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf ...

	I0930 11:11:47.993602   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf: {Name:mk8d827ffc338aba548bc3df464e9e04ae838b07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.993789   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf ...

	I0930 11:11:47.993807   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf: {Name:mka275015927a8ca9f533558d637ec2560f5b41f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:47.993887   26946 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.c00eb5cf -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt

	I0930 11:11:47.993965   26946 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.c00eb5cf -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key

	I0930 11:11:47.994041   26946 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key

	I0930 11:11:47.994059   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt with IP's: []

	I0930 11:11:48.098988   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt ...

	I0930 11:11:48.099020   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt: {Name:mk7106fd4af523e8a328dae6580fd1ecc34c18b9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:48.099178   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key ...

	I0930 11:11:48.099189   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key: {Name:mka3dbe7128ec5d469ec7906155af8e6e7cc2725 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:11:48.099265   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0930 11:11:48.099283   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0930 11:11:48.099294   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0930 11:11:48.099304   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0930 11:11:48.099314   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0930 11:11:48.099324   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0930 11:11:48.099333   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0930 11:11:48.099342   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0930 11:11:48.099385   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem (1338 bytes)

	W0930 11:11:48.099425   26946 certs.go:480] ignoring /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009_empty.pem, impossibly tiny 0 bytes

	I0930 11:11:48.099434   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 11:11:48.099457   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 11:11:48.099481   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 11:11:48.099502   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 11:11:48.099537   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:11:48.099561   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.099574   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.099592   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem -> /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.100091   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 11:11:48.126879   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 11:11:48.153722   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 11:11:48.179797   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 11:11:48.205074   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0930 11:11:48.230272   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0930 11:11:48.255030   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 11:11:48.279850   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 11:11:48.306723   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /usr/share/ca-certificates/110092.pem (1708 bytes)

	I0930 11:11:48.332995   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 11:11:48.363646   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem --> /usr/share/ca-certificates/11009.pem (1338 bytes)

	I0930 11:11:48.392223   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0930 11:11:48.410336   26946 ssh_runner.go:195] Run: openssl version

	I0930 11:11:48.416506   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110092.pem && ln -fs /usr/share/ca-certificates/110092.pem /etc/ssl/certs/110092.pem"

	I0930 11:11:48.428642   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.433601   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 30 11:01 /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.433673   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110092.pem

	I0930 11:11:48.439817   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110092.pem /etc/ssl/certs/3ec20f2e.0"

	I0930 11:11:48.451918   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 11:11:48.464282   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.469211   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.469276   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:11:48.475319   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 11:11:48.487558   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009.pem && ln -fs /usr/share/ca-certificates/11009.pem /etc/ssl/certs/11009.pem"

	I0930 11:11:48.500151   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.505278   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 30 11:01 /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.505355   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009.pem

	I0930 11:11:48.511924   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11009.pem /etc/ssl/certs/51391683.0"

	I0930 11:11:48.525201   26946 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 11:11:48.529960   26946 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 11:11:48.530014   26946 kubeadm.go:392] StartCluster: {Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Clust

erName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 11:11:48.530081   26946 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0930 11:11:48.530129   26946 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0930 11:11:48.568913   26946 cri.go:89] found id: ""

	I0930 11:11:48.568975   26946 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0930 11:11:48.580292   26946 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0930 11:11:48.593494   26946 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0930 11:11:48.606006   26946 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0930 11:11:48.606037   26946 kubeadm.go:157] found existing configuration files:

	I0930 11:11:48.606079   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0930 11:11:48.615784   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0930 11:11:48.615855   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0930 11:11:48.626018   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0930 11:11:48.635953   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0930 11:11:48.636032   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0930 11:11:48.646292   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0930 11:11:48.657605   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0930 11:11:48.657679   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0930 11:11:48.669154   26946 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0930 11:11:48.680279   26946 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0930 11:11:48.680348   26946 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0930 11:11:48.691798   26946 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0930 11:11:48.797903   26946 kubeadm.go:310] W0930 11:11:48.782166     830 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0930 11:11:48.798931   26946 kubeadm.go:310] W0930 11:11:48.783291     830 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0930 11:11:48.907657   26946 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0930 11:12:00.116285   26946 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1

	I0930 11:12:00.116363   26946 kubeadm.go:310] [preflight] Running pre-flight checks

	I0930 11:12:00.116459   26946 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0930 11:12:00.116597   26946 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0930 11:12:00.116728   26946 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0930 11:12:00.116817   26946 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0930 11:12:00.118253   26946 out.go:235]   - Generating certificates and keys ...

	I0930 11:12:00.118344   26946 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0930 11:12:00.118441   26946 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0930 11:12:00.118536   26946 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0930 11:12:00.118621   26946 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0930 11:12:00.118710   26946 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0930 11:12:00.118780   26946 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0930 11:12:00.118849   26946 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0930 11:12:00.118971   26946 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-033260 localhost] and IPs [192.168.39.249 127.0.0.1 ::1]

	I0930 11:12:00.119022   26946 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0930 11:12:00.119113   26946 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-033260 localhost] and IPs [192.168.39.249 127.0.0.1 ::1]

	I0930 11:12:00.119209   26946 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0930 11:12:00.119261   26946 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0930 11:12:00.119300   26946 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0930 11:12:00.119361   26946 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0930 11:12:00.119418   26946 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0930 11:12:00.119463   26946 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0930 11:12:00.119517   26946 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0930 11:12:00.119604   26946 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0930 11:12:00.119657   26946 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0930 11:12:00.119721   26946 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0930 11:12:00.119813   26946 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0930 11:12:00.121972   26946 out.go:235]   - Booting up control plane ...

	I0930 11:12:00.122077   26946 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0930 11:12:00.122168   26946 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0930 11:12:00.122257   26946 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0930 11:12:00.122354   26946 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0930 11:12:00.122445   26946 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0930 11:12:00.122493   26946 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0930 11:12:00.122632   26946 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0930 11:12:00.122746   26946 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0930 11:12:00.122807   26946 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.002277963s

	I0930 11:12:00.122866   26946 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0930 11:12:00.122914   26946 kubeadm.go:310] [api-check] The API server is healthy after 5.817139259s

	I0930 11:12:00.123017   26946 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0930 11:12:00.123126   26946 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0930 11:12:00.123189   26946 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0930 11:12:00.123373   26946 kubeadm.go:310] [mark-control-plane] Marking the node ha-033260 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0930 11:12:00.123455   26946 kubeadm.go:310] [bootstrap-token] Using token: mglnbr.4ysxjyfx6ulvufry

	I0930 11:12:00.124695   26946 out.go:235]   - Configuring RBAC rules ...

	I0930 11:12:00.124816   26946 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0930 11:12:00.124888   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0930 11:12:00.125008   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0930 11:12:00.125123   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0930 11:12:00.125226   26946 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0930 11:12:00.125300   26946 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0930 11:12:00.125399   26946 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0930 11:12:00.125438   26946 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0930 11:12:00.125482   26946 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0930 11:12:00.125488   26946 kubeadm.go:310] 

	I0930 11:12:00.125543   26946 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0930 11:12:00.125548   26946 kubeadm.go:310] 

	I0930 11:12:00.125627   26946 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0930 11:12:00.125640   26946 kubeadm.go:310] 

	I0930 11:12:00.125667   26946 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0930 11:12:00.125722   26946 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0930 11:12:00.125765   26946 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0930 11:12:00.125771   26946 kubeadm.go:310] 

	I0930 11:12:00.125822   26946 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0930 11:12:00.125832   26946 kubeadm.go:310] 

	I0930 11:12:00.125875   26946 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0930 11:12:00.125882   26946 kubeadm.go:310] 

	I0930 11:12:00.125945   26946 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0930 11:12:00.126010   26946 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0930 11:12:00.126068   26946 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0930 11:12:00.126073   26946 kubeadm.go:310] 

	I0930 11:12:00.126141   26946 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0930 11:12:00.126212   26946 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0930 11:12:00.126219   26946 kubeadm.go:310] 

	I0930 11:12:00.126299   26946 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token mglnbr.4ysxjyfx6ulvufry \

	I0930 11:12:00.126384   26946 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 \

	I0930 11:12:00.126404   26946 kubeadm.go:310] 	--control-plane 

	I0930 11:12:00.126410   26946 kubeadm.go:310] 

	I0930 11:12:00.126493   26946 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0930 11:12:00.126501   26946 kubeadm.go:310] 

	I0930 11:12:00.126563   26946 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token mglnbr.4ysxjyfx6ulvufry \

	I0930 11:12:00.126653   26946 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 

	I0930 11:12:00.126666   26946 cni.go:84] Creating CNI manager for ""

	I0930 11:12:00.126671   26946 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0930 11:12:00.128070   26946 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0930 11:12:00.129234   26946 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0930 11:12:00.134944   26946 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...

	I0930 11:12:00.134960   26946 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)

	I0930 11:12:00.155333   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0930 11:12:00.530346   26946 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0930 11:12:00.530478   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-033260 minikube.k8s.io/updated_at=2024_09_30T11_12_00_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=ha-033260 minikube.k8s.io/primary=true

	I0930 11:12:00.530486   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:00.762071   26946 ops.go:34] apiserver oom_adj: -16

	I0930 11:12:00.762161   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:01.262836   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:01.762341   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:02.262939   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:02.762594   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:03.263292   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:03.762877   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0930 11:12:03.861166   26946 kubeadm.go:1113] duration metric: took 3.330735229s to wait for elevateKubeSystemPrivileges

	I0930 11:12:03.861207   26946 kubeadm.go:394] duration metric: took 15.331194175s to StartCluster

	I0930 11:12:03.861229   26946 settings.go:142] acquiring lock: {Name:mkdbb7ee3f4e112a79c58917f833dfd72cc7c3b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:03.861306   26946 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:12:03.861899   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/kubeconfig: {Name:mkbcc26962ad9a46a600e5f0a5facf24bf9d408d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:03.862096   26946 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:03.862109   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0930 11:12:03.862128   26946 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0930 11:12:03.862180   26946 addons.go:69] Setting storage-provisioner=true in profile "ha-033260"

	I0930 11:12:03.862192   26946 addons.go:234] Setting addon storage-provisioner=true in "ha-033260"

	I0930 11:12:03.862117   26946 start.go:241] waiting for startup goroutines ...

	I0930 11:12:03.862217   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:03.862220   26946 addons.go:69] Setting default-storageclass=true in profile "ha-033260"

	I0930 11:12:03.862242   26946 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-033260"

	I0930 11:12:03.862318   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:03.862546   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.862579   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.862640   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.862674   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.878311   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44373

	I0930 11:12:03.878524   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38709

	I0930 11:12:03.878793   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.878956   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.879296   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.879311   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.879437   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.879458   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.879666   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.879878   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.880063   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:03.880274   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.880317   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.882311   26946 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:12:03.882615   26946 kapi.go:59] client config for ha-033260: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt", KeyFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key", CAFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1f685c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0930 11:12:03.883117   26946 cert_rotation.go:140] Starting client certificate rotation controller

	I0930 11:12:03.883340   26946 addons.go:234] Setting addon default-storageclass=true in "ha-033260"

	I0930 11:12:03.883377   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:03.883734   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.883774   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.895612   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39339

	I0930 11:12:03.896182   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.896686   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.896706   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.897041   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.897263   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:03.899125   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:03.899133   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42283

	I0930 11:12:03.899601   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.900021   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.900036   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.900378   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.901008   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:03.901054   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:03.901205   26946 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0930 11:12:03.902407   26946 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0930 11:12:03.902428   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0930 11:12:03.902445   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:03.905497   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.906023   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:03.906045   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.906199   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:03.906396   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:03.906554   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:03.906702   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:03.917103   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34553

	I0930 11:12:03.917557   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:03.918124   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:03.918149   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:03.918507   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:03.918675   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:03.920302   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:03.920506   26946 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0930 11:12:03.920522   26946 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0930 11:12:03.920544   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:03.923151   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.923529   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:03.923552   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:03.923700   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:03.923867   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:03.923995   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:03.924108   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:03.981471   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0930 11:12:04.090970   26946 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0930 11:12:04.120632   26946 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0930 11:12:04.535542   26946 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0930 11:12:04.535597   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.535614   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.535906   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.535923   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.535937   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.535938   26946 main.go:141] libmachine: (ha-033260) DBG | Closing plugin on server side

	I0930 11:12:04.535945   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.536174   26946 main.go:141] libmachine: (ha-033260) DBG | Closing plugin on server side

	I0930 11:12:04.536192   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.536203   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.536265   26946 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false

	I0930 11:12:04.536288   26946 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false

	I0930 11:12:04.536378   26946 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0930 11:12:04.536387   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:04.536394   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:04.536397   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:04.616635   26946 round_trippers.go:574] Response Status: 200 OK in 80 milliseconds

	I0930 11:12:04.617143   26946 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0930 11:12:04.617157   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:04.617164   26946 round_trippers.go:473]     Content-Type: application/json

	I0930 11:12:04.617168   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:04.617171   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:04.644304   26946 round_trippers.go:574] Response Status: 200 OK in 27 milliseconds

	I0930 11:12:04.644577   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.644596   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.644880   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.644899   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.839773   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.839805   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.840111   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.840131   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.840140   26946 main.go:141] libmachine: Making call to close driver server

	I0930 11:12:04.840149   26946 main.go:141] libmachine: (ha-033260) Calling .Close

	I0930 11:12:04.840370   26946 main.go:141] libmachine: Successfully made call to close driver server

	I0930 11:12:04.840384   26946 main.go:141] libmachine: Making call to close connection to plugin binary

	I0930 11:12:04.841979   26946 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0930 11:12:04.843256   26946 addons.go:510] duration metric: took 981.127437ms for enable addons: enabled=[default-storageclass storage-provisioner]

	I0930 11:12:04.843295   26946 start.go:246] waiting for cluster config update ...

	I0930 11:12:04.843309   26946 start.go:255] writing updated cluster config ...

	I0930 11:12:04.844944   26946 out.go:201] 

	I0930 11:12:04.846458   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:04.846524   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:12:04.848060   26946 out.go:177] * Starting "ha-033260-m02" control-plane node in "ha-033260" cluster

	I0930 11:12:04.849158   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:12:04.849179   26946 cache.go:56] Caching tarball of preloaded images

	I0930 11:12:04.849280   26946 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 11:12:04.849291   26946 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 11:12:04.849355   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:12:04.849507   26946 start.go:360] acquireMachinesLock for ha-033260-m02: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 11:12:04.849551   26946 start.go:364] duration metric: took 26.46µs to acquireMachinesLock for "ha-033260-m02"

	I0930 11:12:04.849567   26946 start.go:93] Provisioning new machine with config: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:04.849642   26946 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0930 11:12:04.851226   26946 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0930 11:12:04.851326   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:04.851360   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:04.866966   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34227

	I0930 11:12:04.867433   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:04.867975   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:04.867995   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:04.868336   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:04.868557   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:04.868710   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:04.868858   26946 start.go:159] libmachine.API.Create for "ha-033260" (driver="kvm2")

	I0930 11:12:04.868889   26946 client.go:168] LocalClient.Create starting

	I0930 11:12:04.868923   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 11:12:04.868957   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:12:04.868973   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:12:04.869023   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 11:12:04.869042   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:12:04.869052   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:12:04.869078   26946 main.go:141] libmachine: Running pre-create checks...

	I0930 11:12:04.869093   26946 main.go:141] libmachine: (ha-033260-m02) Calling .PreCreateCheck

	I0930 11:12:04.869253   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetConfigRaw

	I0930 11:12:04.869711   26946 main.go:141] libmachine: Creating machine...

	I0930 11:12:04.869724   26946 main.go:141] libmachine: (ha-033260-m02) Calling .Create

	I0930 11:12:04.869845   26946 main.go:141] libmachine: (ha-033260-m02) Creating KVM machine...

	I0930 11:12:04.871091   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found existing default KVM network

	I0930 11:12:04.871157   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found existing private KVM network mk-ha-033260

	I0930 11:12:04.871294   26946 main.go:141] libmachine: (ha-033260-m02) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02 ...

	I0930 11:12:04.871318   26946 main.go:141] libmachine: (ha-033260-m02) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 11:12:04.871364   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:04.871284   27323 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:12:04.871439   26946 main.go:141] libmachine: (ha-033260-m02) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 11:12:05.099309   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:05.099139   27323 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa...

	I0930 11:12:05.396113   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:05.395976   27323 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/ha-033260-m02.rawdisk...

	I0930 11:12:05.396137   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Writing magic tar header

	I0930 11:12:05.396150   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Writing SSH key tar header

	I0930 11:12:05.396161   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:05.396084   27323 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02 ...

	I0930 11:12:05.396175   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02

	I0930 11:12:05.396200   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02 (perms=drwx------)

	I0930 11:12:05.396209   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 11:12:05.396245   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 11:12:05.396258   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 11:12:05.396269   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 11:12:05.396285   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 11:12:05.396302   26946 main.go:141] libmachine: (ha-033260-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 11:12:05.396315   26946 main.go:141] libmachine: (ha-033260-m02) Creating domain...

	I0930 11:12:05.396331   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:12:05.396348   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 11:12:05.396365   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 11:12:05.396376   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home/jenkins

	I0930 11:12:05.396390   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Checking permissions on dir: /home

	I0930 11:12:05.396400   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Skipping /home - not owner

	I0930 11:12:05.397208   26946 main.go:141] libmachine: (ha-033260-m02) define libvirt domain using xml: 

	I0930 11:12:05.397237   26946 main.go:141] libmachine: (ha-033260-m02) <domain type='kvm'>

	I0930 11:12:05.397248   26946 main.go:141] libmachine: (ha-033260-m02)   <name>ha-033260-m02</name>

	I0930 11:12:05.397259   26946 main.go:141] libmachine: (ha-033260-m02)   <memory unit='MiB'>2200</memory>

	I0930 11:12:05.397267   26946 main.go:141] libmachine: (ha-033260-m02)   <vcpu>2</vcpu>

	I0930 11:12:05.397273   26946 main.go:141] libmachine: (ha-033260-m02)   <features>

	I0930 11:12:05.397282   26946 main.go:141] libmachine: (ha-033260-m02)     <acpi/>

	I0930 11:12:05.397289   26946 main.go:141] libmachine: (ha-033260-m02)     <apic/>

	I0930 11:12:05.397297   26946 main.go:141] libmachine: (ha-033260-m02)     <pae/>

	I0930 11:12:05.397306   26946 main.go:141] libmachine: (ha-033260-m02)     

	I0930 11:12:05.397314   26946 main.go:141] libmachine: (ha-033260-m02)   </features>

	I0930 11:12:05.397321   26946 main.go:141] libmachine: (ha-033260-m02)   <cpu mode='host-passthrough'>

	I0930 11:12:05.397329   26946 main.go:141] libmachine: (ha-033260-m02)   

	I0930 11:12:05.397335   26946 main.go:141] libmachine: (ha-033260-m02)   </cpu>

	I0930 11:12:05.397359   26946 main.go:141] libmachine: (ha-033260-m02)   <os>

	I0930 11:12:05.397379   26946 main.go:141] libmachine: (ha-033260-m02)     <type>hvm</type>

	I0930 11:12:05.397384   26946 main.go:141] libmachine: (ha-033260-m02)     <boot dev='cdrom'/>

	I0930 11:12:05.397391   26946 main.go:141] libmachine: (ha-033260-m02)     <boot dev='hd'/>

	I0930 11:12:05.397407   26946 main.go:141] libmachine: (ha-033260-m02)     <bootmenu enable='no'/>

	I0930 11:12:05.397419   26946 main.go:141] libmachine: (ha-033260-m02)   </os>

	I0930 11:12:05.397427   26946 main.go:141] libmachine: (ha-033260-m02)   <devices>

	I0930 11:12:05.397438   26946 main.go:141] libmachine: (ha-033260-m02)     <disk type='file' device='cdrom'>

	I0930 11:12:05.397450   26946 main.go:141] libmachine: (ha-033260-m02)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/boot2docker.iso'/>

	I0930 11:12:05.397461   26946 main.go:141] libmachine: (ha-033260-m02)       <target dev='hdc' bus='scsi'/>

	I0930 11:12:05.397468   26946 main.go:141] libmachine: (ha-033260-m02)       <readonly/>

	I0930 11:12:05.397480   26946 main.go:141] libmachine: (ha-033260-m02)     </disk>

	I0930 11:12:05.397492   26946 main.go:141] libmachine: (ha-033260-m02)     <disk type='file' device='disk'>

	I0930 11:12:05.397501   26946 main.go:141] libmachine: (ha-033260-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 11:12:05.397518   26946 main.go:141] libmachine: (ha-033260-m02)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/ha-033260-m02.rawdisk'/>

	I0930 11:12:05.397528   26946 main.go:141] libmachine: (ha-033260-m02)       <target dev='hda' bus='virtio'/>

	I0930 11:12:05.397538   26946 main.go:141] libmachine: (ha-033260-m02)     </disk>

	I0930 11:12:05.397548   26946 main.go:141] libmachine: (ha-033260-m02)     <interface type='network'>

	I0930 11:12:05.397565   26946 main.go:141] libmachine: (ha-033260-m02)       <source network='mk-ha-033260'/>

	I0930 11:12:05.397579   26946 main.go:141] libmachine: (ha-033260-m02)       <model type='virtio'/>

	I0930 11:12:05.397590   26946 main.go:141] libmachine: (ha-033260-m02)     </interface>

	I0930 11:12:05.397605   26946 main.go:141] libmachine: (ha-033260-m02)     <interface type='network'>

	I0930 11:12:05.397627   26946 main.go:141] libmachine: (ha-033260-m02)       <source network='default'/>

	I0930 11:12:05.397641   26946 main.go:141] libmachine: (ha-033260-m02)       <model type='virtio'/>

	I0930 11:12:05.397651   26946 main.go:141] libmachine: (ha-033260-m02)     </interface>

	I0930 11:12:05.397663   26946 main.go:141] libmachine: (ha-033260-m02)     <serial type='pty'>

	I0930 11:12:05.397672   26946 main.go:141] libmachine: (ha-033260-m02)       <target port='0'/>

	I0930 11:12:05.397683   26946 main.go:141] libmachine: (ha-033260-m02)     </serial>

	I0930 11:12:05.397693   26946 main.go:141] libmachine: (ha-033260-m02)     <console type='pty'>

	I0930 11:12:05.397702   26946 main.go:141] libmachine: (ha-033260-m02)       <target type='serial' port='0'/>

	I0930 11:12:05.397716   26946 main.go:141] libmachine: (ha-033260-m02)     </console>

	I0930 11:12:05.397728   26946 main.go:141] libmachine: (ha-033260-m02)     <rng model='virtio'>

	I0930 11:12:05.397739   26946 main.go:141] libmachine: (ha-033260-m02)       <backend model='random'>/dev/random</backend>

	I0930 11:12:05.397750   26946 main.go:141] libmachine: (ha-033260-m02)     </rng>

	I0930 11:12:05.397758   26946 main.go:141] libmachine: (ha-033260-m02)     

	I0930 11:12:05.397766   26946 main.go:141] libmachine: (ha-033260-m02)     

	I0930 11:12:05.397771   26946 main.go:141] libmachine: (ha-033260-m02)   </devices>

	I0930 11:12:05.397781   26946 main.go:141] libmachine: (ha-033260-m02) </domain>

	I0930 11:12:05.397794   26946 main.go:141] libmachine: (ha-033260-m02) 

	I0930 11:12:05.404924   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:91:42:82 in network default

	I0930 11:12:05.405500   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:05.405515   26946 main.go:141] libmachine: (ha-033260-m02) Ensuring networks are active...

	I0930 11:12:05.406422   26946 main.go:141] libmachine: (ha-033260-m02) Ensuring network default is active

	I0930 11:12:05.406717   26946 main.go:141] libmachine: (ha-033260-m02) Ensuring network mk-ha-033260 is active

	I0930 11:12:05.407099   26946 main.go:141] libmachine: (ha-033260-m02) Getting domain xml...

	I0930 11:12:05.407766   26946 main.go:141] libmachine: (ha-033260-m02) Creating domain...

	I0930 11:12:06.665629   26946 main.go:141] libmachine: (ha-033260-m02) Waiting to get IP...

	I0930 11:12:06.666463   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:06.666923   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:06.666983   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:06.666914   27323 retry.go:31] will retry after 236.292128ms: waiting for machine to come up

	I0930 11:12:06.904458   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:06.904973   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:06.905008   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:06.904946   27323 retry.go:31] will retry after 373.72215ms: waiting for machine to come up

	I0930 11:12:07.280653   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:07.281148   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:07.281167   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:07.281127   27323 retry.go:31] will retry after 417.615707ms: waiting for machine to come up

	I0930 11:12:07.700723   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:07.701173   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:07.701199   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:07.701130   27323 retry.go:31] will retry after 495.480397ms: waiting for machine to come up

	I0930 11:12:08.198698   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:08.199207   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:08.199236   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:08.199183   27323 retry.go:31] will retry after 541.395524ms: waiting for machine to come up

	I0930 11:12:08.742190   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:08.742786   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:08.742812   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:08.742737   27323 retry.go:31] will retry after 711.22134ms: waiting for machine to come up

	I0930 11:12:09.455685   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:09.456147   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:09.456172   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:09.456119   27323 retry.go:31] will retry after 1.042420332s: waiting for machine to come up

	I0930 11:12:10.499804   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:10.500316   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:10.500353   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:10.500299   27323 retry.go:31] will retry after 1.048379902s: waiting for machine to come up

	I0930 11:12:11.550177   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:11.550587   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:11.550616   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:11.550525   27323 retry.go:31] will retry after 1.84570983s: waiting for machine to come up

	I0930 11:12:13.397532   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:13.398027   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:13.398052   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:13.397980   27323 retry.go:31] will retry after 1.566549945s: waiting for machine to come up

	I0930 11:12:14.966467   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:14.966938   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:14.966983   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:14.966914   27323 retry.go:31] will retry after 1.814424901s: waiting for machine to come up

	I0930 11:12:16.783827   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:16.784216   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:16.784247   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:16.784177   27323 retry.go:31] will retry after 3.594354669s: waiting for machine to come up

	I0930 11:12:20.380537   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:20.380935   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:20.380960   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:20.380904   27323 retry.go:31] will retry after 3.199139157s: waiting for machine to come up

	I0930 11:12:23.582795   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:23.583206   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find current IP address of domain ha-033260-m02 in network mk-ha-033260

	I0930 11:12:23.583227   26946 main.go:141] libmachine: (ha-033260-m02) DBG | I0930 11:12:23.583181   27323 retry.go:31] will retry after 5.054668279s: waiting for machine to come up

	I0930 11:12:28.639867   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.640504   26946 main.go:141] libmachine: (ha-033260-m02) Found IP for machine: 192.168.39.3

	I0930 11:12:28.640526   26946 main.go:141] libmachine: (ha-033260-m02) Reserving static IP address...

	I0930 11:12:28.640539   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has current primary IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.641001   26946 main.go:141] libmachine: (ha-033260-m02) DBG | unable to find host DHCP lease matching {name: "ha-033260-m02", mac: "52:54:00:31:8f:e1", ip: "192.168.39.3"} in network mk-ha-033260

	I0930 11:12:28.722236   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Getting to WaitForSSH function...

	I0930 11:12:28.722267   26946 main.go:141] libmachine: (ha-033260-m02) Reserved static IP address: 192.168.39.3

	I0930 11:12:28.722280   26946 main.go:141] libmachine: (ha-033260-m02) Waiting for SSH to be available...

	I0930 11:12:28.724853   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.725241   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:minikube Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:28.725265   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.725515   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Using SSH client type: external

	I0930 11:12:28.725540   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa (-rw-------)

	I0930 11:12:28.725576   26946 main.go:141] libmachine: (ha-033260-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.3 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:12:28.725598   26946 main.go:141] libmachine: (ha-033260-m02) DBG | About to run SSH command:

	I0930 11:12:28.725610   26946 main.go:141] libmachine: (ha-033260-m02) DBG | exit 0

	I0930 11:12:28.854399   26946 main.go:141] libmachine: (ha-033260-m02) DBG | SSH cmd err, output: <nil>: 

	I0930 11:12:28.854625   26946 main.go:141] libmachine: (ha-033260-m02) KVM machine creation complete!

	I0930 11:12:28.855272   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetConfigRaw

	I0930 11:12:28.855866   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:28.856047   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:28.856170   26946 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 11:12:28.856182   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetState

	I0930 11:12:28.857578   26946 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 11:12:28.857593   26946 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 11:12:28.857600   26946 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 11:12:28.857606   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:28.859889   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.860246   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:28.860279   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.860438   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:28.860622   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.860773   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.860913   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:28.861114   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:28.861325   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:28.861337   26946 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 11:12:28.973157   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:12:28.973184   26946 main.go:141] libmachine: Detecting the provisioner...

	I0930 11:12:28.973195   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:28.976106   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.976500   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:28.976531   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:28.976798   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:28.977021   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.977185   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:28.977339   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:28.977493   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:28.977714   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:28.977727   26946 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 11:12:29.086855   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 11:12:29.086927   26946 main.go:141] libmachine: found compatible host: buildroot

	I0930 11:12:29.086937   26946 main.go:141] libmachine: Provisioning with buildroot...

	I0930 11:12:29.086951   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:29.087245   26946 buildroot.go:166] provisioning hostname "ha-033260-m02"

	I0930 11:12:29.087269   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:29.087463   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.090156   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.090525   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.090551   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.090676   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.090846   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.090986   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.091115   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.091289   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:29.091467   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:29.091479   26946 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-033260-m02 && echo "ha-033260-m02" | sudo tee /etc/hostname

	I0930 11:12:29.220174   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-033260-m02

	I0930 11:12:29.220204   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.223091   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.223537   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.223567   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.223724   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.223905   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.224048   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.224217   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.224385   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:29.224590   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:29.224614   26946 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-033260-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-033260-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-033260-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 11:12:29.343733   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:12:29.343767   26946 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 11:12:29.343787   26946 buildroot.go:174] setting up certificates

	I0930 11:12:29.343798   26946 provision.go:84] configureAuth start

	I0930 11:12:29.343811   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetMachineName

	I0930 11:12:29.344093   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:29.346631   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.346930   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.346956   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.347096   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.349248   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.349664   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.349689   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.349858   26946 provision.go:143] copyHostCerts

	I0930 11:12:29.349889   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:12:29.349936   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem, removing ...

	I0930 11:12:29.349948   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:12:29.350055   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 11:12:29.350156   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:12:29.350176   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem, removing ...

	I0930 11:12:29.350181   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:12:29.350207   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 11:12:29.350254   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:12:29.350271   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem, removing ...

	I0930 11:12:29.350277   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:12:29.350298   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 11:12:29.350347   26946 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.ha-033260-m02 san=[127.0.0.1 192.168.39.3 ha-033260-m02 localhost minikube]

	I0930 11:12:29.533329   26946 provision.go:177] copyRemoteCerts

	I0930 11:12:29.533387   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 11:12:29.533409   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.535946   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.536287   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.536327   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.536541   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.536745   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.536906   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.537054   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:29.625264   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0930 11:12:29.625353   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 11:12:29.651589   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0930 11:12:29.651644   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0930 11:12:29.677526   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0930 11:12:29.677634   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0930 11:12:29.708210   26946 provision.go:87] duration metric: took 364.395657ms to configureAuth

	I0930 11:12:29.708246   26946 buildroot.go:189] setting minikube options for container-runtime

	I0930 11:12:29.708446   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:29.708540   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.711111   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.711545   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.711578   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.711743   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.711914   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.712073   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.712191   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.712381   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:29.712587   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:29.712611   26946 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 11:12:29.956548   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 11:12:29.956576   26946 main.go:141] libmachine: Checking connection to Docker...

	I0930 11:12:29.956585   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetURL

	I0930 11:12:29.957861   26946 main.go:141] libmachine: (ha-033260-m02) DBG | Using libvirt version 6000000

	I0930 11:12:29.959943   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.960349   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.960376   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.960589   26946 main.go:141] libmachine: Docker is up and running!

	I0930 11:12:29.960605   26946 main.go:141] libmachine: Reticulating splines...

	I0930 11:12:29.960611   26946 client.go:171] duration metric: took 25.091713434s to LocalClient.Create

	I0930 11:12:29.960635   26946 start.go:167] duration metric: took 25.091779085s to libmachine.API.Create "ha-033260"

	I0930 11:12:29.960649   26946 start.go:293] postStartSetup for "ha-033260-m02" (driver="kvm2")

	I0930 11:12:29.960663   26946 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 11:12:29.960682   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:29.960894   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 11:12:29.960921   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:29.962943   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.963366   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:29.963390   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:29.963547   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:29.963747   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:29.963887   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:29.963995   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:30.049684   26946 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 11:12:30.054345   26946 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 11:12:30.054373   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 11:12:30.054430   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 11:12:30.054507   26946 filesync.go:149] local asset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> 110092.pem in /etc/ssl/certs

	I0930 11:12:30.054516   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /etc/ssl/certs/110092.pem

	I0930 11:12:30.054592   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0930 11:12:30.064685   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:12:30.090069   26946 start.go:296] duration metric: took 129.405576ms for postStartSetup

	I0930 11:12:30.090127   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetConfigRaw

	I0930 11:12:30.090769   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:30.093475   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.093805   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.093836   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.094011   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:12:30.094269   26946 start.go:128] duration metric: took 25.244614564s to createHost

	I0930 11:12:30.094293   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:30.096188   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.096490   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.096524   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.096656   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:30.096825   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.096963   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.097093   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:30.097253   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:12:30.097426   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.3 22 <nil> <nil>}

	I0930 11:12:30.097439   26946 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 11:12:30.206856   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727694750.184612585

	I0930 11:12:30.206885   26946 fix.go:216] guest clock: 1727694750.184612585

	I0930 11:12:30.206895   26946 fix.go:229] Guest: 2024-09-30 11:12:30.184612585 +0000 UTC Remote: 2024-09-30 11:12:30.094281951 +0000 UTC m=+73.159334041 (delta=90.330634ms)

	I0930 11:12:30.206915   26946 fix.go:200] guest clock delta is within tolerance: 90.330634ms

	I0930 11:12:30.206922   26946 start.go:83] releasing machines lock for "ha-033260-m02", held for 25.357361614s

	I0930 11:12:30.206944   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.207256   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:30.209590   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.209935   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.209964   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.212335   26946 out.go:177] * Found network options:

	I0930 11:12:30.213673   26946 out.go:177]   - NO_PROXY=192.168.39.249

	W0930 11:12:30.215021   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:12:30.215056   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.215673   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.215843   26946 main.go:141] libmachine: (ha-033260-m02) Calling .DriverName

	I0930 11:12:30.215938   26946 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 11:12:30.215976   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	W0930 11:12:30.215983   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:12:30.216054   26946 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 11:12:30.216075   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHHostname

	I0930 11:12:30.218771   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.218983   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.219125   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.219147   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.219360   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:30.219434   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:30.219459   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:30.219516   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.219662   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHPort

	I0930 11:12:30.219670   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:30.219831   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHKeyPath

	I0930 11:12:30.219846   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:30.219963   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetSSHUsername

	I0930 11:12:30.220088   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m02/id_rsa Username:docker}

	I0930 11:12:30.454192   26946 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 11:12:30.462288   26946 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 11:12:30.462348   26946 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 11:12:30.479853   26946 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 11:12:30.479878   26946 start.go:495] detecting cgroup driver to use...

	I0930 11:12:30.479941   26946 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 11:12:30.496617   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 11:12:30.512078   26946 docker.go:217] disabling cri-docker service (if available) ...

	I0930 11:12:30.512142   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 11:12:30.526557   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 11:12:30.541136   26946 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 11:12:30.655590   26946 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 11:12:30.814049   26946 docker.go:233] disabling docker service ...

	I0930 11:12:30.814123   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 11:12:30.829972   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 11:12:30.844068   26946 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 11:12:30.969831   26946 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 11:12:31.096443   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 11:12:31.111612   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 11:12:31.131553   26946 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 11:12:31.131621   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.143596   26946 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 11:12:31.143658   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.156112   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.167422   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.179559   26946 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 11:12:31.192037   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.203507   26946 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.222188   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:12:31.234115   26946 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 11:12:31.245344   26946 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 11:12:31.245401   26946 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 11:12:31.259589   26946 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 11:12:31.269907   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:12:31.388443   26946 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 11:12:31.482864   26946 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 11:12:31.482933   26946 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 11:12:31.487957   26946 start.go:563] Will wait 60s for crictl version

	I0930 11:12:31.488026   26946 ssh_runner.go:195] Run: which crictl

	I0930 11:12:31.492173   26946 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 11:12:31.530740   26946 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 11:12:31.530821   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:12:31.560435   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:12:31.592377   26946 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 11:12:31.593888   26946 out.go:177]   - env NO_PROXY=192.168.39.249

	I0930 11:12:31.595254   26946 main.go:141] libmachine: (ha-033260-m02) Calling .GetIP

	I0930 11:12:31.598165   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:31.598504   26946 main.go:141] libmachine: (ha-033260-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:31:8f:e1", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:12:19 +0000 UTC Type:0 Mac:52:54:00:31:8f:e1 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:ha-033260-m02 Clientid:01:52:54:00:31:8f:e1}

	I0930 11:12:31.598535   26946 main.go:141] libmachine: (ha-033260-m02) DBG | domain ha-033260-m02 has defined IP address 192.168.39.3 and MAC address 52:54:00:31:8f:e1 in network mk-ha-033260

	I0930 11:12:31.598710   26946 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 11:12:31.603081   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:12:31.616231   26946 mustload.go:65] Loading cluster: ha-033260

	I0930 11:12:31.616424   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:31.616676   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:31.616714   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:31.631793   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46637

	I0930 11:12:31.632254   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:31.632734   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:31.632757   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:31.633092   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:31.633272   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:12:31.634860   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:31.635130   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:31.635170   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:31.649687   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44627

	I0930 11:12:31.650053   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:31.650497   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:31.650520   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:31.650803   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:31.650951   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:31.651118   26946 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260 for IP: 192.168.39.3

	I0930 11:12:31.651130   26946 certs.go:194] generating shared ca certs ...

	I0930 11:12:31.651148   26946 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:31.651260   26946 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 11:12:31.651304   26946 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 11:12:31.651313   26946 certs.go:256] generating profile certs ...

	I0930 11:12:31.651410   26946 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key

	I0930 11:12:31.651435   26946 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87

	I0930 11:12:31.651449   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.249 192.168.39.3 192.168.39.254]

	I0930 11:12:31.912914   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87 ...

	I0930 11:12:31.912947   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87: {Name:mk5789d867ee86689334498533835b6baa525e2e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:31.913110   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87 ...

	I0930 11:12:31.913123   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87: {Name:mkcd56431095ebd059864bd581ed7c141670cf4a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:12:31.913195   26946 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.e8d40a87 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt

	I0930 11:12:31.913335   26946 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.e8d40a87 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key

	I0930 11:12:31.913463   26946 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key

	I0930 11:12:31.913478   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0930 11:12:31.913490   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0930 11:12:31.913500   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0930 11:12:31.913510   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0930 11:12:31.913520   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0930 11:12:31.913529   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0930 11:12:31.913539   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0930 11:12:31.913551   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0930 11:12:31.913591   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem (1338 bytes)

	W0930 11:12:31.913648   26946 certs.go:480] ignoring /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009_empty.pem, impossibly tiny 0 bytes

	I0930 11:12:31.913661   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 11:12:31.913690   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 11:12:31.913712   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 11:12:31.913735   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 11:12:31.913780   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:12:31.913806   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:31.913824   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem -> /usr/share/ca-certificates/11009.pem

	I0930 11:12:31.913836   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /usr/share/ca-certificates/110092.pem

	I0930 11:12:31.913865   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:31.917099   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:31.917453   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:31.917482   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:31.917675   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:31.917892   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:31.918041   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:31.918169   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:31.994019   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I0930 11:12:31.999621   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0930 11:12:32.012410   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I0930 11:12:32.017661   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0930 11:12:32.028991   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I0930 11:12:32.034566   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0930 11:12:32.047607   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I0930 11:12:32.052664   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0930 11:12:32.069473   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I0930 11:12:32.074705   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0930 11:12:32.086100   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I0930 11:12:32.090557   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0930 11:12:32.103048   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 11:12:32.132371   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 11:12:32.159806   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 11:12:32.185933   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 11:12:32.210826   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0930 11:12:32.236862   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0930 11:12:32.262441   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 11:12:32.289773   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 11:12:32.318287   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 11:12:32.347371   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem --> /usr/share/ca-certificates/11009.pem (1338 bytes)

	I0930 11:12:32.372327   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /usr/share/ca-certificates/110092.pem (1708 bytes)

	I0930 11:12:32.397781   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0930 11:12:32.415260   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0930 11:12:32.433137   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0930 11:12:32.450661   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0930 11:12:32.467444   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0930 11:12:32.484994   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0930 11:12:32.503412   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0930 11:12:32.522919   26946 ssh_runner.go:195] Run: openssl version

	I0930 11:12:32.529057   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 11:12:32.541643   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:32.546691   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:32.546753   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:12:32.553211   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 11:12:32.565054   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009.pem && ln -fs /usr/share/ca-certificates/11009.pem /etc/ssl/certs/11009.pem"

	I0930 11:12:32.576855   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009.pem

	I0930 11:12:32.581764   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 30 11:01 /usr/share/ca-certificates/11009.pem

	I0930 11:12:32.581818   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009.pem

	I0930 11:12:32.588983   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11009.pem /etc/ssl/certs/51391683.0"

	I0930 11:12:32.602082   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110092.pem && ln -fs /usr/share/ca-certificates/110092.pem /etc/ssl/certs/110092.pem"

	I0930 11:12:32.613340   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110092.pem

	I0930 11:12:32.617722   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 30 11:01 /usr/share/ca-certificates/110092.pem

	I0930 11:12:32.617775   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110092.pem

	I0930 11:12:32.623445   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110092.pem /etc/ssl/certs/3ec20f2e.0"

	I0930 11:12:32.635275   26946 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 11:12:32.639755   26946 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 11:12:32.639812   26946 kubeadm.go:934] updating node {m02 192.168.39.3 8443 v1.31.1 crio true true} ...

	I0930 11:12:32.639905   26946 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-033260-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.3

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 11:12:32.639928   26946 kube-vip.go:115] generating kube-vip config ...

	I0930 11:12:32.639958   26946 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0930 11:12:32.657152   26946 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0930 11:12:32.657231   26946 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0930 11:12:32.657301   26946 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 11:12:32.669072   26946 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.1: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.1': No such file or directory

	Initiating transfer...

	I0930 11:12:32.669126   26946 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.1

	I0930 11:12:32.681078   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl.sha256

	I0930 11:12:32.681102   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl -> /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:12:32.681147   26946 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm

	I0930 11:12:32.681159   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:12:32.681202   26946 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet

	I0930 11:12:32.685896   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubectl': No such file or directory

	I0930 11:12:32.685930   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl --> /var/lib/minikube/binaries/v1.31.1/kubectl (56381592 bytes)

	I0930 11:12:33.355089   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm -> /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:12:33.355169   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:12:33.360551   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubeadm': No such file or directory

	I0930 11:12:33.360593   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm --> /var/lib/minikube/binaries/v1.31.1/kubeadm (58290328 bytes)

	I0930 11:12:33.497331   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:12:33.536292   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet -> /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:12:33.536381   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:12:33.556993   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubelet': No such file or directory

	I0930 11:12:33.557034   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet --> /var/lib/minikube/binaries/v1.31.1/kubelet (76869944 bytes)

	I0930 11:12:33.963212   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0930 11:12:33.973956   26946 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)

	I0930 11:12:33.992407   26946 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 11:12:34.010174   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0930 11:12:34.027647   26946 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0930 11:12:34.031715   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:12:34.045021   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:12:34.164493   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:12:34.181854   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:12:34.182385   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:12:34.182436   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:12:34.197448   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34395

	I0930 11:12:34.197925   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:12:34.198415   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:12:34.198439   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:12:34.198777   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:12:34.199019   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:12:34.199179   26946 start.go:317] joinCluster: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Cluster

Name:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:

26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 11:12:34.199281   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0930 11:12:34.199296   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:12:34.202318   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:34.202754   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:12:34.202783   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:12:34.202947   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:12:34.203150   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:12:34.203332   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:12:34.203477   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:12:34.356774   26946 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:34.356813   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token hn6im1.2otceyiojx5fmqqd --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m02 --control-plane --apiserver-advertise-address=192.168.39.3 --apiserver-bind-port=8443"

	I0930 11:12:56.361665   26946 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token hn6im1.2otceyiojx5fmqqd --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m02 --control-plane --apiserver-advertise-address=192.168.39.3 --apiserver-bind-port=8443": (22.004830324s)

	I0930 11:12:56.361703   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0930 11:12:57.091049   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-033260-m02 minikube.k8s.io/updated_at=2024_09_30T11_12_57_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=ha-033260 minikube.k8s.io/primary=false

	I0930 11:12:57.252660   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-033260-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0930 11:12:57.383009   26946 start.go:319] duration metric: took 23.183825523s to joinCluster

	I0930 11:12:57.383083   26946 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:12:57.383372   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:12:57.384696   26946 out.go:177] * Verifying Kubernetes components...

	I0930 11:12:57.385781   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:12:57.652948   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:12:57.700673   26946 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:12:57.700909   26946 kapi.go:59] client config for ha-033260: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt", KeyFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key", CAFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1f685c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0930 11:12:57.700967   26946 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.249:8443

	I0930 11:12:57.701166   26946 node_ready.go:35] waiting up to 6m0s for node "ha-033260-m02" to be "Ready" ...

	I0930 11:12:57.701263   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:57.701272   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:57.701283   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:57.701288   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:57.710787   26946 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0930 11:12:58.201703   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:58.201723   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:58.201733   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:58.201738   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:58.218761   26946 round_trippers.go:574] Response Status: 200 OK in 17 milliseconds

	I0930 11:12:58.701415   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:58.701436   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:58.701444   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:58.701447   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:58.707425   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:12:59.202375   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:59.202398   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:59.202410   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:59.202416   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:59.206657   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:12:59.701590   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:12:59.701611   26946 round_trippers.go:469] Request Headers:

	I0930 11:12:59.701635   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:12:59.701642   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:12:59.706264   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:12:59.707024   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:00.201877   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:00.201901   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:00.201917   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:00.201924   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:00.205419   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:00.701357   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:00.701378   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:00.701386   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:00.701391   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:00.706252   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:01.202282   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:01.202307   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:01.202319   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:01.202325   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:01.206013   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:01.701738   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:01.701760   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:01.701768   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:01.701773   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:01.705302   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:02.202004   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:02.202030   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:02.202043   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:02.202051   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:02.205535   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:02.206136   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:02.701406   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:02.701427   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:02.701436   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:02.701440   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:02.704929   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:03.202160   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:03.202189   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:03.202198   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:03.202204   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:03.205838   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:03.701797   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:03.701821   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:03.701832   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:03.701841   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:03.706107   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:04.201592   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:04.201623   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:04.201634   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:04.201641   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:04.204858   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:04.701789   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:04.701812   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:04.701825   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:04.701831   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:04.710541   26946 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0930 11:13:04.711317   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:05.202211   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:05.202237   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:05.202248   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:05.202255   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:05.206000   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:05.702240   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:05.702263   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:05.702272   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:05.702276   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:05.713473   26946 round_trippers.go:574] Response Status: 200 OK in 11 milliseconds

	I0930 11:13:06.201370   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:06.201398   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:06.201412   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:06.201421   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:06.205062   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:06.702136   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:06.702157   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:06.702170   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:06.702178   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:06.707226   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:13:07.201911   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:07.201933   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:07.201941   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:07.201947   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:07.205398   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:07.206056   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:07.702203   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:07.702228   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:07.702236   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:07.702240   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:07.705652   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:08.201364   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:08.201385   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:08.201393   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:08.201397   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:08.204682   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:08.701564   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:08.701585   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:08.701593   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:08.701597   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:08.704941   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:09.201826   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:09.201874   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:09.201887   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:09.201892   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:09.205730   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:09.206265   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:09.701548   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:09.701576   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:09.701584   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:09.701588   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:09.704970   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:10.202351   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:10.202382   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:10.202393   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:10.202402   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:10.205886   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:10.701694   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:10.701717   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:10.701725   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:10.701729   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:10.705252   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:11.202235   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:11.202256   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:11.202264   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:11.202267   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:11.205904   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:11.206456   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:11.701817   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:11.701840   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:11.701848   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:11.701852   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:11.705418   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:12.202233   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:12.202257   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:12.202267   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:12.202273   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:12.206552   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:12.701910   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:12.701932   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:12.701940   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:12.701944   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:12.705423   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:13.201690   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:13.201715   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:13.201727   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:13.201733   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:13.205360   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:13.701378   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:13.701402   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:13.701410   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:13.701416   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:13.704921   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:13.705712   26946 node_ready.go:53] node "ha-033260-m02" has status "Ready":"False"

	I0930 11:13:14.202280   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:14.202303   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.202313   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.202317   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.206153   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.701500   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:14.701536   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.701545   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.701549   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.705110   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.705891   26946 node_ready.go:49] node "ha-033260-m02" has status "Ready":"True"

	I0930 11:13:14.705919   26946 node_ready.go:38] duration metric: took 17.004728232s for node "ha-033260-m02" to be "Ready" ...

	I0930 11:13:14.705930   26946 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:13:14.706003   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:14.706012   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.706019   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.706027   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.710637   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:14.717034   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.717112   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-5frmm

	I0930 11:13:14.717120   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.717127   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.717132   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.720167   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.720847   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:14.720863   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.720870   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.720874   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.723869   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:13:14.724515   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.724535   26946 pod_ready.go:82] duration metric: took 7.4758ms for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.724545   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.724613   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-kt87v

	I0930 11:13:14.724621   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.724628   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.724634   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.727903   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.728724   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:14.728741   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.728751   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.728757   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.731653   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:13:14.732553   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.732574   26946 pod_ready.go:82] duration metric: took 8.020759ms for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.732586   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.732653   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260

	I0930 11:13:14.732664   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.732674   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.732682   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.735972   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.736968   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:14.736990   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.737001   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.737006   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.742593   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:13:14.743126   26946 pod_ready.go:93] pod "etcd-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.743157   26946 pod_ready.go:82] duration metric: took 10.560613ms for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.743170   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.743261   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m02

	I0930 11:13:14.743274   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.743284   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.743295   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.746988   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:14.747647   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:14.747666   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.747678   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.747685   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.752616   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:14.753409   26946 pod_ready.go:93] pod "etcd-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:14.753424   26946 pod_ready.go:82] duration metric: took 10.242469ms for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.753437   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:14.901974   26946 request.go:632] Waited for 148.458979ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:13:14.902036   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:13:14.902043   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:14.902055   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:14.902060   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:14.905987   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.101905   26946 request.go:632] Waited for 195.35281ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.101994   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.102002   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.102014   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.102020   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.106060   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:15.106613   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:15.106631   26946 pod_ready.go:82] duration metric: took 353.188275ms for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.106640   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.301775   26946 request.go:632] Waited for 195.071866ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:13:15.301852   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:13:15.301859   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.301869   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.301877   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.305432   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.502470   26946 request.go:632] Waited for 196.425957ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:15.502545   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:15.502550   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.502559   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.502564   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.506368   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.506795   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:15.506815   26946 pod_ready.go:82] duration metric: took 400.168693ms for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.506824   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.702050   26946 request.go:632] Waited for 195.162388ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:13:15.702133   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:13:15.702141   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.702152   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.702163   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.705891   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.901957   26946 request.go:632] Waited for 195.415244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.902015   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:15.902032   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:15.902045   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:15.902050   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:15.905760   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:15.906550   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:15.906568   26946 pod_ready.go:82] duration metric: took 399.738814ms for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:15.906577   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.101960   26946 request.go:632] Waited for 195.295618ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:13:16.102015   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:13:16.102020   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.102027   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.102034   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.105657   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:16.301949   26946 request.go:632] Waited for 195.400353ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.302010   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.302015   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.302022   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.302028   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.306149   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:16.306664   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:16.306684   26946 pod_ready.go:82] duration metric: took 400.100909ms for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.306693   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.501852   26946 request.go:632] Waited for 195.093896ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:13:16.501929   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:13:16.501936   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.501944   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.501948   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.505624   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:16.702111   26946 request.go:632] Waited for 195.755005ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.702172   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:16.702201   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.702232   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.702242   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.706191   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:16.706772   26946 pod_ready.go:93] pod "kube-proxy-fckwn" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:16.706793   26946 pod_ready.go:82] duration metric: took 400.093034ms for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.706806   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:16.901822   26946 request.go:632] Waited for 194.939903ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:13:16.901874   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:13:16.901878   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:16.901886   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:16.901890   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:16.905939   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:17.102468   26946 request.go:632] Waited for 195.869654ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.102551   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.102559   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.102570   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.102576   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.105889   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.106573   26946 pod_ready.go:93] pod "kube-proxy-mxvxr" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:17.106594   26946 pod_ready.go:82] duration metric: took 399.778126ms for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.106605   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.301593   26946 request.go:632] Waited for 194.913576ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:13:17.301653   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:13:17.301658   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.301671   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.301678   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.305178   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.502249   26946 request.go:632] Waited for 196.387698ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.502326   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:13:17.502350   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.502358   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.502362   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.505833   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.506907   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:17.506935   26946 pod_ready.go:82] duration metric: took 400.319251ms for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.506948   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.701919   26946 request.go:632] Waited for 194.9063ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:13:17.701999   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:13:17.702006   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.702017   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.702028   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.705520   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:13:17.902402   26946 request.go:632] Waited for 196.207639ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:17.902477   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:13:17.902485   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.902500   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.902526   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.906656   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:17.907109   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:13:17.907128   26946 pod_ready.go:82] duration metric: took 400.172408ms for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:13:17.907142   26946 pod_ready.go:39] duration metric: took 3.201195785s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:13:17.907159   26946 api_server.go:52] waiting for apiserver process to appear ...

	I0930 11:13:17.907218   26946 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0930 11:13:17.923202   26946 api_server.go:72] duration metric: took 20.540084285s to wait for apiserver process to appear ...

	I0930 11:13:17.923232   26946 api_server.go:88] waiting for apiserver healthz status ...

	I0930 11:13:17.923251   26946 api_server.go:253] Checking apiserver healthz at https://192.168.39.249:8443/healthz ...

	I0930 11:13:17.929517   26946 api_server.go:279] https://192.168.39.249:8443/healthz returned 200:

	ok

	I0930 11:13:17.929596   26946 round_trippers.go:463] GET https://192.168.39.249:8443/version

	I0930 11:13:17.929602   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:17.929631   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:17.929636   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:17.930581   26946 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0930 11:13:17.930807   26946 api_server.go:141] control plane version: v1.31.1

	I0930 11:13:17.930834   26946 api_server.go:131] duration metric: took 7.593991ms to wait for apiserver health ...

	I0930 11:13:17.930843   26946 system_pods.go:43] waiting for kube-system pods to appear ...

	I0930 11:13:18.102359   26946 request.go:632] Waited for 171.419304ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.102425   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.102433   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.102442   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.102449   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.107679   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:13:18.114591   26946 system_pods.go:59] 17 kube-system pods found

	I0930 11:13:18.114717   26946 system_pods.go:61] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:13:18.114749   26946 system_pods.go:61] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:13:18.114780   26946 system_pods.go:61] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:13:18.114803   26946 system_pods.go:61] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:13:18.114826   26946 system_pods.go:61] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:13:18.114841   26946 system_pods.go:61] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:13:18.114876   26946 system_pods.go:61] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:13:18.114899   26946 system_pods.go:61] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:13:18.114915   26946 system_pods.go:61] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:13:18.114935   26946 system_pods.go:61] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:13:18.114950   26946 system_pods.go:61] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:13:18.114975   26946 system_pods.go:61] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:13:18.114997   26946 system_pods.go:61] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:13:18.115011   26946 system_pods.go:61] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:13:18.115025   26946 system_pods.go:61] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:13:18.115059   26946 system_pods.go:61] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:13:18.115132   26946 system_pods.go:61] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:13:18.115146   26946 system_pods.go:74] duration metric: took 184.295086ms to wait for pod list to return data ...

	I0930 11:13:18.115155   26946 default_sa.go:34] waiting for default service account to be created ...

	I0930 11:13:18.301606   26946 request.go:632] Waited for 186.324564ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:13:18.301691   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:13:18.301697   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.301704   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.301708   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.305792   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:18.306031   26946 default_sa.go:45] found service account: "default"

	I0930 11:13:18.306053   26946 default_sa.go:55] duration metric: took 190.887438ms for default service account to be created ...

	I0930 11:13:18.306064   26946 system_pods.go:116] waiting for k8s-apps to be running ...

	I0930 11:13:18.502520   26946 request.go:632] Waited for 196.381212ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.502574   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:13:18.502580   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.502589   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.502594   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.507606   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:18.513786   26946 system_pods.go:86] 17 kube-system pods found

	I0930 11:13:18.513814   26946 system_pods.go:89] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:13:18.513820   26946 system_pods.go:89] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:13:18.513824   26946 system_pods.go:89] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:13:18.513828   26946 system_pods.go:89] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:13:18.513832   26946 system_pods.go:89] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:13:18.513835   26946 system_pods.go:89] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:13:18.513838   26946 system_pods.go:89] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:13:18.513842   26946 system_pods.go:89] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:13:18.513845   26946 system_pods.go:89] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:13:18.513849   26946 system_pods.go:89] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:13:18.513852   26946 system_pods.go:89] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:13:18.513855   26946 system_pods.go:89] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:13:18.513858   26946 system_pods.go:89] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:13:18.513864   26946 system_pods.go:89] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:13:18.513868   26946 system_pods.go:89] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:13:18.513871   26946 system_pods.go:89] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:13:18.513874   26946 system_pods.go:89] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:13:18.513883   26946 system_pods.go:126] duration metric: took 207.809961ms to wait for k8s-apps to be running ...

	I0930 11:13:18.513889   26946 system_svc.go:44] waiting for kubelet service to be running ....

	I0930 11:13:18.513933   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:13:18.530491   26946 system_svc.go:56] duration metric: took 16.594303ms WaitForService to wait for kubelet

	I0930 11:13:18.530520   26946 kubeadm.go:582] duration metric: took 21.147406438s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 11:13:18.530536   26946 node_conditions.go:102] verifying NodePressure condition ...

	I0930 11:13:18.701935   26946 request.go:632] Waited for 171.311845ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes

	I0930 11:13:18.701998   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes

	I0930 11:13:18.702004   26946 round_trippers.go:469] Request Headers:

	I0930 11:13:18.702013   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:13:18.702020   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:13:18.706454   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:13:18.707258   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:13:18.707286   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:13:18.707302   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:13:18.707309   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:13:18.707315   26946 node_conditions.go:105] duration metric: took 176.773141ms to run NodePressure ...

	I0930 11:13:18.707329   26946 start.go:241] waiting for startup goroutines ...

	I0930 11:13:18.707365   26946 start.go:255] writing updated cluster config ...

	I0930 11:13:18.709744   26946 out.go:201] 

	I0930 11:13:18.711365   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:13:18.711455   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:13:18.713157   26946 out.go:177] * Starting "ha-033260-m03" control-plane node in "ha-033260" cluster

	I0930 11:13:18.714611   26946 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio

	I0930 11:13:18.714636   26946 cache.go:56] Caching tarball of preloaded images

	I0930 11:13:18.714744   26946 preload.go:172] Found /home/jenkins/minikube-integration/19734-3842/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0930 11:13:18.714757   26946 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio

	I0930 11:13:18.714852   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:13:18.715040   26946 start.go:360] acquireMachinesLock for ha-033260-m03: {Name:mk00c8e95dd7ef3f3af18c831feaff25b009c005 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0930 11:13:18.715084   26946 start.go:364] duration metric: took 25.338µs to acquireMachinesLock for "ha-033260-m03"

	I0930 11:13:18.715101   26946 start.go:93] Provisioning new machine with config: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-

gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizatio

ns:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:13:18.715188   26946 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0930 11:13:18.716794   26946 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0930 11:13:18.716894   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:18.716928   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:18.732600   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42281

	I0930 11:13:18.733109   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:18.733561   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:18.733575   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:18.733910   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:18.734089   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:18.734238   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:18.734421   26946 start.go:159] libmachine.API.Create for "ha-033260" (driver="kvm2")

	I0930 11:13:18.734451   26946 client.go:168] LocalClient.Create starting

	I0930 11:13:18.734489   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem

	I0930 11:13:18.734529   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:13:18.734544   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:13:18.734600   26946 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem

	I0930 11:13:18.734619   26946 main.go:141] libmachine: Decoding PEM data...

	I0930 11:13:18.734631   26946 main.go:141] libmachine: Parsing certificate...

	I0930 11:13:18.734648   26946 main.go:141] libmachine: Running pre-create checks...

	I0930 11:13:18.734656   26946 main.go:141] libmachine: (ha-033260-m03) Calling .PreCreateCheck

	I0930 11:13:18.734797   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetConfigRaw

	I0930 11:13:18.735196   26946 main.go:141] libmachine: Creating machine...

	I0930 11:13:18.735209   26946 main.go:141] libmachine: (ha-033260-m03) Calling .Create

	I0930 11:13:18.735336   26946 main.go:141] libmachine: (ha-033260-m03) Creating KVM machine...

	I0930 11:13:18.736643   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found existing default KVM network

	I0930 11:13:18.736820   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found existing private KVM network mk-ha-033260

	I0930 11:13:18.736982   26946 main.go:141] libmachine: (ha-033260-m03) Setting up store path in /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03 ...

	I0930 11:13:18.737011   26946 main.go:141] libmachine: (ha-033260-m03) Building disk image from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso

	I0930 11:13:18.737118   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:18.736992   27716 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:13:18.737204   26946 main.go:141] libmachine: (ha-033260-m03) Downloading /home/jenkins/minikube-integration/19734-3842/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19734-3842/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...

	I0930 11:13:18.965830   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:18.965684   27716 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa...

	I0930 11:13:19.182387   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:19.182221   27716 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/ha-033260-m03.rawdisk...

	I0930 11:13:19.182427   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Writing magic tar header

	I0930 11:13:19.182442   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Writing SSH key tar header

	I0930 11:13:19.182454   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:19.182378   27716 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03 ...

	I0930 11:13:19.182548   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03

	I0930 11:13:19.182570   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube/machines

	I0930 11:13:19.182578   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03 (perms=drwx------)

	I0930 11:13:19.182587   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube/machines (perms=drwxr-xr-x)

	I0930 11:13:19.182596   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842/.minikube (perms=drwxr-xr-x)

	I0930 11:13:19.182610   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration/19734-3842 (perms=drwxrwxr-x)

	I0930 11:13:19.182620   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0930 11:13:19.182634   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842/.minikube

	I0930 11:13:19.182647   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19734-3842

	I0930 11:13:19.182661   26946 main.go:141] libmachine: (ha-033260-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0930 11:13:19.182678   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0930 11:13:19.182687   26946 main.go:141] libmachine: (ha-033260-m03) Creating domain...

	I0930 11:13:19.182699   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home/jenkins

	I0930 11:13:19.182796   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Checking permissions on dir: /home

	I0930 11:13:19.182820   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Skipping /home - not owner

	I0930 11:13:19.183716   26946 main.go:141] libmachine: (ha-033260-m03) define libvirt domain using xml: 

	I0930 11:13:19.183740   26946 main.go:141] libmachine: (ha-033260-m03) <domain type='kvm'>

	I0930 11:13:19.183766   26946 main.go:141] libmachine: (ha-033260-m03)   <name>ha-033260-m03</name>

	I0930 11:13:19.183787   26946 main.go:141] libmachine: (ha-033260-m03)   <memory unit='MiB'>2200</memory>

	I0930 11:13:19.183800   26946 main.go:141] libmachine: (ha-033260-m03)   <vcpu>2</vcpu>

	I0930 11:13:19.183806   26946 main.go:141] libmachine: (ha-033260-m03)   <features>

	I0930 11:13:19.183817   26946 main.go:141] libmachine: (ha-033260-m03)     <acpi/>

	I0930 11:13:19.183827   26946 main.go:141] libmachine: (ha-033260-m03)     <apic/>

	I0930 11:13:19.183836   26946 main.go:141] libmachine: (ha-033260-m03)     <pae/>

	I0930 11:13:19.183845   26946 main.go:141] libmachine: (ha-033260-m03)     

	I0930 11:13:19.183853   26946 main.go:141] libmachine: (ha-033260-m03)   </features>

	I0930 11:13:19.183861   26946 main.go:141] libmachine: (ha-033260-m03)   <cpu mode='host-passthrough'>

	I0930 11:13:19.183868   26946 main.go:141] libmachine: (ha-033260-m03)   

	I0930 11:13:19.183881   26946 main.go:141] libmachine: (ha-033260-m03)   </cpu>

	I0930 11:13:19.183892   26946 main.go:141] libmachine: (ha-033260-m03)   <os>

	I0930 11:13:19.183902   26946 main.go:141] libmachine: (ha-033260-m03)     <type>hvm</type>

	I0930 11:13:19.183911   26946 main.go:141] libmachine: (ha-033260-m03)     <boot dev='cdrom'/>

	I0930 11:13:19.183924   26946 main.go:141] libmachine: (ha-033260-m03)     <boot dev='hd'/>

	I0930 11:13:19.183936   26946 main.go:141] libmachine: (ha-033260-m03)     <bootmenu enable='no'/>

	I0930 11:13:19.183942   26946 main.go:141] libmachine: (ha-033260-m03)   </os>

	I0930 11:13:19.183951   26946 main.go:141] libmachine: (ha-033260-m03)   <devices>

	I0930 11:13:19.183961   26946 main.go:141] libmachine: (ha-033260-m03)     <disk type='file' device='cdrom'>

	I0930 11:13:19.183975   26946 main.go:141] libmachine: (ha-033260-m03)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/boot2docker.iso'/>

	I0930 11:13:19.183985   26946 main.go:141] libmachine: (ha-033260-m03)       <target dev='hdc' bus='scsi'/>

	I0930 11:13:19.183993   26946 main.go:141] libmachine: (ha-033260-m03)       <readonly/>

	I0930 11:13:19.184007   26946 main.go:141] libmachine: (ha-033260-m03)     </disk>

	I0930 11:13:19.184019   26946 main.go:141] libmachine: (ha-033260-m03)     <disk type='file' device='disk'>

	I0930 11:13:19.184028   26946 main.go:141] libmachine: (ha-033260-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0930 11:13:19.184041   26946 main.go:141] libmachine: (ha-033260-m03)       <source file='/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/ha-033260-m03.rawdisk'/>

	I0930 11:13:19.184052   26946 main.go:141] libmachine: (ha-033260-m03)       <target dev='hda' bus='virtio'/>

	I0930 11:13:19.184065   26946 main.go:141] libmachine: (ha-033260-m03)     </disk>

	I0930 11:13:19.184076   26946 main.go:141] libmachine: (ha-033260-m03)     <interface type='network'>

	I0930 11:13:19.184137   26946 main.go:141] libmachine: (ha-033260-m03)       <source network='mk-ha-033260'/>

	I0930 11:13:19.184167   26946 main.go:141] libmachine: (ha-033260-m03)       <model type='virtio'/>

	I0930 11:13:19.184179   26946 main.go:141] libmachine: (ha-033260-m03)     </interface>

	I0930 11:13:19.184187   26946 main.go:141] libmachine: (ha-033260-m03)     <interface type='network'>

	I0930 11:13:19.184197   26946 main.go:141] libmachine: (ha-033260-m03)       <source network='default'/>

	I0930 11:13:19.184205   26946 main.go:141] libmachine: (ha-033260-m03)       <model type='virtio'/>

	I0930 11:13:19.184215   26946 main.go:141] libmachine: (ha-033260-m03)     </interface>

	I0930 11:13:19.184223   26946 main.go:141] libmachine: (ha-033260-m03)     <serial type='pty'>

	I0930 11:13:19.184242   26946 main.go:141] libmachine: (ha-033260-m03)       <target port='0'/>

	I0930 11:13:19.184249   26946 main.go:141] libmachine: (ha-033260-m03)     </serial>

	I0930 11:13:19.184259   26946 main.go:141] libmachine: (ha-033260-m03)     <console type='pty'>

	I0930 11:13:19.184267   26946 main.go:141] libmachine: (ha-033260-m03)       <target type='serial' port='0'/>

	I0930 11:13:19.184277   26946 main.go:141] libmachine: (ha-033260-m03)     </console>

	I0930 11:13:19.184285   26946 main.go:141] libmachine: (ha-033260-m03)     <rng model='virtio'>

	I0930 11:13:19.184297   26946 main.go:141] libmachine: (ha-033260-m03)       <backend model='random'>/dev/random</backend>

	I0930 11:13:19.184305   26946 main.go:141] libmachine: (ha-033260-m03)     </rng>

	I0930 11:13:19.184313   26946 main.go:141] libmachine: (ha-033260-m03)     

	I0930 11:13:19.184326   26946 main.go:141] libmachine: (ha-033260-m03)     

	I0930 11:13:19.184337   26946 main.go:141] libmachine: (ha-033260-m03)   </devices>

	I0930 11:13:19.184344   26946 main.go:141] libmachine: (ha-033260-m03) </domain>

	I0930 11:13:19.184355   26946 main.go:141] libmachine: (ha-033260-m03) 

	I0930 11:13:19.191067   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:09:7f:ae in network default

	I0930 11:13:19.191719   26946 main.go:141] libmachine: (ha-033260-m03) Ensuring networks are active...

	I0930 11:13:19.191738   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:19.192592   26946 main.go:141] libmachine: (ha-033260-m03) Ensuring network default is active

	I0930 11:13:19.192924   26946 main.go:141] libmachine: (ha-033260-m03) Ensuring network mk-ha-033260 is active

	I0930 11:13:19.193268   26946 main.go:141] libmachine: (ha-033260-m03) Getting domain xml...

	I0930 11:13:19.193941   26946 main.go:141] libmachine: (ha-033260-m03) Creating domain...

	I0930 11:13:20.468738   26946 main.go:141] libmachine: (ha-033260-m03) Waiting to get IP...

	I0930 11:13:20.469515   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:20.469944   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:20.469970   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:20.469926   27716 retry.go:31] will retry after 232.398954ms: waiting for machine to come up

	I0930 11:13:20.704544   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:20.704996   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:20.705026   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:20.704955   27716 retry.go:31] will retry after 380.728938ms: waiting for machine to come up

	I0930 11:13:21.087407   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:21.087831   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:21.087853   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:21.087810   27716 retry.go:31] will retry after 405.871711ms: waiting for machine to come up

	I0930 11:13:21.495366   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:21.495857   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:21.495885   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:21.495810   27716 retry.go:31] will retry after 380.57456ms: waiting for machine to come up

	I0930 11:13:21.878262   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:21.878697   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:21.878718   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:21.878678   27716 retry.go:31] will retry after 486.639816ms: waiting for machine to come up

	I0930 11:13:22.367485   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:22.367998   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:22.368026   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:22.367946   27716 retry.go:31] will retry after 818.869274ms: waiting for machine to come up

	I0930 11:13:23.187832   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:23.188286   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:23.188306   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:23.188246   27716 retry.go:31] will retry after 870.541242ms: waiting for machine to come up

	I0930 11:13:24.060866   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:24.061364   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:24.061403   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:24.061339   27716 retry.go:31] will retry after 1.026163442s: waiting for machine to come up

	I0930 11:13:25.089407   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:25.089859   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:25.089889   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:25.089789   27716 retry.go:31] will retry after 1.677341097s: waiting for machine to come up

	I0930 11:13:26.769716   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:26.770127   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:26.770173   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:26.770102   27716 retry.go:31] will retry after 2.102002194s: waiting for machine to come up

	I0930 11:13:28.873495   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:28.874089   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:28.874118   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:28.874042   27716 retry.go:31] will retry after 2.512249945s: waiting for machine to come up

	I0930 11:13:31.388375   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:31.388813   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:31.388842   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:31.388766   27716 retry.go:31] will retry after 3.025058152s: waiting for machine to come up

	I0930 11:13:34.415391   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:34.415806   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:34.415826   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:34.415764   27716 retry.go:31] will retry after 3.6491044s: waiting for machine to come up

	I0930 11:13:38.067512   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:38.067932   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find current IP address of domain ha-033260-m03 in network mk-ha-033260

	I0930 11:13:38.067957   26946 main.go:141] libmachine: (ha-033260-m03) DBG | I0930 11:13:38.067891   27716 retry.go:31] will retry after 5.462753525s: waiting for machine to come up

	I0930 11:13:43.535257   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:43.535767   26946 main.go:141] libmachine: (ha-033260-m03) Found IP for machine: 192.168.39.238

	I0930 11:13:43.535792   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has current primary IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:43.535800   26946 main.go:141] libmachine: (ha-033260-m03) Reserving static IP address...

	I0930 11:13:43.536253   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find host DHCP lease matching {name: "ha-033260-m03", mac: "52:54:00:f2:70:c8", ip: "192.168.39.238"} in network mk-ha-033260

	I0930 11:13:43.612168   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Getting to WaitForSSH function...

	I0930 11:13:43.612200   26946 main.go:141] libmachine: (ha-033260-m03) Reserved static IP address: 192.168.39.238

	I0930 11:13:43.612213   26946 main.go:141] libmachine: (ha-033260-m03) Waiting for SSH to be available...

	I0930 11:13:43.614758   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:43.615073   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260

	I0930 11:13:43.615102   26946 main.go:141] libmachine: (ha-033260-m03) DBG | unable to find defined IP address of network mk-ha-033260 interface with MAC address 52:54:00:f2:70:c8

	I0930 11:13:43.615180   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH client type: external

	I0930 11:13:43.615208   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa (-rw-------)

	I0930 11:13:43.615240   26946 main.go:141] libmachine: (ha-033260-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:13:43.615252   26946 main.go:141] libmachine: (ha-033260-m03) DBG | About to run SSH command:

	I0930 11:13:43.615269   26946 main.go:141] libmachine: (ha-033260-m03) DBG | exit 0

	I0930 11:13:43.619189   26946 main.go:141] libmachine: (ha-033260-m03) DBG | SSH cmd err, output: exit status 255: 

	I0930 11:13:43.619212   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0930 11:13:43.619222   26946 main.go:141] libmachine: (ha-033260-m03) DBG | command : exit 0

	I0930 11:13:43.619233   26946 main.go:141] libmachine: (ha-033260-m03) DBG | err     : exit status 255

	I0930 11:13:43.619246   26946 main.go:141] libmachine: (ha-033260-m03) DBG | output  : 

	I0930 11:13:46.621877   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Getting to WaitForSSH function...

	I0930 11:13:46.624327   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.624849   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.624873   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.625052   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH client type: external

	I0930 11:13:46.625075   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa (-rw-------)

	I0930 11:13:46.625113   26946 main.go:141] libmachine: (ha-033260-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.238 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0930 11:13:46.625125   26946 main.go:141] libmachine: (ha-033260-m03) DBG | About to run SSH command:

	I0930 11:13:46.625137   26946 main.go:141] libmachine: (ha-033260-m03) DBG | exit 0

	I0930 11:13:46.749932   26946 main.go:141] libmachine: (ha-033260-m03) DBG | SSH cmd err, output: <nil>: 

	I0930 11:13:46.750211   26946 main.go:141] libmachine: (ha-033260-m03) KVM machine creation complete!

	I0930 11:13:46.750551   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetConfigRaw

	I0930 11:13:46.751116   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:46.751371   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:46.751553   26946 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0930 11:13:46.751568   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetState

	I0930 11:13:46.752698   26946 main.go:141] libmachine: Detecting operating system of created instance...

	I0930 11:13:46.752714   26946 main.go:141] libmachine: Waiting for SSH to be available...

	I0930 11:13:46.752721   26946 main.go:141] libmachine: Getting to WaitForSSH function...

	I0930 11:13:46.752728   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:46.755296   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.755714   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.755738   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.755877   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:46.756027   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.756136   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.756284   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:46.756448   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:46.756639   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:46.756651   26946 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0930 11:13:46.857068   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:13:46.857090   26946 main.go:141] libmachine: Detecting the provisioner...

	I0930 11:13:46.857097   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:46.859904   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.860340   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.860372   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.860564   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:46.860899   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.861065   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.861200   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:46.861350   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:46.861511   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:46.861526   26946 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0930 11:13:46.970453   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0930 11:13:46.970520   26946 main.go:141] libmachine: found compatible host: buildroot

	I0930 11:13:46.970534   26946 main.go:141] libmachine: Provisioning with buildroot...

	I0930 11:13:46.970543   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:46.970766   26946 buildroot.go:166] provisioning hostname "ha-033260-m03"

	I0930 11:13:46.970791   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:46.970955   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:46.973539   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.973929   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:46.973956   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:46.974221   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:46.974372   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.974556   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:46.974665   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:46.974786   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:46.974938   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:46.974953   26946 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-033260-m03 && echo "ha-033260-m03" | sudo tee /etc/hostname

	I0930 11:13:47.087604   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-033260-m03

	I0930 11:13:47.087636   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.090559   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.090866   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.090895   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.091089   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.091283   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.091400   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.091516   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.091649   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:47.091811   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:47.091834   26946 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-033260-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-033260-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-033260-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0930 11:13:47.203919   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0930 11:13:47.203950   26946 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19734-3842/.minikube CaCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19734-3842/.minikube}

	I0930 11:13:47.203969   26946 buildroot.go:174] setting up certificates

	I0930 11:13:47.203977   26946 provision.go:84] configureAuth start

	I0930 11:13:47.203986   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetMachineName

	I0930 11:13:47.204270   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:47.207236   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.207589   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.207618   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.207750   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.210196   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.210560   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.210587   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.210754   26946 provision.go:143] copyHostCerts

	I0930 11:13:47.210783   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:13:47.210816   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem, removing ...

	I0930 11:13:47.210826   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem

	I0930 11:13:47.210895   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/cert.pem (1123 bytes)

	I0930 11:13:47.210966   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:13:47.210983   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem, removing ...

	I0930 11:13:47.210989   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem

	I0930 11:13:47.211013   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/key.pem (1679 bytes)

	I0930 11:13:47.211059   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:13:47.211076   26946 exec_runner.go:144] found /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem, removing ...

	I0930 11:13:47.211082   26946 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem

	I0930 11:13:47.211104   26946 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19734-3842/.minikube/ca.pem (1082 bytes)

	I0930 11:13:47.211150   26946 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem org=jenkins.ha-033260-m03 san=[127.0.0.1 192.168.39.238 ha-033260-m03 localhost minikube]

	I0930 11:13:47.437398   26946 provision.go:177] copyRemoteCerts

	I0930 11:13:47.437447   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0930 11:13:47.437470   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.440541   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.440922   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.440953   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.441156   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.441379   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.441583   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.441760   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:47.524024   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0930 11:13:47.524094   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0930 11:13:47.548921   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0930 11:13:47.548991   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0930 11:13:47.573300   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0930 11:13:47.573362   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0930 11:13:47.597885   26946 provision.go:87] duration metric: took 393.894244ms to configureAuth

	I0930 11:13:47.597913   26946 buildroot.go:189] setting minikube options for container-runtime

	I0930 11:13:47.598137   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:13:47.598221   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.600783   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.601100   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.601141   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.601308   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.601511   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.601694   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.601837   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.601988   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:47.602139   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:47.602153   26946 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0930 11:13:47.824726   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0930 11:13:47.824757   26946 main.go:141] libmachine: Checking connection to Docker...

	I0930 11:13:47.824767   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetURL

	I0930 11:13:47.826205   26946 main.go:141] libmachine: (ha-033260-m03) DBG | Using libvirt version 6000000

	I0930 11:13:47.829313   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.829732   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.829758   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.829979   26946 main.go:141] libmachine: Docker is up and running!

	I0930 11:13:47.829995   26946 main.go:141] libmachine: Reticulating splines...

	I0930 11:13:47.830002   26946 client.go:171] duration metric: took 29.095541403s to LocalClient.Create

	I0930 11:13:47.830029   26946 start.go:167] duration metric: took 29.095609634s to libmachine.API.Create "ha-033260"

	I0930 11:13:47.830042   26946 start.go:293] postStartSetup for "ha-033260-m03" (driver="kvm2")

	I0930 11:13:47.830059   26946 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0930 11:13:47.830080   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:47.830308   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0930 11:13:47.830331   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.832443   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.832840   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.832866   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.833032   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.833204   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.833336   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.833448   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:47.911982   26946 ssh_runner.go:195] Run: cat /etc/os-release

	I0930 11:13:47.916413   26946 info.go:137] Remote host: Buildroot 2023.02.9

	I0930 11:13:47.916434   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/addons for local assets ...

	I0930 11:13:47.916512   26946 filesync.go:126] Scanning /home/jenkins/minikube-integration/19734-3842/.minikube/files for local assets ...

	I0930 11:13:47.916604   26946 filesync.go:149] local asset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> 110092.pem in /etc/ssl/certs

	I0930 11:13:47.916615   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /etc/ssl/certs/110092.pem

	I0930 11:13:47.916726   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0930 11:13:47.926360   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:13:47.951398   26946 start.go:296] duration metric: took 121.337458ms for postStartSetup

	I0930 11:13:47.951443   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetConfigRaw

	I0930 11:13:47.951959   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:47.954522   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.954882   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.954902   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.955203   26946 profile.go:143] Saving config to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/config.json ...

	I0930 11:13:47.955450   26946 start.go:128] duration metric: took 29.240250665s to createHost

	I0930 11:13:47.955475   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:47.957714   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.958054   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:47.958091   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:47.958262   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:47.958436   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.958562   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:47.958708   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:47.958822   26946 main.go:141] libmachine: Using SSH client type: native

	I0930 11:13:47.958982   26946 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil>  [] 0s} 192.168.39.238 22 <nil> <nil>}

	I0930 11:13:47.958994   26946 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0930 11:13:48.062976   26946 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727694828.042605099

	I0930 11:13:48.062999   26946 fix.go:216] guest clock: 1727694828.042605099

	I0930 11:13:48.063009   26946 fix.go:229] Guest: 2024-09-30 11:13:48.042605099 +0000 UTC Remote: 2024-09-30 11:13:47.955462433 +0000 UTC m=+151.020514213 (delta=87.142666ms)

	I0930 11:13:48.063030   26946 fix.go:200] guest clock delta is within tolerance: 87.142666ms

	I0930 11:13:48.063037   26946 start.go:83] releasing machines lock for "ha-033260-m03", held for 29.347943498s

	I0930 11:13:48.063057   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.063295   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:48.065833   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.066130   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:48.066166   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.068440   26946 out.go:177] * Found network options:

	I0930 11:13:48.070194   26946 out.go:177]   - NO_PROXY=192.168.39.249,192.168.39.3

	W0930 11:13:48.071578   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	W0930 11:13:48.071602   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:13:48.071621   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.072253   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.072426   26946 main.go:141] libmachine: (ha-033260-m03) Calling .DriverName

	I0930 11:13:48.072506   26946 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0930 11:13:48.072552   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	W0930 11:13:48.072605   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	W0930 11:13:48.072630   26946 proxy.go:119] fail to check proxy env: Error ip not in block

	I0930 11:13:48.072698   26946 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0930 11:13:48.072719   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHHostname

	I0930 11:13:48.075267   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075365   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075641   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:48.075667   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075715   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:48.075746   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:48.075778   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:48.075958   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:48.075973   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHPort

	I0930 11:13:48.076123   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:48.076126   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHKeyPath

	I0930 11:13:48.076233   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:48.076311   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetSSHUsername

	I0930 11:13:48.076464   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260-m03/id_rsa Username:docker}

	I0930 11:13:48.315424   26946 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0930 11:13:48.322103   26946 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0930 11:13:48.322167   26946 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0930 11:13:48.340329   26946 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0930 11:13:48.340354   26946 start.go:495] detecting cgroup driver to use...

	I0930 11:13:48.340419   26946 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0930 11:13:48.356866   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0930 11:13:48.372077   26946 docker.go:217] disabling cri-docker service (if available) ...

	I0930 11:13:48.372139   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0930 11:13:48.387616   26946 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0930 11:13:48.402259   26946 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0930 11:13:48.523588   26946 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0930 11:13:48.671634   26946 docker.go:233] disabling docker service ...

	I0930 11:13:48.671693   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0930 11:13:48.687483   26946 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0930 11:13:48.702106   26946 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0930 11:13:48.848121   26946 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0930 11:13:48.976600   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0930 11:13:48.991745   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0930 11:13:49.014226   26946 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I0930 11:13:49.014303   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.025816   26946 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0930 11:13:49.025892   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.038153   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.049762   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.061409   26946 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0930 11:13:49.073521   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.084788   26946 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.104074   26946 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0930 11:13:49.116909   26946 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0930 11:13:49.129116   26946 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0930 11:13:49.129180   26946 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0930 11:13:49.143704   26946 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0930 11:13:49.155037   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:13:49.274882   26946 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0930 11:13:49.369751   26946 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I0930 11:13:49.369822   26946 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0930 11:13:49.375071   26946 start.go:563] Will wait 60s for crictl version

	I0930 11:13:49.375129   26946 ssh_runner.go:195] Run: which crictl

	I0930 11:13:49.379040   26946 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0930 11:13:49.421444   26946 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0930 11:13:49.421545   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:13:49.450271   26946 ssh_runner.go:195] Run: crio --version

	I0930 11:13:49.481221   26946 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.29.1 ...

	I0930 11:13:49.482604   26946 out.go:177]   - env NO_PROXY=192.168.39.249

	I0930 11:13:49.483828   26946 out.go:177]   - env NO_PROXY=192.168.39.249,192.168.39.3

	I0930 11:13:49.485093   26946 main.go:141] libmachine: (ha-033260-m03) Calling .GetIP

	I0930 11:13:49.488106   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:49.488528   26946 main.go:141] libmachine: (ha-033260-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:70:c8", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:13:33 +0000 UTC Type:0 Mac:52:54:00:f2:70:c8 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:ha-033260-m03 Clientid:01:52:54:00:f2:70:c8}

	I0930 11:13:49.488555   26946 main.go:141] libmachine: (ha-033260-m03) DBG | domain ha-033260-m03 has defined IP address 192.168.39.238 and MAC address 52:54:00:f2:70:c8 in network mk-ha-033260

	I0930 11:13:49.488791   26946 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0930 11:13:49.493484   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:13:49.506933   26946 mustload.go:65] Loading cluster: ha-033260

	I0930 11:13:49.507212   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:13:49.507471   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:49.507506   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:49.522665   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36191

	I0930 11:13:49.523038   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:49.523529   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:49.523558   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:49.523847   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:49.524064   26946 main.go:141] libmachine: (ha-033260) Calling .GetState

	I0930 11:13:49.525464   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:13:49.525875   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:49.525916   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:49.540657   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45857

	I0930 11:13:49.541129   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:49.541659   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:49.541680   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:49.541991   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:49.542172   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:13:49.542336   26946 certs.go:68] Setting up /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260 for IP: 192.168.39.238

	I0930 11:13:49.542347   26946 certs.go:194] generating shared ca certs ...

	I0930 11:13:49.542362   26946 certs.go:226] acquiring lock for ca certs: {Name:mk6e8575843c22b815a3b102bdc4a520434e3b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:13:49.542476   26946 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key

	I0930 11:13:49.542515   26946 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key

	I0930 11:13:49.542525   26946 certs.go:256] generating profile certs ...

	I0930 11:13:49.542591   26946 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key

	I0930 11:13:49.542615   26946 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37

	I0930 11:13:49.542628   26946 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.249 192.168.39.3 192.168.39.238 192.168.39.254]

	I0930 11:13:49.661476   26946 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37 ...

	I0930 11:13:49.661515   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37: {Name:mk149c204bf31f855e781b37ed00d2d45943dc74 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:13:49.661762   26946 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37 ...

	I0930 11:13:49.661785   26946 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37: {Name:mka1c6759c2661bfc3ab07f3168b7da60e9fc340 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0930 11:13:49.661922   26946 certs.go:381] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt.93938a37 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt

	I0930 11:13:49.662094   26946 certs.go:385] copying /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key.93938a37 -> /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key

	I0930 11:13:49.662275   26946 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key

	I0930 11:13:49.662294   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0930 11:13:49.662313   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0930 11:13:49.662333   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0930 11:13:49.662351   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0930 11:13:49.662368   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0930 11:13:49.662384   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0930 11:13:49.662452   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0930 11:13:49.677713   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0930 11:13:49.677801   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem (1338 bytes)

	W0930 11:13:49.677835   26946 certs.go:480] ignoring /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009_empty.pem, impossibly tiny 0 bytes

	I0930 11:13:49.677845   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca-key.pem (1679 bytes)

	I0930 11:13:49.677866   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/ca.pem (1082 bytes)

	I0930 11:13:49.677888   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/cert.pem (1123 bytes)

	I0930 11:13:49.677908   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/key.pem (1679 bytes)

	I0930 11:13:49.677944   26946 certs.go:484] found cert: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem (1708 bytes)

	I0930 11:13:49.677971   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem -> /usr/share/ca-certificates/11009.pem

	I0930 11:13:49.677983   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem -> /usr/share/ca-certificates/110092.pem

	I0930 11:13:49.677997   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:49.678030   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:13:49.681296   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:49.681887   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:13:49.681920   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:49.682144   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:13:49.682365   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:13:49.682543   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:13:49.682691   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:13:49.766051   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I0930 11:13:49.771499   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0930 11:13:49.783878   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I0930 11:13:49.789403   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0930 11:13:49.801027   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I0930 11:13:49.806774   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0930 11:13:49.824334   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I0930 11:13:49.828617   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I0930 11:13:49.838958   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I0930 11:13:49.843225   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0930 11:13:49.853655   26946 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I0930 11:13:49.857681   26946 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0930 11:13:49.869752   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0930 11:13:49.897794   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0930 11:13:49.925363   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0930 11:13:49.951437   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0930 11:13:49.978863   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0930 11:13:50.005498   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0930 11:13:50.030426   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0930 11:13:50.055825   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0930 11:13:50.080625   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/certs/11009.pem --> /usr/share/ca-certificates/11009.pem (1338 bytes)

	I0930 11:13:50.113315   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/files/etc/ssl/certs/110092.pem --> /usr/share/ca-certificates/110092.pem (1708 bytes)

	I0930 11:13:50.142931   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0930 11:13:50.168186   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0930 11:13:50.185792   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0930 11:13:50.203667   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0930 11:13:50.222202   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I0930 11:13:50.241795   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0930 11:13:50.260704   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0930 11:13:50.278865   26946 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0930 11:13:50.296763   26946 ssh_runner.go:195] Run: openssl version

	I0930 11:13:50.303234   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0930 11:13:50.314412   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:50.319228   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 30 10:21 /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:50.319276   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0930 11:13:50.325090   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0930 11:13:50.337510   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009.pem && ln -fs /usr/share/ca-certificates/11009.pem /etc/ssl/certs/11009.pem"

	I0930 11:13:50.351103   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009.pem

	I0930 11:13:50.356273   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 30 11:01 /usr/share/ca-certificates/11009.pem

	I0930 11:13:50.356331   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009.pem

	I0930 11:13:50.362227   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11009.pem /etc/ssl/certs/51391683.0"

	I0930 11:13:50.373066   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110092.pem && ln -fs /usr/share/ca-certificates/110092.pem /etc/ssl/certs/110092.pem"

	I0930 11:13:50.384243   26946 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110092.pem

	I0930 11:13:50.388958   26946 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 30 11:01 /usr/share/ca-certificates/110092.pem

	I0930 11:13:50.389012   26946 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110092.pem

	I0930 11:13:50.394820   26946 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110092.pem /etc/ssl/certs/3ec20f2e.0"

	I0930 11:13:50.406295   26946 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0930 11:13:50.410622   26946 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0930 11:13:50.410674   26946 kubeadm.go:934] updating node {m03 192.168.39.238 8443 v1.31.1 crio true true} ...

	I0930 11:13:50.410806   26946 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-033260-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.238

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0930 11:13:50.410833   26946 kube-vip.go:115] generating kube-vip config ...

	I0930 11:13:50.410873   26946 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0930 11:13:50.426800   26946 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0930 11:13:50.426870   26946 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0930 11:13:50.426931   26946 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0930 11:13:50.437767   26946 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.1: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.1': No such file or directory

	Initiating transfer...

	I0930 11:13:50.437827   26946 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.1

	I0930 11:13:50.448545   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubelet.sha256

	I0930 11:13:50.448565   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubeadm.sha256

	I0930 11:13:50.448591   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm -> /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:13:50.448597   26946 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.1/bin/linux/amd64/kubectl.sha256

	I0930 11:13:50.448619   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl -> /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:13:50.448655   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm

	I0930 11:13:50.448668   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl

	I0930 11:13:50.448599   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:13:50.460142   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubeadm': No such file or directory

	I0930 11:13:50.460178   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubeadm --> /var/lib/minikube/binaries/v1.31.1/kubeadm (58290328 bytes)

	I0930 11:13:50.460491   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubectl': No such file or directory

	I0930 11:13:50.460521   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubectl --> /var/lib/minikube/binaries/v1.31.1/kubectl (56381592 bytes)

	I0930 11:13:50.475258   26946 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet -> /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:13:50.475370   26946 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet

	I0930 11:13:50.603685   26946 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.1/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.1/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.1/kubelet': No such file or directory

	I0930 11:13:50.603734   26946 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19734-3842/.minikube/cache/linux/amd64/v1.31.1/kubelet --> /var/lib/minikube/binaries/v1.31.1/kubelet (76869944 bytes)

	I0930 11:13:51.331864   26946 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0930 11:13:51.343111   26946 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0930 11:13:51.361905   26946 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0930 11:13:51.380114   26946 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0930 11:13:51.398229   26946 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0930 11:13:51.402565   26946 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0930 11:13:51.414789   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:13:51.547939   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:13:51.568598   26946 host.go:66] Checking if "ha-033260" exists ...

	I0930 11:13:51.569032   26946 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0930 11:13:51.569117   26946 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0930 11:13:51.584541   26946 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45637

	I0930 11:13:51.585019   26946 main.go:141] libmachine: () Calling .GetVersion

	I0930 11:13:51.585485   26946 main.go:141] libmachine: Using API Version  1

	I0930 11:13:51.585506   26946 main.go:141] libmachine: () Calling .SetConfigRaw

	I0930 11:13:51.585824   26946 main.go:141] libmachine: () Calling .GetMachineName

	I0930 11:13:51.586011   26946 main.go:141] libmachine: (ha-033260) Calling .DriverName

	I0930 11:13:51.586156   26946 start.go:317] joinCluster: &{Name:ha-033260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 Cluster

Name:ha-033260 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.249 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.3 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.238 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:fal

se istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false D

isableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0930 11:13:51.586275   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0930 11:13:51.586294   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHHostname

	I0930 11:13:51.589730   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:51.590160   26946 main.go:141] libmachine: (ha-033260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b0:2e:07", ip: ""} in network mk-ha-033260: {Iface:virbr1 ExpiryTime:2024-09-30 12:11:31 +0000 UTC Type:0 Mac:52:54:00:b0:2e:07 Iaid: IPaddr:192.168.39.249 Prefix:24 Hostname:ha-033260 Clientid:01:52:54:00:b0:2e:07}

	I0930 11:13:51.590189   26946 main.go:141] libmachine: (ha-033260) DBG | domain ha-033260 has defined IP address 192.168.39.249 and MAC address 52:54:00:b0:2e:07 in network mk-ha-033260

	I0930 11:13:51.590326   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHPort

	I0930 11:13:51.590673   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHKeyPath

	I0930 11:13:51.590813   26946 main.go:141] libmachine: (ha-033260) Calling .GetSSHUsername

	I0930 11:13:51.590943   26946 sshutil.go:53] new ssh client: &{IP:192.168.39.249 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19734-3842/.minikube/machines/ha-033260/id_rsa Username:docker}

	I0930 11:13:51.742155   26946 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.238 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:13:51.742217   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token ve4s5e.z27uafhrt4vwx76f --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m03 --control-plane --apiserver-advertise-address=192.168.39.238 --apiserver-bind-port=8443"

	I0930 11:14:14.534669   26946 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token ve4s5e.z27uafhrt4vwx76f --discovery-token-ca-cert-hash sha256:cd44e8fdd740c8f48e1465c61d0873a6e2887c60a128a2d513ee0addae94f8a2 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-033260-m03 --control-plane --apiserver-advertise-address=192.168.39.238 --apiserver-bind-port=8443": (22.792425292s)

	I0930 11:14:14.534703   26946 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0930 11:14:15.090933   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-033260-m03 minikube.k8s.io/updated_at=2024_09_30T11_14_15_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128 minikube.k8s.io/name=ha-033260 minikube.k8s.io/primary=false

	I0930 11:14:15.217971   26946 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-033260-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0930 11:14:15.356327   26946 start.go:319] duration metric: took 23.770167838s to joinCluster

	I0930 11:14:15.356406   26946 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.238 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0930 11:14:15.356782   26946 config.go:182] Loaded profile config "ha-033260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1

	I0930 11:14:15.358117   26946 out.go:177] * Verifying Kubernetes components...

	I0930 11:14:15.359571   26946 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0930 11:14:15.622789   26946 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0930 11:14:15.640897   26946 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19734-3842/kubeconfig

	I0930 11:14:15.641233   26946 kapi.go:59] client config for ha-033260: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.crt", KeyFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/profiles/ha-033260/client.key", CAFile:"/home/jenkins/minikube-integration/19734-3842/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1f685c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0930 11:14:15.641327   26946 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.249:8443

	I0930 11:14:15.641657   26946 node_ready.go:35] waiting up to 6m0s for node "ha-033260-m03" to be "Ready" ...

	I0930 11:14:15.641759   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:15.641771   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:15.641783   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:15.641790   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:15.644778   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:14:16.142790   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:16.142817   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:16.142829   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:16.142842   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:16.146568   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:16.642107   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:16.642131   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:16.642142   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:16.642147   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:16.648466   26946 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0930 11:14:17.142339   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:17.142362   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:17.142375   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:17.142381   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:17.146498   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:17.642900   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:17.642921   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:17.642930   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:17.642934   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:17.646792   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:17.647749   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:18.141856   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:18.141880   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:18.141889   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:18.141893   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:18.145059   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:18.641848   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:18.641883   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:18.641896   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:18.641905   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:18.645609   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:19.142000   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:19.142030   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:19.142041   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:19.142046   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:19.146124   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:19.642709   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:19.642734   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:19.642746   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:19.642751   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:19.647278   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:19.648375   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:20.142851   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:20.142871   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:20.142879   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:20.142883   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:20.146328   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:20.642913   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:20.642940   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:20.642954   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:20.642961   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:20.653974   26946 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0930 11:14:21.142909   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:21.142931   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:21.142942   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:21.142954   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:21.146862   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:21.642348   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:21.642373   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:21.642383   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:21.642388   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:21.647699   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:14:22.142178   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:22.142198   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:22.142206   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:22.142210   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:22.145760   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:22.146824   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:22.642895   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:22.642917   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:22.642925   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:22.642931   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:22.648085   26946 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0930 11:14:23.141847   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:23.141872   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:23.141883   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:23.141888   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:23.149699   26946 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0930 11:14:23.641992   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:23.642013   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:23.642023   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:23.642029   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:23.645640   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:24.142073   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:24.142096   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:24.142104   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:24.142108   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:24.146322   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:24.146891   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:24.642695   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:24.642716   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:24.642724   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:24.642731   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:24.646216   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:25.142500   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:25.142538   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:25.142546   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:25.142552   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:25.146687   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:25.642542   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:25.642566   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:25.642573   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:25.642577   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:25.646661   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:26.142499   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:26.142535   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:26.142545   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:26.142552   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:26.146202   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:26.147018   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:26.642712   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:26.642739   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:26.642751   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:26.642756   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:26.646338   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:27.142246   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:27.142276   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:27.142286   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:27.142292   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:27.146473   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:27.642325   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:27.642347   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:27.642355   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:27.642359   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:27.646109   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:28.142885   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:28.142912   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:28.142923   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:28.142929   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:28.146499   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:28.147250   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:28.642625   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:28.642652   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:28.642663   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:28.642669   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:28.646618   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:29.142391   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:29.142412   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:29.142420   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:29.142424   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:29.146320   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:29.642615   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:29.642640   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:29.642649   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:29.642653   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:29.646130   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:30.142916   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:30.142938   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:30.142947   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:30.142951   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:30.146109   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:30.642863   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:30.642885   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:30.642893   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:30.642897   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:30.646458   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:30.647204   26946 node_ready.go:53] node "ha-033260-m03" has status "Ready":"False"

	I0930 11:14:31.142601   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:31.142623   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.142631   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.142635   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.146623   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.642077   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:31.642103   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.642114   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.642119   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.645322   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.645964   26946 node_ready.go:49] node "ha-033260-m03" has status "Ready":"True"

	I0930 11:14:31.645987   26946 node_ready.go:38] duration metric: took 16.004306964s for node "ha-033260-m03" to be "Ready" ...

	I0930 11:14:31.645997   26946 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:14:31.646075   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:31.646090   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.646099   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.646106   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.653396   26946 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0930 11:14:31.663320   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.663400   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-5frmm

	I0930 11:14:31.663405   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.663412   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.663420   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.666829   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.667522   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:31.667537   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.667544   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.667550   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.670668   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.671278   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.671301   26946 pod_ready.go:82] duration metric: took 7.951059ms for pod "coredns-7c65d6cfc9-5frmm" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.671309   26946 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.671362   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-kt87v

	I0930 11:14:31.671369   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.671376   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.671383   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.674317   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:14:31.675093   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:31.675107   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.675114   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.675120   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.678167   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.678702   26946 pod_ready.go:93] pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.678717   26946 pod_ready.go:82] duration metric: took 7.402263ms for pod "coredns-7c65d6cfc9-kt87v" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.678725   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.678775   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260

	I0930 11:14:31.678782   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.678789   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.678794   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.682042   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.683033   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:31.683050   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.683060   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.683067   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.686124   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.686928   26946 pod_ready.go:93] pod "etcd-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.686944   26946 pod_ready.go:82] duration metric: took 8.212366ms for pod "etcd-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.686951   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.687047   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m02

	I0930 11:14:31.687059   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.687068   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.687077   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.690190   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:31.690825   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:31.690840   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.690850   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.690858   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.693597   26946 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0930 11:14:31.694016   26946 pod_ready.go:93] pod "etcd-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:31.694032   26946 pod_ready.go:82] duration metric: took 7.073598ms for pod "etcd-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.694050   26946 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:31.842476   26946 request.go:632] Waited for 148.347924ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m03

	I0930 11:14:31.842535   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/etcd-ha-033260-m03

	I0930 11:14:31.842540   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:31.842547   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:31.842551   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:31.846779   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:32.042378   26946 request.go:632] Waited for 194.977116ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:32.042433   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:32.042441   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.042451   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.042460   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.046938   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:32.047883   26946 pod_ready.go:93] pod "etcd-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:32.047901   26946 pod_ready.go:82] duration metric: took 353.843104ms for pod "etcd-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.047915   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.242541   26946 request.go:632] Waited for 194.549595ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:14:32.242605   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260

	I0930 11:14:32.242614   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.242625   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.242634   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.246270   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.443112   26946 request.go:632] Waited for 196.194005ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:32.443180   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:32.443188   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.443196   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.443204   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.446839   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.447484   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:32.447503   26946 pod_ready.go:82] duration metric: took 399.580784ms for pod "kube-apiserver-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.447514   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.642591   26946 request.go:632] Waited for 194.994624ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:14:32.642658   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m02

	I0930 11:14:32.642663   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.642670   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.642674   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.646484   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.842626   26946 request.go:632] Waited for 195.406068ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:32.842682   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:32.842700   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:32.842723   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:32.842729   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:32.846693   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:32.847589   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:32.847611   26946 pod_ready.go:82] duration metric: took 400.088499ms for pod "kube-apiserver-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:32.847622   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.042743   26946 request.go:632] Waited for 195.040991ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m03

	I0930 11:14:33.042794   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-033260-m03

	I0930 11:14:33.042810   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.042822   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.042831   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.047437   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:33.242766   26946 request.go:632] Waited for 194.350243ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:33.242826   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:33.242831   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.242838   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.242842   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.246530   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:33.247420   26946 pod_ready.go:93] pod "kube-apiserver-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:33.247442   26946 pod_ready.go:82] duration metric: took 399.811844ms for pod "kube-apiserver-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.247458   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.442488   26946 request.go:632] Waited for 194.945176ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:14:33.442539   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260

	I0930 11:14:33.442545   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.442552   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.442555   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.446162   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:33.642540   26946 request.go:632] Waited for 195.369281ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:33.642603   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:33.642609   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.642615   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.642620   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.646221   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:33.646635   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:33.646655   26946 pod_ready.go:82] duration metric: took 399.188776ms for pod "kube-controller-manager-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.646667   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:33.843125   26946 request.go:632] Waited for 196.391494ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:14:33.843216   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m02

	I0930 11:14:33.843227   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:33.843238   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:33.843244   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:33.846706   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.042579   26946 request.go:632] Waited for 195.024865ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.042680   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.042689   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.042697   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.042701   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.046091   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.046788   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:34.046810   26946 pod_ready.go:82] duration metric: took 400.13538ms for pod "kube-controller-manager-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.046823   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.242282   26946 request.go:632] Waited for 195.389369ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m03

	I0930 11:14:34.242349   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-033260-m03

	I0930 11:14:34.242356   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.242365   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.242370   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.246179   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.442166   26946 request.go:632] Waited for 195.280581ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:34.442224   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:34.442230   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.442237   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.442240   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.445326   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.445954   26946 pod_ready.go:93] pod "kube-controller-manager-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:34.445978   26946 pod_ready.go:82] duration metric: took 399.145783ms for pod "kube-controller-manager-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.445991   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.643049   26946 request.go:632] Waited for 196.981464ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:14:34.643124   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fckwn

	I0930 11:14:34.643131   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.643141   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.643148   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.647040   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.843108   26946 request.go:632] Waited for 195.398341ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.843190   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:34.843212   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:34.843227   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:34.843238   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:34.846825   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:34.847411   26946 pod_ready.go:93] pod "kube-proxy-fckwn" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:34.847432   26946 pod_ready.go:82] duration metric: took 401.432801ms for pod "kube-proxy-fckwn" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:34.847445   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fctld" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.043014   26946 request.go:632] Waited for 195.507309ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fctld

	I0930 11:14:35.043093   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-fctld

	I0930 11:14:35.043102   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.043109   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.043117   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.046836   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.242781   26946 request.go:632] Waited for 195.218665ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:35.242851   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:35.242856   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.242862   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.242866   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.246468   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.247353   26946 pod_ready.go:93] pod "kube-proxy-fctld" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:35.247380   26946 pod_ready.go:82] duration metric: took 399.923772ms for pod "kube-proxy-fctld" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.247393   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.442345   26946 request.go:632] Waited for 194.883869ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:14:35.442516   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-proxy-mxvxr

	I0930 11:14:35.442529   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.442541   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.442550   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.446031   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.642937   26946 request.go:632] Waited for 196.342972ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:35.642985   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:35.642990   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.642997   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.643001   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.646624   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:35.647369   26946 pod_ready.go:93] pod "kube-proxy-mxvxr" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:35.647389   26946 pod_ready.go:82] duration metric: took 399.989175ms for pod "kube-proxy-mxvxr" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.647398   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:35.842485   26946 request.go:632] Waited for 195.020246ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:14:35.842575   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260

	I0930 11:14:35.842586   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:35.842597   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:35.842605   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:35.845997   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.043063   26946 request.go:632] Waited for 196.343615ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:36.043113   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260

	I0930 11:14:36.043119   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.043125   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.043131   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.046327   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.046783   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:36.046799   26946 pod_ready.go:82] duration metric: took 399.395226ms for pod "kube-scheduler-ha-033260" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.046810   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.242936   26946 request.go:632] Waited for 196.062784ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:14:36.243003   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m02

	I0930 11:14:36.243024   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.243037   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.243046   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.246888   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.442803   26946 request.go:632] Waited for 195.27104ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:36.442859   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m02

	I0930 11:14:36.442867   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.442877   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.442888   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.446304   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.446972   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:36.447001   26946 pod_ready.go:82] duration metric: took 400.183775ms for pod "kube-scheduler-ha-033260-m02" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.447011   26946 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.642468   26946 request.go:632] Waited for 195.395201ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m03

	I0930 11:14:36.642532   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-033260-m03

	I0930 11:14:36.642538   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.642545   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.642549   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.646175   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.842841   26946 request.go:632] Waited for 195.970164ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:36.842911   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes/ha-033260-m03

	I0930 11:14:36.842924   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.842938   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.842946   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.846452   26946 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0930 11:14:36.847134   26946 pod_ready.go:93] pod "kube-scheduler-ha-033260-m03" in "kube-system" namespace has status "Ready":"True"

	I0930 11:14:36.847153   26946 pod_ready.go:82] duration metric: took 400.136505ms for pod "kube-scheduler-ha-033260-m03" in "kube-system" namespace to be "Ready" ...

	I0930 11:14:36.847163   26946 pod_ready.go:39] duration metric: took 5.201155018s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0930 11:14:36.847177   26946 api_server.go:52] waiting for apiserver process to appear ...

	I0930 11:14:36.847229   26946 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0930 11:14:36.869184   26946 api_server.go:72] duration metric: took 21.512734614s to wait for apiserver process to appear ...

	I0930 11:14:36.869210   26946 api_server.go:88] waiting for apiserver healthz status ...

	I0930 11:14:36.869231   26946 api_server.go:253] Checking apiserver healthz at https://192.168.39.249:8443/healthz ...

	I0930 11:14:36.875656   26946 api_server.go:279] https://192.168.39.249:8443/healthz returned 200:

	ok

	I0930 11:14:36.875723   26946 round_trippers.go:463] GET https://192.168.39.249:8443/version

	I0930 11:14:36.875730   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:36.875741   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:36.875751   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:36.876680   26946 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0930 11:14:36.876763   26946 api_server.go:141] control plane version: v1.31.1

	I0930 11:14:36.876785   26946 api_server.go:131] duration metric: took 7.567961ms to wait for apiserver health ...

	I0930 11:14:36.876795   26946 system_pods.go:43] waiting for kube-system pods to appear ...

	I0930 11:14:37.042474   26946 request.go:632] Waited for 165.583212ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.042549   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.042557   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.042568   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.042577   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.049247   26946 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0930 11:14:37.056036   26946 system_pods.go:59] 24 kube-system pods found

	I0930 11:14:37.056063   26946 system_pods.go:61] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:14:37.056069   26946 system_pods.go:61] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:14:37.056073   26946 system_pods.go:61] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:14:37.056076   26946 system_pods.go:61] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:14:37.056079   26946 system_pods.go:61] "etcd-ha-033260-m03" [69f89dd9-3421-46a4-a577-4d9fc1dc2f40] Running

	I0930 11:14:37.056082   26946 system_pods.go:61] "kindnet-4rpgw" [e9fd1809-f010-4725-ad29-7c7b4978a70f] Running

	I0930 11:14:37.056085   26946 system_pods.go:61] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:14:37.056088   26946 system_pods.go:61] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:14:37.056091   26946 system_pods.go:61] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:14:37.056094   26946 system_pods.go:61] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:14:37.056097   26946 system_pods.go:61] "kube-apiserver-ha-033260-m03" [24f2e5a6-8ccd-41a4-9881-b3326db38a78] Running

	I0930 11:14:37.056100   26946 system_pods.go:61] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:14:37.056105   26946 system_pods.go:61] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:14:37.056108   26946 system_pods.go:61] "kube-controller-manager-ha-033260-m03" [aff121d2-41f1-4a58-8d41-09ee2759e183] Running

	I0930 11:14:37.056111   26946 system_pods.go:61] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:14:37.056115   26946 system_pods.go:61] "kube-proxy-fctld" [6ebb84e4-ea77-42d4-8237-30564d82cc03] Running

	I0930 11:14:37.056120   26946 system_pods.go:61] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:14:37.056151   26946 system_pods.go:61] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:14:37.056164   26946 system_pods.go:61] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:14:37.056169   26946 system_pods.go:61] "kube-scheduler-ha-033260-m03" [30086d5f-5b9b-4e93-bc1e-dee878d5ec71] Running

	I0930 11:14:37.056177   26946 system_pods.go:61] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:14:37.056182   26946 system_pods.go:61] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:14:37.056189   26946 system_pods.go:61] "kube-vip-ha-033260-m03" [043e0bff-9099-41a1-98e5-d0f6c47a853d] Running

	I0930 11:14:37.056194   26946 system_pods.go:61] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:14:37.056204   26946 system_pods.go:74] duration metric: took 179.399341ms to wait for pod list to return data ...

	I0930 11:14:37.056216   26946 default_sa.go:34] waiting for default service account to be created ...

	I0930 11:14:37.242741   26946 request.go:632] Waited for 186.4192ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:14:37.242795   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/default/serviceaccounts

	I0930 11:14:37.242800   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.242807   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.242813   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.247153   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:37.247269   26946 default_sa.go:45] found service account: "default"

	I0930 11:14:37.247285   26946 default_sa.go:55] duration metric: took 191.060236ms for default service account to be created ...

	I0930 11:14:37.247292   26946 system_pods.go:116] waiting for k8s-apps to be running ...

	I0930 11:14:37.442756   26946 request.go:632] Waited for 195.39174ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.442830   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/namespaces/kube-system/pods

	I0930 11:14:37.442840   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.442850   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.442861   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.450094   26946 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0930 11:14:37.457440   26946 system_pods.go:86] 24 kube-system pods found

	I0930 11:14:37.457477   26946 system_pods.go:89] "coredns-7c65d6cfc9-5frmm" [7333717d-95d5-4990-bac9-8443a51eee97] Running

	I0930 11:14:37.457485   26946 system_pods.go:89] "coredns-7c65d6cfc9-kt87v" [26f75c31-d44d-4a4c-8048-b6ce5c824151] Running

	I0930 11:14:37.457491   26946 system_pods.go:89] "etcd-ha-033260" [d56638a1-acd7-4dec-ad8f-12df96339db5] Running

	I0930 11:14:37.457497   26946 system_pods.go:89] "etcd-ha-033260-m02" [8f01e472-f8ae-4ef6-8f1b-a318d77140e2] Running

	I0930 11:14:37.457506   26946 system_pods.go:89] "etcd-ha-033260-m03" [69f89dd9-3421-46a4-a577-4d9fc1dc2f40] Running

	I0930 11:14:37.457512   26946 system_pods.go:89] "kindnet-4rpgw" [e9fd1809-f010-4725-ad29-7c7b4978a70f] Running

	I0930 11:14:37.457518   26946 system_pods.go:89] "kindnet-752cm" [af6a4971-6c03-4800-8c93-72937bc9d2bd] Running

	I0930 11:14:37.457524   26946 system_pods.go:89] "kindnet-g94k6" [260e385d-9e17-4af8-a854-8683afb714c4] Running

	I0930 11:14:37.457530   26946 system_pods.go:89] "kube-apiserver-ha-033260" [bf23a120-d2fd-4446-9965-935832ad0587] Running

	I0930 11:14:37.457538   26946 system_pods.go:89] "kube-apiserver-ha-033260-m02" [cdc17419-96df-4112-8926-42e589cb7da5] Running

	I0930 11:14:37.457547   26946 system_pods.go:89] "kube-apiserver-ha-033260-m03" [24f2e5a6-8ccd-41a4-9881-b3326db38a78] Running

	I0930 11:14:37.457553   26946 system_pods.go:89] "kube-controller-manager-ha-033260" [0f751e4d-0adf-4425-81e9-723edcff472c] Running

	I0930 11:14:37.457562   26946 system_pods.go:89] "kube-controller-manager-ha-033260-m02" [0c485755-8aae-4287-b7f0-f4f51c5ffc29] Running

	I0930 11:14:37.457569   26946 system_pods.go:89] "kube-controller-manager-ha-033260-m03" [aff121d2-41f1-4a58-8d41-09ee2759e183] Running

	I0930 11:14:37.457575   26946 system_pods.go:89] "kube-proxy-fckwn" [784e8104-d913-476f-b1c3-9fb91d7e4c88] Running

	I0930 11:14:37.457584   26946 system_pods.go:89] "kube-proxy-fctld" [6ebb84e4-ea77-42d4-8237-30564d82cc03] Running

	I0930 11:14:37.457590   26946 system_pods.go:89] "kube-proxy-mxvxr" [314da0b5-6242-4af0-8e99-d0aaba82a43e] Running

	I0930 11:14:37.457597   26946 system_pods.go:89] "kube-scheduler-ha-033260" [37cc3312-1d25-4ee0-b6d2-1e0dbfdd4e16] Running

	I0930 11:14:37.457603   26946 system_pods.go:89] "kube-scheduler-ha-033260-m02" [0518eff4-61a1-4d11-9544-179c5e77b655] Running

	I0930 11:14:37.457612   26946 system_pods.go:89] "kube-scheduler-ha-033260-m03" [30086d5f-5b9b-4e93-bc1e-dee878d5ec71] Running

	I0930 11:14:37.457630   26946 system_pods.go:89] "kube-vip-ha-033260" [544867fe-5f73-4613-ab03-f0a8f8ce64e2] Running

	I0930 11:14:37.457637   26946 system_pods.go:89] "kube-vip-ha-033260-m02" [6183d51d-d0b5-456a-9e46-abc6f30dd012] Running

	I0930 11:14:37.457643   26946 system_pods.go:89] "kube-vip-ha-033260-m03" [043e0bff-9099-41a1-98e5-d0f6c47a853d] Running

	I0930 11:14:37.457648   26946 system_pods.go:89] "storage-provisioner" [964381ab-f2ac-4361-a7e0-5212fff5e26e] Running

	I0930 11:14:37.457657   26946 system_pods.go:126] duration metric: took 210.359061ms to wait for k8s-apps to be running ...

	I0930 11:14:37.457669   26946 system_svc.go:44] waiting for kubelet service to be running ....

	I0930 11:14:37.457721   26946 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0930 11:14:37.476929   26946 system_svc.go:56] duration metric: took 19.252575ms WaitForService to wait for kubelet

	I0930 11:14:37.476958   26946 kubeadm.go:582] duration metric: took 22.120515994s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0930 11:14:37.476982   26946 node_conditions.go:102] verifying NodePressure condition ...

	I0930 11:14:37.642377   26946 request.go:632] Waited for 165.309074ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.249:8443/api/v1/nodes

	I0930 11:14:37.642424   26946 round_trippers.go:463] GET https://192.168.39.249:8443/api/v1/nodes

	I0930 11:14:37.642429   26946 round_trippers.go:469] Request Headers:

	I0930 11:14:37.642438   26946 round_trippers.go:473]     Accept: application/json, */*

	I0930 11:14:37.642449   26946 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0930 11:14:37.646747   26946 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0930 11:14:37.647864   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:14:37.647885   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:14:37.647896   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:14:37.647900   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:14:37.647904   26946 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0930 11:14:37.647908   26946 node_conditions.go:123] node cpu capacity is 2

	I0930 11:14:37.647912   26946 node_conditions.go:105] duration metric: took 170.925329ms to run NodePressure ...

	I0930 11:14:37.647922   26946 start.go:241] waiting for startup goroutines ...

	I0930 11:14:37.647945   26946 start.go:255] writing updated cluster config ...

	I0930 11:14:37.648212   26946 ssh_runner.go:195] Run: rm -f paused

	I0930 11:14:37.699426   26946 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)

	I0930 11:14:37.701518   26946 out.go:177] * Done! kubectl is now configured to use "ha-033260" cluster and "default" namespace by default

	==> CRI-O <==

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.351740523Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=654d8294-2d2b-467d-9ba7-d0ff5f661ba9 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.353538027Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=ffe6ee2a-ddb5-4e73-95d3-feb8e29b4a96 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.354006439Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695101353980568,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=ffe6ee2a-ddb5-4e73-95d3-feb8e29b4a96 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.354796259Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=3f0e2775-0ace-48de-bd98-cf864d6706b6 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.354871266Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3f0e2775-0ace-48de-bd98-cf864d6706b6 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.355098840Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3f0e2775-0ace-48de-bd98-cf864d6706b6 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.402215745Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=664eafb2-fb09-42fb-bd62-71cb9723c633 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.402949005Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=664eafb2-fb09-42fb-bd62-71cb9723c633 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.404851190Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=1c25174a-eb49-438d-b2bd-dfbce550cb2a name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.405395332Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695101405369137,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=1c25174a-eb49-438d-b2bd-dfbce550cb2a name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.406333121Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=859a3efb-197c-46f3-8793-b501459e7be9 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.406406101Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=859a3efb-197c-46f3-8793-b501459e7be9 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.406700321Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=859a3efb-197c-46f3-8793-b501459e7be9 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.443841665Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=2a5ef37d-fcf9-4237-8e44-86a247488570 name=/runtime.v1.RuntimeService/ListPodSandbox

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.444092538Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&PodSandboxMetadata{Name:busybox-7dff88458-nbhwc,Uid:e62e1e44-3723-496c-85a3-7a79e9c8264b,Namespace:default,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694878999607270,Labels:map[string]string{app: busybox,io.kubernetes.container.name: POD,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,pod-template-hash: 7dff88458,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-09-30T11:14:38.675928095Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&PodSandboxMetadata{Name:coredns-7c65d6cfc9-5frmm,Uid:7333717d-95d5-4990-bac9-8443a51eee97,Namespace:kube-system,Attempt:0,},State:S

ANDBOX_READY,CreatedAt:1727694738389437732,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95d5-4990-bac9-8443a51eee97,k8s-app: kube-dns,pod-template-hash: 7c65d6cfc9,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-09-30T11:12:18.075315913Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:964381ab-f2ac-4361-a7e0-5212fff5e26e,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694738388233227,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{kubec

tl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-09-30T11:12:18.074715472Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&PodSandboxMetadata{Name:coredns-7c65d6cfc9-kt87v,Uid:26f75c31-d44d-4a4c-8048-b6ce5c824151,Namespace:kube-system,Atte

mpt:0,},State:SANDBOX_READY,CreatedAt:1727694738374333861,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,k8s-app: kube-dns,pod-template-hash: 7c65d6cfc9,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-09-30T11:12:18.066691994Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&PodSandboxMetadata{Name:kube-proxy-mxvxr,Uid:314da0b5-6242-4af0-8e99-d0aaba82a43e,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694726485116537,Labels:map[string]string{controller-revision-hash: 648b489c5b,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]

string{kubernetes.io/config.seen: 2024-09-30T11:12:04.378056083Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&PodSandboxMetadata{Name:kindnet-g94k6,Uid:260e385d-9e17-4af8-a854-8683afb714c4,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694726174379745,Labels:map[string]string{app: kindnet,controller-revision-hash: 65cbdfc95f,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,k8s-app: kindnet,pod-template-generation: 1,tier: node,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-09-30T11:12:04.361135889Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-ha-033260,Uid:43955f8cf95999657a88952585c93768,Namespace:kube-system,

Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694713030111436,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 43955f8cf95999657a88952585c93768,kubernetes.io/config.seen: 2024-09-30T11:11:52.558361791Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&PodSandboxMetadata{Name:kube-vip-ha-033260,Uid:bc91a2a25badfe2ca88893e1f6ac643a,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694713027013730,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{kube

rnetes.io/config.hash: bc91a2a25badfe2ca88893e1f6ac643a,kubernetes.io/config.seen: 2024-09-30T11:11:52.558364200Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&PodSandboxMetadata{Name:kube-apiserver-ha-033260,Uid:6c1732ebd63e52d0c6ac6d9cd648cff5,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694713022237134,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.249:8443,kubernetes.io/config.hash: 6c1732ebd63e52d0c6ac6d9cd648cff5,kubernetes.io/config.seen: 2024-09-30T11:11:52.558360466Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3

941a9c701561b0d3d113ef8,Metadata:&PodSandboxMetadata{Name:kube-scheduler-ha-033260,Uid:734999721cb3f48c24354599fcaf3db2,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694713020603401,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 734999721cb3f48c24354599fcaf3db2,kubernetes.io/config.seen: 2024-09-30T11:11:52.558362997Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&PodSandboxMetadata{Name:etcd-ha-033260,Uid:4ee6f0cb154890b5d1bf6173256957d4,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1727694713017992899,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-ha-033260,i

o.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.249:2379,kubernetes.io/config.hash: 4ee6f0cb154890b5d1bf6173256957d4,kubernetes.io/config.seen: 2024-09-30T11:11:52.558355509Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="otel-collector/interceptors.go:74" id=2a5ef37d-fcf9-4237-8e44-86a247488570 name=/runtime.v1.RuntimeService/ListPodSandbox

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.444808077Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:&ContainerStateValue{State:CONTAINER_RUNNING,},PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=f2c0908a-09ff-47e4-9a05-84ff4d21ff1a name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.444866724Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=f2c0908a-09ff-47e4-9a05-84ff4d21ff1a name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.445146992Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=f2c0908a-09ff-47e4-9a05-84ff4d21ff1a name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.450328327Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=f4b72448-bf0a-41b9-97ac-84aa0dc16020 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.450393391Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=f4b72448-bf0a-41b9-97ac-84aa0dc16020 name=/runtime.v1.RuntimeService/Version

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.452165790Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=ae4bbdcb-1132-495e-9659-2bd7d5864af9 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.452569286Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695101452546894,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=ae4bbdcb-1132-495e-9659-2bd7d5864af9 name=/runtime.v1.ImageService/ImageFsInfo

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.453137394Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=a099b8f2-e630-45f7-9dff-b2f487c5ce07 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.453206399Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=a099b8f2-e630-45f7-9dff-b2f487c5ce07 name=/runtime.v1.RuntimeService/ListContainers

	Sep 30 11:18:21 ha-033260 crio[660]: time="2024-09-30 11:18:21.453457550Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:970aed3b1f96bb97e72898cd783225ac0006aebe6f054dd28143f597e8ea86a0,PodSandboxId:e5a4e140afd6ad949b07014c6b859f1ea789a97d9dade260abb5ed29f0fe7b50,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1727694880474406078,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-nbhwc,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e62e1e44-3723-496c-85a3-7a79e9c8264b,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0,PodSandboxId:ee2a6eb69b10a669fc5cb46da152a0f46e479a701be48d5b4fc93794c488bf00,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738700499783,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-kt87v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 26f75c31-d44d-4a4c-8048-b6ce5c824151,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f612e29e1b4eb533d1a232015bb5469c9324bbc7708670d4d8dd51b5a3607245,PodSandboxId:571ace347c86dd46d00d874681f602b39855eeddbadcef9282df123361d4bead,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1727694738655314464,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: 964381ab-f2ac-4361-a7e0-5212fff5e26e,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7,PodSandboxId:724d02dce7a0d8d3302d91b914313f6170fad7bb463f35a89efbc2d45ea83743,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1727694738606901190,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-5frmm,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7333717d-95

d5-4990-bac9-8443a51eee97,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346,PodSandboxId:b2990036962da9c3b67fe8a8e6276369a8c485498aa25e0a3f2b2162e2dbc3a0,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f,State:CONTAINER_RUNNING,CreatedAt:17276947

26647937132,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-g94k6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 260e385d-9e17-4af8-a854-8683afb714c4,},Annotations:map[string]string{io.kubernetes.container.hash: e80daca3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c,PodSandboxId:b08b772dab41d0de4aecc929afc68796f20ba155acf12d5995ad1312e342f984,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561,State:CONTAINER_RUNNING,CreatedAt:1727694726649930334,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-mxvxr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 314da0b5-6242-4af0-8e99-d0aaba82a43e,},Annotations:map[string]string{io.kubernetes.container.hash: 159dcc59,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7a9e01197e5c6b93ad407fd55a87997ad971da8f01b419f28afe151cb9b7dfee,PodSandboxId:2bd722c6afa6367f145f4ebdb6423ebed6288d2086382e9274c56212f86c24b5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1727694715828520149,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bc91a2a25badfe2ca88893e1f6ac643a,},Annotations:map[string]string{io.kubernetes.container.hash: 3123ec07,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8,PodSandboxId:f789f882a4d3cf2a06f794fdbbf602769321846425b0200641d34768019ad655,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1727694713376562110,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4ee6f0cb154890b5d1bf6173256957d4,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489,PodSandboxId:6bdfa517065574a1ed07663d90754c844f217f9666ba7d8956d982f55232ddab,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1,State:CONTAINER_RUNNING,CreatedAt:1727694713329220180,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.nam

e: kube-controller-manager-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 43955f8cf95999657a88952585c93768,},Annotations:map[string]string{io.kubernetes.container.hash: d1900d79,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2,PodSandboxId:fd27dbf29ee9b8b28ca29c668a35a6290fc7fe7c3941a9c701561b0d3d113ef8,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b,State:CONTAINER_RUNNING,CreatedAt:1727694713298021814,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-sche

duler-ha-033260,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 734999721cb3f48c24354599fcaf3db2,},Annotations:map[string]string{io.kubernetes.container.hash: 12faacf7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac,PodSandboxId:676d3fbaf3e6fcd911b9ae81364c8a5bf71bb8d8bc40e253e71a7eaca6a0ec90,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee,State:CONTAINER_RUNNING,CreatedAt:1727694713207263431,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-033260,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6c1732ebd63e52d0c6ac6d9cd648cff5,},Annotations:map[string]string{io.kubernetes.container.hash: 7df2713b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=a099b8f2-e630-45f7-9dff-b2f487c5ce07 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	970aed3b1f96b       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   e5a4e140afd6a       busybox-7dff88458-nbhwc

	856f46390ed07       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      6 minutes ago       Running             coredns                   0                   ee2a6eb69b10a       coredns-7c65d6cfc9-kt87v

	f612e29e1b4eb       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      6 minutes ago       Running             storage-provisioner       0                   571ace347c86d       storage-provisioner

	2aac013f37bf9       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      6 minutes ago       Running             coredns                   0                   724d02dce7a0d       coredns-7c65d6cfc9-5frmm

	347597ebf9b20       60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561                                      6 minutes ago       Running             kube-proxy                0                   b08b772dab41d       kube-proxy-mxvxr

	6cf899810e161       12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f                                      6 minutes ago       Running             kindnet-cni               0                   b2990036962da       kindnet-g94k6

	7a9e01197e5c6       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     6 minutes ago       Running             kube-vip                  0                   2bd722c6afa63       kube-vip-ha-033260

	aa8ecc81d0af2       2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4                                      6 minutes ago       Running             etcd                      0                   f789f882a4d3c       etcd-ha-033260

	e62c0a6cc031f       175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1                                      6 minutes ago       Running             kube-controller-manager   0                   6bdfa51706557       kube-controller-manager-ha-033260

	2435a21a0f6f8       9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b                                      6 minutes ago       Running             kube-scheduler            0                   fd27dbf29ee9b       kube-scheduler-ha-033260

	cd2027f0a04e1       6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee                                      6 minutes ago       Running             kube-apiserver            0                   676d3fbaf3e6f       kube-apiserver-ha-033260

	==> coredns [2aac013f37bf973feaaafcbd51d773e3d3ff3a344806e961369cd9a2982d61b7] <==

	[INFO] 10.244.1.2:53856 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00078279s

	[INFO] 10.244.0.4:40457 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001984462s

	[INFO] 10.244.2.2:53822 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 31 0.006986108s

	[INFO] 10.244.2.2:56668 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001677174s

	[INFO] 10.244.1.2:39538 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000172765s

	[INFO] 10.244.1.2:52635 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.028646205s

	[INFO] 10.244.1.2:41853 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000176274s

	[INFO] 10.244.1.2:35962 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000170835s

	[INFO] 10.244.0.4:41550 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130972s

	[INFO] 10.244.0.4:32938 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000173381s

	[INFO] 10.244.0.4:56409 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000073902s

	[INFO] 10.244.2.2:58163 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000268677s

	[INFO] 10.244.2.2:36365 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00010796s

	[INFO] 10.244.2.2:56656 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000115088s

	[INFO] 10.244.2.2:56306 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000139171s

	[INFO] 10.244.1.2:35824 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000200215s

	[INFO] 10.244.1.2:55897 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000096777s

	[INFO] 10.244.1.2:41692 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000109849s

	[INFO] 10.244.0.4:40290 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000106794s

	[INFO] 10.244.0.4:46779 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000132069s

	[INFO] 10.244.1.2:51125 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000201243s

	[INFO] 10.244.1.2:54698 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000184568s

	[INFO] 10.244.0.4:53882 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000193917s

	[INFO] 10.244.0.4:47773 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000121126s

	[INFO] 10.244.2.2:58238 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000117978s

	==> coredns [856f46390ed078527dc9fe5b83277da5845af344640c03eadebd71a1879f67b0] <==

	[INFO] 10.244.1.2:57277 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000266561s

	[INFO] 10.244.1.2:48530 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000385853s

	[INFO] 10.244.0.4:37489 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002109336s

	[INFO] 10.244.0.4:53881 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000132699s

	[INFO] 10.244.0.4:35131 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000120989s

	[INFO] 10.244.0.4:53761 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001344827s

	[INFO] 10.244.0.4:59481 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000051804s

	[INFO] 10.244.2.2:39523 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000137336s

	[INFO] 10.244.2.2:35477 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002190323s

	[INFO] 10.244.2.2:37515 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001525471s

	[INFO] 10.244.2.2:34201 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000119381s

	[INFO] 10.244.1.2:42886 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000230949s

	[INFO] 10.244.0.4:43156 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000079033s

	[INFO] 10.244.0.4:55330 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00010674s

	[INFO] 10.244.2.2:47730 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000245903s

	[INFO] 10.244.2.2:54559 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000165285s

	[INFO] 10.244.2.2:56225 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000115859s

	[INFO] 10.244.2.2:54334 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.0001069s

	[INFO] 10.244.1.2:43809 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130742s

	[INFO] 10.244.1.2:56685 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000199555s

	[INFO] 10.244.0.4:44188 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000154269s

	[INFO] 10.244.0.4:56530 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000138351s

	[INFO] 10.244.2.2:34814 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000138709s

	[INFO] 10.244.2.2:49549 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000124443s

	[INFO] 10.244.2.2:35669 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000100712s

	==> describe nodes <==

	Name:               ha-033260

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_30T11_12_00_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:11:56 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:18:18 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:11:55 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:11:55 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:11:55 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 30 Sep 2024 11:15:02 +0000   Mon, 30 Sep 2024 11:12:18 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.249

	  Hostname:    ha-033260

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 285e64dc8d10442694303513a400e333

	  System UUID:                285e64dc-8d10-4426-9430-3513a400e333

	  Boot ID:                    e1ab2d78-3004-455b-b8b3-86a48689299f

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-nbhwc              0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m43s

	  kube-system                 coredns-7c65d6cfc9-5frmm             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m17s

	  kube-system                 coredns-7c65d6cfc9-kt87v             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m17s

	  kube-system                 etcd-ha-033260                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         6m22s

	  kube-system                 kindnet-g94k6                        100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      6m17s

	  kube-system                 kube-apiserver-ha-033260             250m (12%)    0 (0%)      0 (0%)           0 (0%)         6m22s

	  kube-system                 kube-controller-manager-ha-033260    200m (10%)    0 (0%)      0 (0%)           0 (0%)         6m22s

	  kube-system                 kube-proxy-mxvxr                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m17s

	  kube-system                 kube-scheduler-ha-033260             100m (5%)     0 (0%)      0 (0%)           0 (0%)         6m22s

	  kube-system                 kube-vip-ha-033260                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m24s

	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m17s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%)   100m (5%)

	  memory             290Mi (13%)  390Mi (18%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m14s  kube-proxy       

	  Normal  Starting                 6m22s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m22s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m22s  kubelet          Node ha-033260 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m22s  kubelet          Node ha-033260 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m22s  kubelet          Node ha-033260 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m18s  node-controller  Node ha-033260 event: Registered Node ha-033260 in Controller

	  Normal  NodeReady                6m3s   kubelet          Node ha-033260 status is now: NodeReady

	  Normal  RegisteredNode           5m18s  node-controller  Node ha-033260 event: Registered Node ha-033260 in Controller

	  Normal  RegisteredNode           4m1s   node-controller  Node ha-033260 event: Registered Node ha-033260 in Controller

	Name:               ha-033260-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_09_30T11_12_57_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:12:54 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:15:48 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 30 Sep 2024 11:14:56 +0000   Mon, 30 Sep 2024 11:16:30 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.3

	  Hostname:    ha-033260-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 1504aa96b0e7414e83ec57ce754ea274

	  System UUID:                1504aa96-b0e7-414e-83ec-57ce754ea274

	  Boot ID:                    08e05cdc-874f-4f82-99d4-84bb26fd07ac

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-748nr                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m43s

	  kube-system                 etcd-ha-033260-m02                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         5m25s

	  kube-system                 kindnet-752cm                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      5m27s

	  kube-system                 kube-apiserver-ha-033260-m02             250m (12%)    0 (0%)      0 (0%)           0 (0%)         5m26s

	  kube-system                 kube-controller-manager-ha-033260-m02    200m (10%)    0 (0%)      0 (0%)           0 (0%)         5m22s

	  kube-system                 kube-proxy-fckwn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m27s

	  kube-system                 kube-scheduler-ha-033260-m02             100m (5%)     0 (0%)      0 (0%)           0 (0%)         5m26s

	  kube-system                 kube-vip-ha-033260-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m23s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m22s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  5m27s (x8 over 5m27s)  kubelet          Node ha-033260-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m27s (x8 over 5m27s)  kubelet          Node ha-033260-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m27s (x7 over 5m27s)  kubelet          Node ha-033260-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5m27s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           5m23s                  node-controller  Node ha-033260-m02 event: Registered Node ha-033260-m02 in Controller

	  Normal  RegisteredNode           5m18s                  node-controller  Node ha-033260-m02 event: Registered Node ha-033260-m02 in Controller

	  Normal  RegisteredNode           4m1s                   node-controller  Node ha-033260-m02 event: Registered Node ha-033260-m02 in Controller

	  Normal  NodeNotReady             110s                   node-controller  Node ha-033260-m02 status is now: NodeNotReady

	Name:               ha-033260-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_09_30T11_14_15_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:14:11 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:18:17 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:11 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:11 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:11 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 30 Sep 2024 11:14:41 +0000   Mon, 30 Sep 2024 11:14:31 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.238

	  Hostname:    ha-033260-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 581b37e2b76245bf813ddd1801a6b9a3

	  System UUID:                581b37e2-b762-45bf-813d-dd1801a6b9a3

	  Boot ID:                    92c7790b-7ee9-43e4-b1b8-fd69ae5fa989

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-rkczc                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m43s

	  kube-system                 etcd-ha-033260-m03                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         4m8s

	  kube-system                 kindnet-4rpgw                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      4m10s

	  kube-system                 kube-apiserver-ha-033260-m03             250m (12%)    0 (0%)      0 (0%)           0 (0%)         4m8s

	  kube-system                 kube-controller-manager-ha-033260-m03    200m (10%)    0 (0%)      0 (0%)           0 (0%)         4m8s

	  kube-system                 kube-proxy-fctld                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m10s

	  kube-system                 kube-scheduler-ha-033260-m03             100m (5%)     0 (0%)      0 (0%)           0 (0%)         4m8s

	  kube-system                 kube-vip-ha-033260-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m6s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m4s                   kube-proxy       

	  Normal  NodeHasSufficientMemory  4m10s (x8 over 4m10s)  kubelet          Node ha-033260-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m10s (x8 over 4m10s)  kubelet          Node ha-033260-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m10s (x7 over 4m10s)  kubelet          Node ha-033260-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m10s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m8s                   node-controller  Node ha-033260-m03 event: Registered Node ha-033260-m03 in Controller

	  Normal  RegisteredNode           4m8s                   node-controller  Node ha-033260-m03 event: Registered Node ha-033260-m03 in Controller

	  Normal  RegisteredNode           4m1s                   node-controller  Node ha-033260-m03 event: Registered Node ha-033260-m03 in Controller

	Name:               ha-033260-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-033260-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b68b4b088317c82ffa16da1c47933e77f0f5d128

	                    minikube.k8s.io/name=ha-033260

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_09_30T11_15_15_0700

	                    minikube.k8s.io/version=v1.34.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 30 Sep 2024 11:15:14 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-033260-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 30 Sep 2024 11:18:18 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:14 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:14 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:14 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 30 Sep 2024 11:15:45 +0000   Mon, 30 Sep 2024 11:15:34 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.104

	  Hostname:    ha-033260-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 3f7e5ab5969e49808de6a4938b82b604

	  System UUID:                3f7e5ab5-969e-4980-8de6-a4938b82b604

	  Boot ID:                    15a5a2bf-b69b-4b89-b5f2-f6529ae084b3

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-kb2cp       100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      3m7s

	  kube-system                 kube-proxy-cr58q    0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m7s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%)  100m (5%)

	  memory             50Mi (2%)  50Mi (2%)

	  ephemeral-storage  0 (0%)     0 (0%)

	  hugepages-2Mi      0 (0%)     0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 3m1s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  3m7s (x2 over 3m7s)  kubelet          Node ha-033260-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m7s (x2 over 3m7s)  kubelet          Node ha-033260-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m7s (x2 over 3m7s)  kubelet          Node ha-033260-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m7s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m6s                 node-controller  Node ha-033260-m04 event: Registered Node ha-033260-m04 in Controller

	  Normal  RegisteredNode           3m3s                 node-controller  Node ha-033260-m04 event: Registered Node ha-033260-m04 in Controller

	  Normal  RegisteredNode           3m3s                 node-controller  Node ha-033260-m04 event: Registered Node ha-033260-m04 in Controller

	  Normal  NodeReady                2m47s                kubelet          Node ha-033260-m04 status is now: NodeReady

	==> dmesg <==

	[Sep30 11:11] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050905] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.040385] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.839402] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.653040] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.597753] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +9.651623] systemd-fstab-generator[584]: Ignoring "noauto" option for root device

	[  +0.057096] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.058580] systemd-fstab-generator[596]: Ignoring "noauto" option for root device

	[  +0.170861] systemd-fstab-generator[610]: Ignoring "noauto" option for root device

	[  +0.144465] systemd-fstab-generator[622]: Ignoring "noauto" option for root device

	[  +0.293344] systemd-fstab-generator[651]: Ignoring "noauto" option for root device

	[  +4.055212] systemd-fstab-generator[744]: Ignoring "noauto" option for root device

	[  +4.356595] systemd-fstab-generator[883]: Ignoring "noauto" option for root device

	[  +0.065791] kauditd_printk_skb: 158 callbacks suppressed

	[  +7.315036] systemd-fstab-generator[1300]: Ignoring "noauto" option for root device

	[  +0.090322] kauditd_printk_skb: 79 callbacks suppressed

	[Sep30 11:12] kauditd_printk_skb: 21 callbacks suppressed

	[ +12.137075] kauditd_printk_skb: 38 callbacks suppressed

	[Sep30 11:13] kauditd_printk_skb: 24 callbacks suppressed

	==> etcd [aa8ecc81d0af259c51958db3b384b1a62da85024faac4051a96b0fbb721e91f8] <==

	{"level":"warn","ts":"2024-09-30T11:18:21.712437Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.719865Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.723937Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.732858Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.739531Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.749931Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.750895Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.754533Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.758563Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.764734Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.771975Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.778576Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.782856Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.786395Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.792288Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.798519Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.807611Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.809860Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.812311Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.813234Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.817504Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.821143Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.827143Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.833725Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-09-30T11:18:21.850771Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"318ee90c3446d547","from":"318ee90c3446d547","remote-peer-id":"1e3ede80da48fb5a","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 11:18:21 up 7 min,  0 users,  load average: 0.31, 0.18, 0.08

	Linux ha-033260 5.10.207 #1 SMP Mon Sep 23 21:01:39 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [6cf899810e1614b75c9475872ceb50ec8dcf1fed0857d7febea3992706943346] <==

	I0930 11:17:47.860978       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:17:57.862776       1 main.go:295] Handling node with IPs: map[192.168.39.238:{}]

	I0930 11:17:57.862852       1 main.go:322] Node ha-033260-m03 has CIDR [10.244.2.0/24] 

	I0930 11:17:57.862995       1 main.go:295] Handling node with IPs: map[192.168.39.104:{}]

	I0930 11:17:57.863020       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:17:57.863078       1 main.go:295] Handling node with IPs: map[192.168.39.249:{}]

	I0930 11:17:57.863084       1 main.go:299] handling current node

	I0930 11:17:57.863098       1 main.go:295] Handling node with IPs: map[192.168.39.3:{}]

	I0930 11:17:57.863102       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	I0930 11:18:07.854593       1 main.go:295] Handling node with IPs: map[192.168.39.3:{}]

	I0930 11:18:07.854770       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	I0930 11:18:07.854951       1 main.go:295] Handling node with IPs: map[192.168.39.238:{}]

	I0930 11:18:07.854979       1 main.go:322] Node ha-033260-m03 has CIDR [10.244.2.0/24] 

	I0930 11:18:07.855034       1 main.go:295] Handling node with IPs: map[192.168.39.104:{}]

	I0930 11:18:07.855052       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:18:07.855106       1 main.go:295] Handling node with IPs: map[192.168.39.249:{}]

	I0930 11:18:07.855130       1 main.go:299] handling current node

	I0930 11:18:17.860759       1 main.go:295] Handling node with IPs: map[192.168.39.238:{}]

	I0930 11:18:17.860855       1 main.go:322] Node ha-033260-m03 has CIDR [10.244.2.0/24] 

	I0930 11:18:17.860991       1 main.go:295] Handling node with IPs: map[192.168.39.104:{}]

	I0930 11:18:17.861014       1 main.go:322] Node ha-033260-m04 has CIDR [10.244.3.0/24] 

	I0930 11:18:17.861065       1 main.go:295] Handling node with IPs: map[192.168.39.249:{}]

	I0930 11:18:17.861084       1 main.go:299] handling current node

	I0930 11:18:17.861114       1 main.go:295] Handling node with IPs: map[192.168.39.3:{}]

	I0930 11:18:17.861129       1 main.go:322] Node ha-033260-m02 has CIDR [10.244.1.0/24] 

	==> kube-apiserver [cd2027f0a04e15268a463edfaacc1090c2975c49f972af0729d97b0d16cf23ac] <==

	I0930 11:11:58.463989       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0930 11:11:58.477865       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.249]

	I0930 11:11:58.479372       1 controller.go:615] quota admission added evaluator for: endpoints

	I0930 11:11:58.487328       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0930 11:11:58.586099       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0930 11:11:59.517972       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0930 11:11:59.542879       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0930 11:11:59.558820       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0930 11:12:04.282712       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0930 11:12:04.376507       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E0930 11:14:41.794861       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58556: use of closed network connection

	E0930 11:14:41.976585       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58584: use of closed network connection

	E0930 11:14:42.175263       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58602: use of closed network connection

	E0930 11:14:42.398453       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58626: use of closed network connection

	E0930 11:14:42.598999       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58646: use of closed network connection

	E0930 11:14:42.786264       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58670: use of closed network connection

	E0930 11:14:42.985795       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58688: use of closed network connection

	E0930 11:14:43.164451       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58700: use of closed network connection

	E0930 11:14:43.352582       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58708: use of closed network connection

	E0930 11:14:43.634509       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58726: use of closed network connection

	E0930 11:14:43.812335       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58746: use of closed network connection

	E0930 11:14:44.006684       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58766: use of closed network connection

	E0930 11:14:44.194031       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58782: use of closed network connection

	E0930 11:14:44.561371       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:58814: use of closed network connection

	W0930 11:16:08.485734       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.238 192.168.39.249]

	==> kube-controller-manager [e62c0a6cc031f8bf59e56d14e1e873c2b041e7d8e0b9bc574a57f461d7b2f489] <==

	I0930 11:15:14.593101       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:14.593158       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:14.605401       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:14.879876       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:15.297330       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:16.002721       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:18.158455       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:18.429273       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:18.922721       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-033260-m04"

	I0930 11:15:18.922856       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:19.229459       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:24.734460       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:34.561602       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:34.561906       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-033260-m04"

	I0930 11:15:34.575771       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:35.966445       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:15:45.204985       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m04"

	I0930 11:16:30.993129       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:30.994314       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-033260-m04"

	I0930 11:16:31.023898       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:31.050052       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="14.150574ms"

	I0930 11:16:31.050219       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="52.36µs"

	I0930 11:16:31.218479       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:34.045967       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	I0930 11:16:36.316239       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-033260-m02"

	==> kube-proxy [347597ebf9b2054ab77437e879ee112c6582729129d7f0aa43f5810028fca10c] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0930 11:12:06.949025       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0930 11:12:06.986064       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.39.249"]

	E0930 11:12:06.986193       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0930 11:12:07.041171       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0930 11:12:07.041238       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0930 11:12:07.041262       1 server_linux.go:169] "Using iptables Proxier"

	I0930 11:12:07.044020       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0930 11:12:07.044727       1 server.go:483] "Version info" version="v1.31.1"

	I0930 11:12:07.044757       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0930 11:12:07.047853       1 config.go:199] "Starting service config controller"

	I0930 11:12:07.048187       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0930 11:12:07.048613       1 config.go:105] "Starting endpoint slice config controller"

	I0930 11:12:07.048700       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0930 11:12:07.051971       1 config.go:328] "Starting node config controller"

	I0930 11:12:07.052033       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0930 11:12:07.148982       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0930 11:12:07.149026       1 shared_informer.go:320] Caches are synced for service config

	I0930 11:12:07.152927       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2435a21a0f6f84c3ffd21789f2a22ae0784155abbef7de3f0078227fb0bc3fb2] <==

	I0930 11:11:59.743507       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0930 11:14:38.641000       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-rkczc\": pod busybox-7dff88458-rkczc is already assigned to node \"ha-033260-m03\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-rkczc" node="ha-033260-m03"

	E0930 11:14:38.642588       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 12532e14-b4c0-4c7d-ab93-e96698fbc986(default/busybox-7dff88458-rkczc) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-rkczc"

	E0930 11:14:38.642720       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-rkczc\": pod busybox-7dff88458-rkczc is already assigned to node \"ha-033260-m03\"" pod="default/busybox-7dff88458-rkczc"

	I0930 11:14:38.642772       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-rkczc" node="ha-033260-m03"

	E0930 11:14:38.700019       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-nbhwc\": pod busybox-7dff88458-nbhwc is already assigned to node \"ha-033260\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-nbhwc" node="ha-033260"

	E0930 11:14:38.700408       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod e62e1e44-3723-496c-85a3-7a79e9c8264b(default/busybox-7dff88458-nbhwc) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-nbhwc"

	E0930 11:14:38.700579       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-nbhwc\": pod busybox-7dff88458-nbhwc is already assigned to node \"ha-033260\"" pod="default/busybox-7dff88458-nbhwc"

	I0930 11:14:38.700685       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-nbhwc" node="ha-033260"

	E0930 11:14:38.701396       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-748nr\": pod busybox-7dff88458-748nr is already assigned to node \"ha-033260-m02\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-748nr" node="ha-033260-m02"

	E0930 11:14:38.701487       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 004c0140-b81f-4e7b-aa0d-0aa6f7403351(default/busybox-7dff88458-748nr) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-748nr"

	E0930 11:14:38.701528       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-748nr\": pod busybox-7dff88458-748nr is already assigned to node \"ha-033260-m02\"" pod="default/busybox-7dff88458-748nr"

	I0930 11:14:38.701566       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-748nr" node="ha-033260-m02"

	E0930 11:15:14.650435       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-mkbm9\": pod kube-proxy-mkbm9 is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-mkbm9" node="ha-033260-m04"

	E0930 11:15:14.650543       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-mkbm9\": pod kube-proxy-mkbm9 is already assigned to node \"ha-033260-m04\"" pod="kube-system/kube-proxy-mkbm9"

	E0930 11:15:14.687957       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-kb2cp\": pod kindnet-kb2cp is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-kb2cp" node="ha-033260-m04"

	E0930 11:15:14.688017       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod c071322f-794b-4d6f-a33a-92077352ef5d(kube-system/kindnet-kb2cp) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-kb2cp"

	E0930 11:15:14.688032       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-kb2cp\": pod kindnet-kb2cp is already assigned to node \"ha-033260-m04\"" pod="kube-system/kindnet-kb2cp"

	I0930 11:15:14.688047       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-kb2cp" node="ha-033260-m04"

	E0930 11:15:14.701899       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-nbts6\": pod kindnet-nbts6 is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-nbts6" node="ha-033260-m04"

	E0930 11:15:14.702003       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-nbts6\": pod kindnet-nbts6 is already assigned to node \"ha-033260-m04\"" pod="kube-system/kindnet-nbts6"

	E0930 11:15:14.702565       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-cr58q\": pod kube-proxy-cr58q is already assigned to node \"ha-033260-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-cr58q" node="ha-033260-m04"

	E0930 11:15:14.705542       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod b2de7434-03f1-4bbc-ab62-3101483908c1(kube-system/kube-proxy-cr58q) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-cr58q"

	E0930 11:15:14.705602       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-cr58q\": pod kube-proxy-cr58q is already assigned to node \"ha-033260-m04\"" pod="kube-system/kube-proxy-cr58q"

	I0930 11:15:14.705671       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-cr58q" node="ha-033260-m04"

	==> kubelet <==

	Sep 30 11:16:59 ha-033260 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Sep 30 11:16:59 ha-033260 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Sep 30 11:16:59 ha-033260 kubelet[1307]: E0930 11:16:59.603405    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695019602992032,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:16:59 ha-033260 kubelet[1307]: E0930 11:16:59.603474    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695019602992032,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:09 ha-033260 kubelet[1307]: E0930 11:17:09.605544    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695029605156885,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:09 ha-033260 kubelet[1307]: E0930 11:17:09.605573    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695029605156885,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:19 ha-033260 kubelet[1307]: E0930 11:17:19.607869    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695039607317316,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:19 ha-033260 kubelet[1307]: E0930 11:17:19.608153    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695039607317316,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:29 ha-033260 kubelet[1307]: E0930 11:17:29.611241    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695049610444192,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:29 ha-033260 kubelet[1307]: E0930 11:17:29.611290    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695049610444192,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:39 ha-033260 kubelet[1307]: E0930 11:17:39.612829    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695059612275436,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:39 ha-033260 kubelet[1307]: E0930 11:17:39.613366    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695059612275436,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:49 ha-033260 kubelet[1307]: E0930 11:17:49.615817    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695069615300757,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:49 ha-033260 kubelet[1307]: E0930 11:17:49.616359    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695069615300757,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:59 ha-033260 kubelet[1307]: E0930 11:17:59.469234    1307 iptables.go:577] "Could not set up iptables canary" err=<

	Sep 30 11:17:59 ha-033260 kubelet[1307]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Sep 30 11:17:59 ha-033260 kubelet[1307]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Sep 30 11:17:59 ha-033260 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Sep 30 11:17:59 ha-033260 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Sep 30 11:17:59 ha-033260 kubelet[1307]: E0930 11:17:59.620277    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695079619430930,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:17:59 ha-033260 kubelet[1307]: E0930 11:17:59.620330    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695079619430930,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:18:09 ha-033260 kubelet[1307]: E0930 11:18:09.622386    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695089621956899,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:18:09 ha-033260 kubelet[1307]: E0930 11:18:09.622824    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695089621956899,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:18:19 ha-033260 kubelet[1307]: E0930 11:18:19.628964    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695099627068358,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Sep 30 11:18:19 ha-033260 kubelet[1307]: E0930 11:18:19.629013    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727695099627068358,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:146316,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-033260 -n ha-033260

helpers_test.go:261: (dbg) Run:  kubectl --context ha-033260 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (5.64s)